[TUTORIAL] Orchestrating an AWS EC2 cluster with Apache Airflow as a Systemd service
25 May 2020
In this tutorial I will go over the details on how to install and run Apache Airflow as a Systemd service on an AWS EC2 instance and orchestrate a cluster. I will also describe how to use a MySQL database as a backend for Airflow. Finally, I will show how to execute ssh commands across the cluster by going over a simple example of the Airflow SSH operator.
Ride-Share-Compare - Your Ride On Your Terms
01 Apr 2020
Ride-Share-Compare was the project that I completed as part of the Insight Data Engineering program. It is a platform where users can compare different ride-share options without the need to check each ride-share provider's application.
Exploring ATLAS Physics Data Sets in Python using uproot
17 Apr 2019
In this post I explore uproot, a python/numpy framework to read and write ROOT data files. The ROOT file I will be using is a data set containing simulated collision events from the ATLAS open data website.
My First Kaggle Kernel
08 Feb 2019
Recently, I joined a Kaggle 'Kernel only' competition. The competition was 'PUBG Finish Placement Prediction (Kernels Only)' with the goal of predicting the player ranking of a PlayerUnknown's Battlegrounds match. Since the ranking is based on how well players or teams perform in a match, my approach was to train a neural network incrementally on a per-match basis.
Everyday Converter: My first Android App
09 Oct 2018
In this post you can read about the process of developing my first Android app. Everyday Converter is an app to convert between units of measure such as length, volume, weight or time. It was developed for an easy user experience with the most basic units available to not overload the user interface. It is available for both Android on mobile phones or tablets and Wear OS for wearable devices and smartwatches.
How To Find Employers That Sponsor H1-B Visas
09 Oct 2018
Finding a job in data science as an international student can be challenging. In this article I present a way of using data science to analyse the H1-B disclosure data to understand where we can find employers that support H1-B visas.
VP1-Light: The Standalone ATLAS event display
07 Sep 2018
For my qualification task in the ATLAS experiment I worked on the experiments standalone event display VP1-Light. An event display in particle physics visualizes both the experiment itself and the physics happening within. VP1-Light can visualize the ATLAS detector with all its subcomponents in great detail and also display the particle physics interactions that happen when high energetic protons collide in the center of the detector.