Rohit G. is a Software Engineer with experience in data engineering and machine learning operations. He has worked on optimizing data ingestion pipelines, migrating pipelines and transitioning tables to Databricks Unity Catalog. Rohit G. has experience with Azure, Databricks, Kubernetes and various other technologies. He is also certified in Databricks, AWS, Dataiku and other areas.
Optimized data ingestion pipelines, achieving cost savings and improved processing efficiency.
Migrated pipelines from a shared ADF to a dedicated ADF and set up CI/CD to automate code deployment.
Streamlined oil refining data ingestion from various sources with Azure Data Factory and Databricks.
Optimized long-running spark jobs on the Kubernetes clusters.
Automated migration of projects from EMR to EKS using Dataiku APIs and Jupyter Notebooks.
Prepared a one-click solution for deploying a project and checking Code Quality using Azure DevOps, SonarQube, Pylint and Trufflehog.
Applied OpenCV DNN for Face Detection.
Calculated Embeddings and Euclidean distances of images using FaceNet and TensorFlow.
Clustered similar images using the Chinese Whispers Algorithm.
