Optimized data ingestion pipelines, achieving cost savings and improved processing efficiency.

Migrated pipelines from a shared ADF to a dedicated ADF and set up CI/CD to automate code deployment.

Streamlined oil refining data ingestion from various sources with Azure Data Factory and Databricks.

Optimized long-running Spark jobs on the Kubernetes clusters.

Automated migration of projects from EMR to EKS using Dataiku APIs and Jupyter Notebooks.

Prepared a one-click solution for deploying a project and checking code quality using Azure DevOps, SonarQube, Pylint, and Trufflehog.

Deployed the NLP framework Flair as an ECS service.

Created a generic Python library used across pharmaceutical clients.

Dockerized Jenkins and executed a CI/CD pipeline into it.

Automated execution of an Airflow data ingestion pipeline.

Standardized and refactored Pharma project data.

Worked on Stardog API to create microservices.

Applied OpenCV DNN for face detection.

Calculated embeddings and Euclidean distances of images using FaceNet and TensorFlow.

Clustered similar images using the Chinese Whispers Algorithm.