Ramping up the back end and data engineering.

• Revamped a MacOS security tool written in Go for malware detection and analysis and prepared it for production.

• Architected and built a highly scalable ETL pipeline that boosted throughput by 100x using AWS Batch to fetch video-ad creatives from third-party APIs.

• Built a centralized crawler that supports different search engines to crawl for organic and ad searches, improving the efficiency and effectiveness of Confiant's ad scanning capabilities.

• Built and architected an API engine on ECS clusters as a central aggregation layer for crawlers.

• Developed a robust and extensible STIX/TAXII builder API for the security team and configured an OpenCTI dashboard for visualizing cyber threats and observables.

• Created a YouTube live video scanner that uses Google Vision API to flag malicious domains and scams.

• Contributed to the migration of Confiant's core ad scanner from legacy PHP to Node.js and Puppeteer.

• Modeled and designed datasets, schema for a data warehouse (BigQuery) to process music streaming data and predict artist revenues.

• Created ETL pipelines to fetch data from multiple streaming platforms like YouTube, Spotify, Apple Music using Go and transform them in Python clusters.

• Paired with a data scientist to create a revenue prediction model using ML models like ARIMA and Moving avg.

• Migrated the initial prototype stack hosted on Heroku to a production-ready scalable system hosted on GCP, reducing runtime cost by 80%.

• Architected an event-driven microservices-based back-end infrastructure and set up deployments with CI/CD.

• Built an in-house artist catalogue aggregator service that works off of Spotify and iTunes web APIs.

• Built a payment analytics and financial service using Stripe Treasury to process 100K payments per day.

• Productionized the revenue prediction models and integrated them into scalable ML workflows.

• Built a payment analytics and reporting system and transitioned it to DAG pipelines.

• Built a log uploader in Go to scan file paths for rotated LXC, system logs and upload them to AWS S3.

• Added a session idle timeout in a pty shell written in Go, used for SSH access to a host region.

• Extended the manually implemented wtmp protocol to update utmp/wtmp records for a pty.

• Wrote Python build hook, which made Ceph volumes available to LXD clusters and flagged non-EBS volumes.

• Led the Analytics team in building a Python and Cassandra-powered analytics back end.

• Developed data modelling, data processing, and data aggregation engines and APIs in Python.

• Built a job scheduler for effective load sharing between services in Go.

• Implemented dithering and rasterization for printing images on receipts in Go.

• Maintained a React Native app and analytics dashboards in Angular.js and React.js.

• Created a clone of the existing platform to work for different users and added functionality, implementing architectural changes.

• Rewrote, revamped, and decluttered legacy Python code to use a more modularized approach.

• Managed and created internal tooling for Django admin and wrote Celery automation scripts.

• Rewrote almost every controller and added more services on the Angular.js front.

• Created features, widgets, and dashboards for internal and vendor-side use.

• Launched and worked on the developer newsletter on the side.

• Wrote the entire web app using Node.js, Angular.js, HTML/CSS, and Sass.

• Implemented static page caching combining the PHP/Laravel back end with Redis.

• Built a WordPress-powered blog for the company.

• Managed AWS production setup and wrote scripts for automated deployments.

• Implemented Docker and custom designed the UI/UX of a few website sections.