Work history
Senior Software Engineer
2022 - Present (2 years)• Revamping a MacOS security tool written in Go for malware detection and analysis, and preparing it for production. • Architected and built a highly scalable ETL pipeline that boosted throughput by 100x by leveraging AWS Batch to fetch Video-Ad creatives from 3rd Party APIs. • Built a centralized crawler that supports different search engines to crawl for organic and Ad searches, improving the efficiency and effectiveness of Confiant's ad scanning capabilities. • Built and architected an API engine on ECS clusters that served as the central aggregation layer for crawlers. • Developed a robust and extensible Taxii & Stix builder API for the security team, and configured an OpenCTI dashboard for visualizing cyber threats and observables. • Created a Youtube live video scanner that uses Google Vision API to flag malicious domains and scams. • Contributed to the migration of Confiant's core Ad scanner from legacy PHP to Nodejs and puppeteer
Data Engineer
2019 - 2019• Created data warehouse using BigQuery to process music streaming data and predict artist revenues. • Created ETL pipelines that fetches data from multiple streaming platforms like Youtube, Spotify, Apple Music using Go and transforms them in python clusters. • Paired with data scientist to create revenue prediction model using ML models like ARIMA and Moving avg. • Migrated the initial prototype stack hosted on Heroku to a production ready scalable system hosted on GCP, thereby reducing the runtime cost by 80%. • Architected an event-driven micro-services based backend infrastructure & set up deployments with CI/CD. • Built an in-house artist catalogue aggregator service that works off of Spotify and iTunes web APIs. • Built a payment analytics and financial service using Stripe Treasury to process 100k payments per day.
Cloud Engineer
2019 - 2019• Built a log-uploader in Go which would scan file paths for rotated LXC, system logs and upload them AWS S3 • Added a session idle timeout in a pty shell written in Go, used for SSH access to a host region. • Extended the manually implemented wtmp protocol, to update utmp/wtmp records for a pty. • Wrote python build hook which made Ceph volumes available to LXD clusters and flagged non EBS volumes.
Senior Software Engineer
2017 - 2017• Led the Analytics Team in building a Python and Cassandra powered Analytics backend. • Developed data modelling, data processing and data aggregation engines and APIs in python. • Built a job scheduler for effective load sharing amongst services in Go. • Implemented dithering and rasterization for printing images on receipts in Go. • Maintained a React-Native app and analytics dashboards in AngularJS and React.js.
Software Engineer
2016 - 2017 (1 year)• Created a clone of the existing platform to work for different users & added functionality. • Implemented architectural changes. Rewrote, revamped and de-cluttered legacy python code. • Managed and created internal tooling for django admin, wrote celery automation scripts. • Launched and worked on the developer newsletter on the side.
Software Engineer
2015 - 2015• Wrote the entire NodeJS & AngularJs webapp, including html, sass/css • Implemented static page caching combining the PHP/Laravel backend with Redis. • Built the Wordpress powered blog for the company. • Single-handedly managed AWS production setup and wrote scripts for automated deployments