I am a Senior Software Engineer with 13+ years of technical insight in data (Big Data) analysis; iterating high-quality solutions for clients in the advertising and banking industry. I have hands-on mastery in Big Data analysis, AWS data pipeline processing, Hadoop and Java development; working on big-scale data-centric projects across the software development process. I am an avid learner of new technologies with team lead expertise for globally distributed software development teams.
Worked on a Data Analysis and Reporting solution for one of the world's largest online advertising platforms - with the capacity to process 15-20bn Avro records of data a day. The platform comes with a complete chain of data analysis tasks for data collection from ad servers with Log Collector, aggregation and analysis using Apache Pig scripts/AWS Glue/Hive on AWS EMR fleet of around 300-350 high-tier nodes and post-processed for presentation purposes onto a self-managed Vertica database. Oversaw the architecture, implementation, and maintenance of complex data analysis components (with sole ownership of a fleet of around 20 ETL chains mainly related to AOL Advertisings’ SSP solution. Managed a team of up to 10 Big Data engineers globally as a Team Tech Lead; communicating with Business Team/Project Owners on the project, and implementing multiple components used in the data analysis process (mainly Java, also Shell Scripting and Python). Improved the tech stack of the SSP Advertising platform used globally by customers; enhancing its scalability and performance.
Introduced GDPR compliance into the platform's data analysis ecosystem to ensure that every single piece of data going through the data analysis ecosystem was GDPR compliant. Oversaw the architecting, implementation, and maintenance of the set of GDPR-related components (Apache Pig aggregations, record-filtering components, AWS Glue/Amazon Athena components, storage). Liaised with Project Owners on the best strategies for GDPR compliance on the Verizon Media Advertising data processing platform. The new solution was published globally in Jan, 2018
Migrated the data analysis components of a large-scale platform from a self-hosted and managed fleet of Flume servers, Cloudera Hadoop cluster of around 80 nodes and Vertica database to AWS infrastructure (AWS EMR fleet of around 300-350 nodes, LogCollector/Vertica/all other components running on EC2 instances). Worked on performance-tuning and cost optimization of data analysis components onto AWS. Selected tech stack and services for the migration of the whole AOL Advertising SSP data analysis solution to AWS; providing the client with ease of management and cost-savings. The migration and was completed and deployed globally in 2017.
This is AOL/Verizon Media Advertising's major global DSP solution which allows advertisers to create, manage, monitor and adjust their advertising campaigns across all DSP-enabled Verizon Media assets.
Architected and developed the Aol Advertising Shared Services on the platform. Lead and mentored a team of engineers in architecting and developing the AdLearn Open Platform. Developed and improved the AdDesk solution and overhauled the AdLearn Open Platform; integrating it with multiple target data vendors and SSP platforms (like Facebook, Microsoft, Yahoo) with enhanced scalability and performance. This was a multi-thousand customer project, initially published by Ad.com, now serving as the core DSP Advertising offering of Verizon Media.
Senior Software Engineer
2019 - Present (3 years)
Creating and developing innovative software solutions for clients across a broad range of industries.
Participate in scrums consisting of cross-functional teams, both software and hardware.
Ensure that features are being delivered efficiently and on-time.