Megha M.

Megha M.

Bangalore, India
Hire Megha M. Hire Megha M. Hire Megha M.

About Me

Diverse and comprehensive experience in IT performing multiple roles as Technical Manager, Senior Consultant, Data Engineer, Team Leader, Scrum Master with rich experience in ETL processes and data migration projects. Have led and managed a numerous data-centric projects to go live, responsible for end-to-end delivery, including design, planning, coding, project execution, project automation, resourcing, mentoring, quality assurance and delivery.

AI, ML & LLM

SAML Blockchain

Frontend

CSS Vue Next.js React JavaScript HTML

Backend

Amazon API Gateway REST APIs Spring Microservice Third-party APIs APIs Amazon API Spring Interactive Brokers API Spring Boot Flask

Database

Databases MySQL PostgreSQL Database Design noSQL Amazon DynamoDB SQL Microsoft SQL Server MongoDB Oracle SQL

DevOps

Amazon Web Services (AWS) Cloud Jenkins Cloud Architecture AWS Data Pipeline Service Amazon S3 (AWS S3) Amazon Virtual Private Cloud (VPC) AWS AppSync Kubernetes DevOps CI/CD Pipelines AWS CloudFormation AWS Lambda AWS Amplify Docker AWS Elastic Beanstalk AWS Glue AWS Cloud Computing Services AWS DevOps

QA & Testing

Test-driven development (TDD)

Workflow

Git

Other

JSON Web Tokens (JWT) Kafka Streams Stock Trading Guice Role-based Access Control (RBAC) Full-stack Sybase IQ Architecture Debugging Serverless Framework Data Analytics Back-end Architecture FinTech Pandas Team Mentoring Amazon EC2 CDC Integration Amazon RDS KNIME Python Serverless C Google Guava Subversion (SVN) REST Software Design Sybase Android SDK Back-end Kibana Material Design Mockito Optimization Swagger Typescript Project Estimation System Architecture Technical Architecture Android Mobile Web Development Hadoop Big Data Design Patterns Elasticsearch Solution Architecture Data Analysis Java Slang Mobile Development Near-field Communication (NFC) Back4App Data Engineering Trading Amazon Aurora ETL Google Guice Leadership Amazon Ion Distributed Systems Project Management Apache Spark Kotlin Python 3 Scalability Spark Apache Kafka Microservices Gradle Microservices Architecture OAuth 2 Algorithms Perl Redshift Bitcoin Data pipelines Data Structures Numpy Parse Server Automated Trading Software Computer Science JSI

Work history

Oracle
Data Migration ETL Lead | Data Engineer
2012 - Present (13 years)
Remote

  • Successfully led and mentored a team of freshers in the high-stakes data migration project valued at multi million dollars.

  • An extensive ETL data migration engagement involving huge volumes of data extraction, data staging, cleaning, enrichment, formatting, application of complex business rules and final loading of 10 years of data into FLEXCUBE tables leveraging several automation tools created by me and my team.

  • Collaborated and Co-ordinated with multiple stakeholders involving FLEXCUBE teams, SCB Bank, FBC Holdings ensuring seamless integration of systems.

  • Implementing the project through writing pl/SQL migration scripts, running multiple Mock runs, DR runs on static and dynamic data having daily deliverables adhering to strict, non-negotiable deadlines.

  • Focused on Automating the processes and creating reusable generic utilities, conducting POCs and working on performance tuning to accommodate 10 years data migration.

  • Designed and got developed the migration of one the very complex Signatures module, extracting data from XML files, converting to CSV, and reconciling with JPEG images for over 10 years of customer records.

  • Conducted Agile ceremonies, daily scrums, Story creations and assignment in Jira, Holding Retrospective calls and all the related activities for Agile implementation of the Project having a team exceeding 11 members.

Infosys Technologies
Technology Lead | Software Engineer | Lead Tester
2006 - 2012 (6 years)
Remote

  • Implemented and Configured data product PMM to facilitate real time data integration in the application transitioning it from batch to real time processing. The impact was real time data was available in Netezza reporting database for Campaigning team to read real time purchasing behavior of customers and create more meaningful campaigns and coupons for them.

  • Enhanced the features and supported a web application that processes and reconciles travel data from multiple agencies, generating financial reports.

  • Developed PL/SQL procedures, debugged applications, created i-Reports, and automated testing using Rational Functional Tester (RFT).

Showcase

Back-end Web Server

  • Developed a back-end server with Python and Flask, deployed on AWS Lambda and API Gateway

  • Seamlessly integrated numerous APIs into a front-end website, Android application, and various app scripts

  • Implemented JWT authentication and role-based access control for secure access across all APIs

Rule Execution Platform for Amazon

  • I was a full-stack developer on the 'Rule Execution Platform for Amazon', contributing to the development of an Ion-based rule-execution platform for efficient micro-service creation.

  • Key implementations include an Ion data storage/retrieval solution with DynamoDB and Elasticsearch, a UI portal via REST APIs for seamless CRUD operations, an on-box caching solution, and a permission control system for secure data sharing.

  • All these developments have improved system resources and client interactions.

Messaging app for android

  • Developer created a non-instant messaging Android application

  • Full-stack development approach was taken, with focus on frontend design utilizing material design components

  • Used Back4App hosted Parse server for the backend solution

Swift Claim API for Amazon

  • Implemented a client-facing REST API using AWS technologies including Lambda, CloudAuth, and API Gateway to enable direct claiming of Amazon e-Gift cards

  • Established a cloud formation stack to connect API Gateway with Amazon's internal microservices and developed a Java client library for seamless API integration

  • Resolved the Lambda cold start issue using AWS CloudWatch events, reducing average latency by nearly 50%

Data Pruning Solution for GS Data Lake

  • Collaborated with senior developers to design the HDFS export feature, ensuring seamless implementation of data pruning functionality for Sybase IQ-based virtual warehouses.

  • This feature validates the presence of data within the underlying HDFS prior to executing the pruning workflow.

  • Ensured the functionality maintains compatibility with previous versions and long-term maintainability.

Automated Trading App

  • Developed and executed an automated trading application using Python and Interactive Broker APIs

  • Incorporated various technical indicators including DMI and ADX for informed trading decisions

  • Application is designed to automate the process of buying and selling securities

Data Pipeline for Amazon

  • Redesigned a data warehousing pipeline, achieving a 70% reduction in operational burden for the team.

  • Implemented a new serverless solution using Fast Data Pipelines and ensured backward compatibility for all six related microservices.

  • Executed daily SQL queries to reconcile data between the old and new solutions, and seamlessly transitioned to the new solution after verifying its accuracy.

Education

Education
B. Tech in Electronics and Communication Engineering
Guru Jambheshwar University of Science & Technology, Haryana
2003 - 2007 (4 years)