Vikulp is a Senior Data Engineer who builds innovative products and creates optimized processes for service management. His expertise includes optimizing ETL pipelines, implementing ingestion services and REST APIs with Python and Flask, and setting up data pipelines using various warehouses or lakes like PostgreSQL, Delta Lake, and Snowflake. Vikulp additionally works with DDD-based data mesh architecture using Airflow and implements microservices with Python and Django using event-driven architecture.
Implemented data mesh architecture based on domain-driven design using Airflow for orchestration.
Implemented ingestion service and REST APIs using Python and Flask.
Measured read/write performance by setting up data pipelines that processed GBs of data using various warehouses or lakes like PostgreSQL, Delta Lake, and Snowflake.
Optimized ETL pipelines of Delta Lake using Spark for processing and reduced cost of infra needed to process and transform data.
An academic project (Jul-Dec 2016) to create an autonomous robot that can map an unknown environment while avoiding obstacles. Integrated wheel odometry data from encoders and RGBD SLAM data from Kinect for 3D mapping. Implemented a two-way serial communication system with map broadcasting and joystick control.