Created Airflow DAGs using Python, working on several Airflow components, including scheduler, web UI interface, and Airflow worker.

Setting up Amazon S3 buckets SFTP for reports that are generated using Airflow.

Creating and managing ETL/ELT pipelines, supporting ongoing ETL operations.

Scheduled and monitored SQL Server Agent Jobs and SSIS ETL jobs and created a batch Shell Script to automate the process.

Set up CI/CD processes for SQL code promotion to QA, UAT, and PROD environments using GitHub Actions.

Constructed Delta Lake tables in Databricks and worked on query optimization using SQL Profiler and Explain plan.

Created data mapping documents for source and destination databases and developed SQL scripts, optimizing the scripts for better performance.

Used Splunk GUI to query the logs and identify the underlying cause of the problems the production team was reporting.

Actively participated in developing and implementing data purge strategies and updating the entries in purge script as needed.

Created project documentation and used Confluence Pages while working with both Agile Scrum and Waterfall approaches.

Provided support in database structural changes such as schemas, tables, sequences, constraints, indexes, etc.

Developed SQL views, functions, and stored procedures to support data processing and reporting needs.

Analyzed new requirements, designed solutions, and developed advanced PL/SQL scripts as an Oracle BI data modeler.

Developed custom calculations, measurements, and KPIs using DAX.

Created a dashboard and reports using Azure Power BI and MS SQL Server 8.0 analytics platform.

Developed and maintained interactive dashboards and reports in Power BI, using Power Query to extract, clean, and transform data from SQL databases to be used in Power BI reports.

Created SQL queries, database tables, functions, procedures, views, and indexes and built new schemas in the existing Oracle database server.

Created DDL scripts for implementing the data model changes.

Performed data mapping as part of the migration task between MS SQL Server and Oracle databases.

Worked on performance tuning of the SQL queries by eliminating the redundant joins and code.

Designed an entity relationship (ER) model diagram as part of the database design documentation.

Offred production support, participated in code review meetings, and monitored query performance using Explain plans.

Created detailed documentation in Confluence for database management systems, aiding new developers in reducing onboarding time by 20%.

Worked with developers and provided SQL queries to create reports and dashboards for business analysis.