Kiran K.

Kiran K.

Senior Software Engineer

Sydney, Australia
Hire Kiran K. Hire Kiran K. Hire Kiran K.

About Me

 Extensive experience in designing and developing enterprise data driven solutions.  Building modern data solutions on Azure & AWS Cloud platforms.  Extensive hands-on experience implementing data integration & Data Warehousing solutions using Azure Data Factory, Azure Databricks & Synapse DW.  Experience in implementing Enterprise Data Lake in Azure Cloud Platform.  Experience working in DevOps environment and implementing CI/CD pipelines.  Working knowledge with AWS Cloud platform – Redshift, S3, EMR, Lambda, Glue, DynamoDB  Develop reusable ETL frameworks for the data warehousing applications.  Programming with Python, C# & Scala  Demonstrated expertise utilizing the Alteryx Designer, Informatica Power Center & SSIS.  Preparing the analytical queries using SQL for data analysis.  Tuning complex SQL queries for optimum performance.  Python programming experience in building data pipelines, Rest APIs & Web Scraping.  Experience working with the version control tools – GitHub & Bitbucket  Develop Unix & PowerShell Shell wrapper scripts for process automation

Data Engineering 8 years Python 6 years Azure Synapse Analytics 4 years Databricks 4 years Amazon Web Services (AWS) 4 years Web Scraping 2 years Apache Airflow 3 years Apache Spark 4 years Azure SQL 4 years Unix Shell Scripting AWS Lambda 4 years Azure Logic Apps 2 years Data Analytics 8 years Azure Data Factory 4 years Azure Functions 2 years

Work history

ARQ Group
ARQ Group
Senior Data Consultant
2021 - 2022 (1 year)
Australia

  • Provided the solution design for several Customer Self service initiatives using batch & streaming integration patterns.

  • Coordinating with Business Analysts, Data Modelers, Developers and Enterprise Architects and propose the end-to-end architecture that meets the requirements and enterprise standards.

Azure Synapse Analytics Azure Cosmos DB Azure Event HubAzure Databricks
Data Driven
Data Driven
Senior Data Engineer
2020 - 2020
Australia

  • Developed Azure functions (C#, Python) to ingest the real time trip updates & vehicle position data from Open Data Hub through rest APIs. Created logic apps to expose the historical data through APIs for External users.

  • Created pipelines using Azure Data Factory to transform and load data into Synapse Data Warehouse & Azure SQL.

  • Build CI/CD pipelines to deploy Azure functions & data bricks notebooks to promote the code to production environment using Azure DevOps.

Azure FunctionsAzure DatabricksAzure Data FactoryAzure DevOpsMicrosoft Power Platform Azure Logic Apps Python 3

Portfolio

Upwork Profile
Upwork Profile

Successfully completed several projects as a freelancer in upwork earlier. One of projects that I completed is Web Scraping on NCAA Stats website . Created python executable to extract the data from team rankings site about the on the day schedules and for those teams get the latest rankings for different categories.

Tableau
Tableau

Tableau Public Profile

Education

Education
Batchelors in Technology
Jawaharlal Technological University
2002 - 2006 (4 years)