Kiran K.

Kiran K.

Sydney, Australia
Hire Kiran K. Hire Kiran K. Hire Kiran K.

About Me

 Extensive experience in designing and developing enterprise data driven solutions.  Building modern data solutions on Azure & AWS Cloud platforms.  Extensive hands-on experience implementing data integration & Data Warehousing solutions using Azure Data Factory, Azure Databricks & Synapse DW.  Experience in implementing Enterprise Data Lake in Azure Cloud Platform.  Experience working in DevOps environment and implementing CI/CD pipelines.  Working knowledge with AWS Cloud platform – Redshift, S3, EMR, Lambda, Glue, DynamoDB  Develop reusable ETL frameworks for the data warehousing applications.  Programming with Python, C# & Scala  Demonstrated expertise utilizing the Alteryx Designer, Informatica Power Center & SSIS.  Preparing the analytical queries using SQL for data analysis.  Tuning complex SQL queries for optimum performance.  Python programming experience in building data pipelines, Rest APIs & Web Scraping.  Experience working with the version control tools – GitHub & Bitbucket  Develop Unix & PowerShell Shell wrapper scripts for process automation

AI, ML & LLM

Apache Airflow

Backend

Python Web Scraping

Database

Azure SQL

DevOps

Azure Synapse Analytics Amazon Web Services (AWS) AWS Lambda Azure Logic Apps Azure Data Factory Azure Functions

Other

Data Engineering Databricks Apache Spark Unix Shell Scripting Data Analytics

Work history

ARQ Group
ARQ Group
Senior Data Consultant
2021 - 2022 (1 year)
Australia

  • Provided the solution design for several Customer Self service initiatives using batch & streaming integration patterns.

  • Coordinating with Business Analysts, Data Modelers, Developers and Enterprise Architects and propose the end-to-end architecture that meets the requirements and enterprise standards.

Azure Synapse Analytics Azure Cosmos DB Azure Event HubAzure Databricks
Data Driven
Data Driven
Senior Data Engineer
2020 - 2020
Australia

  • Developed Azure functions (C#, Python) to ingest the real time trip updates & vehicle position data from Open Data Hub through rest APIs. Created logic apps to expose the historical data through APIs for External users.

  • Created pipelines using Azure Data Factory to transform and load data into Synapse Data Warehouse & Azure SQL.

  • Build CI/CD pipelines to deploy Azure functions & data bricks notebooks to promote the code to production environment using Azure DevOps.

Azure FunctionsAzure DatabricksAzure Data FactoryAzure DevOpsMicrosoft Power Platform Azure Logic Apps Python 3

Showcase

Upwork Profile
Upwork Profile

  • Completed several projects as a freelancer on Upwork

  • Completed a project on Web Scraping that involved extracting data from the NCAA Stats website

  • Created a Python executable to extract data about on-the-day schedules and latest team rankings for different categories

Tableau
Tableau

  • Tableau Public Profile

Education

Education
Batchelors in Technology
Jawaharlal Technological University
2002 - 2006 (4 years)