Rohit Bhowate

Azure Data Engineer

Pune

Summary

Engineering graduate with 6.10 years of industry experience (IT).
Having 3.5+ years of experience with exposure to Designing, Developing, Analysis, and Implementation of productionized data ingestion processing pipelines, solutions, and post-implementation support of Data Warehouse applications using Microsoft SQL Server and Azure cloud technologies such as Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
Extensive experience in utilizing Azure Data Lake for data storage, Azure Databricks for data transformation, and Azure Data Factory for process orchestration.
Skilled in designing solutions in Azure Data Factory using Azure Data Lake Storage, Azure SQL Database, Azure Logic Apps, and APIs.
Proficient in all types of ADF activities such as Copy activity, Web activity, Dataflow activity, For Each activity, Lookup, etc.
Expertise in designing dynamic pipelines and datasets as reusable components using Configuration tables and pipeline parameters.
Worked in Agile Scrum with JIRA, GIT versioning.
Experience in developing Spark applications using PySpark in Databricks for data extraction, transformation, and aggregation from multiple file formats for analyzing and transforming data to uncover insights into customer usage patterns.
Strong understanding of Spark Architecture, including Spark Core, Spark SQL, DataFrames, Driver Node, Worker Node, Stages, Executors, and Tasks.

Overview

years of professional experience

Languages

Work History

Azure Data Engineer

EBaotech INDIA Pvt.Ltd.

05.2021 - Current

Designed and implemented ETL processes to extract, transform, and load data from various source systems into Azure Data Storage services, leveraging tool such as Azure Data Factory, Azure Databricks.
Built and maintained pipelines in Azure Data Factory, utilizing Linked Services, Datasets, and Pipelines to ingest data from diverse sources like Azure SQL, Blob Storage, Azure Data Lake and REST API’s. Configured and scheduled appropriate triggers to automate workflows.
Developed and optimized Spark applications using Spark SQL and PySpark in Databricks to transform, aggregate, and analyze datasets, driving insights into customer usage patterns.
Implemented Incremental loading in Databricks notebook.
Authored and optimized SQL queries to deliver efficient and scalable solutions that aligned with technical specifications and business objectives.
Collaborated with stakeholders to gather functional requirements, analysed data challenges, and escalate critical issues to business leadership for resolution.
Partnered with reporting teams to provide curated datasets tailored to analytics requirements, enabling insightful decision making.
Knowledge of Unity Catalog for data governance.
Familiarity with Azure Fabric for data integration and orchestration - Implemented unit testing frameworks in Azure Data Factory pipelines to validate data transformations, ensuring accurate and reliable ETL processes. Programming Python, Pyspark,SQL.
Experienced in utilizing Azure Data Factory components such as Pipelines, Linked services, Datasets, Triggers, Lookups, Get Metadata, For Each, and other activities.
Retrieved data from various sources such as ADLS Gen2, Azure Blob, and SQL Servers, and converted them to Parquet files, reducing the source file size by one-fourth.
Implemented IAM best practices with Entra ID, ensuring secure role-based access control across Azure services.
Experience with Synapse Dedicated and Serverless SQL Pools for scalable data processing and analytics.
Exploring Microsoft Fabric’s Lakehouse, Dataflows Gen2, Notebooks, and Shortcuts to build scalable, unified data architectures and streamline data integration. Databricks and Big Data Processing:
Used Databricks with PySpark for transformation of the data and Azure Synapse as storage.
Implemented Azure Databricks Delta tables for efficient data storage and management, ensuring faster query performance and enabling ACID transactions.
Created and managed Databricks notebooks for data transformation tasks using PySpark, automating data pipelines and improving data processing efficiency by 15%.
Utilized Databricks jobs to schedule and monitor data workflows, ensuring reliable and timely execution of data pipelines, which led to a 20% improvement in workflow consistency.

Administrator

WIPRO TECHNOLOGIES

03.2018 - 11.2020

Worked in Wipro Technologies for 2.8 Years as Major Incident Management Administrator(MIM).
As MIM administrator provided first level of support to the user on High priority issues like P1 & P2.
Worked on Incident & Change management in an US Account (Natural Gas & Electric providers).
Also initiated and co-ordinated Major incident management process for high severity incidents.
To maintain the data of every action taken by teams to resolve high priority incidents.
To initiate a bridge call with the resolver groups, vendor and client when high priority incident logged.
Have worked on Service now tool efficiently.
Worked on reporting's done on Excel for the account which is basically related to Service Level Agreement and KPI reports.
Reporting includes the daily, weekly & monthly incidents with the operational efficiency.
I was a part of review meetings with clients for the Project where the backlogs of incidents & service task highlighted.
To maintain the CRs (Change Request) reports approved by the Change Approver Board.
BI reporting using Power BI Dashboards.

Education

B.E - Electronics & Telecommunication

Nagpur University (RTMNU)

Nagpur

01.2016

Diploma - Electronics & Communication

Government Polytechnic

Nagpur

01.2013

Skills

Azure Data factory
Azure Databricks
Pyspark
SQL

Testing (Functional, System, Performance Testing)
Power BI Reporting
Data pipeline design
JIRA

Interests

Cycling,Political news

Timeline

Azure Data Engineer

EBaotech INDIA Pvt.Ltd.

05.2021 - Current

Administrator

WIPRO TECHNOLOGIES

03.2018 - 11.2020

B.E - Electronics & Telecommunication

Nagpur University (RTMNU)

Diploma - Electronics & Communication

Government Polytechnic