Mayur Marathe
PUNE,MAHARASHTRA
Summary
Data Engineer with 3.5 years of experience in building data-intensive applications, tackling challenging architectural and scalability problems in finance. Developing and maintaining programs on source systems, ETL applications, data cleansing, load automation, data acquisition, and others.
Overview
4
4
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Bajaj Finserv
02.2022 - 09.2024
- Maintained Azure Data Factory pipeline up-time of 99.9% while ingesting data from different sources i.e.Oracle, SQL, EDW etc.
- Written pyspark spark code in Databricks to merge incremental data and developed Azure Data Factory pipeline for orchestrating the end-to-end ETL batch process flow.
- We moved all scheduled tasks from the interactive cluster to the job cluster using multi- threading, which saved us 30% on costs.
- Developed data pipelines to ensure efficient data flow and accessibility.
- Collaborated with cross-functional teams to gather requirements for data integration projects.
- Implemented ETL processes using industry-standard tools for data transformation and loading.
- Supported the deployment of analytical solutions, improving decision-making capabilities across departments.
- We have moved all business groups to unity catalog(Central metastore) for fine access control on data lineages..
Software Engineer
IT Source Ltd
03.2021 - 02.2022
- Managing and coordinating with vendor team for development and implementation of business requirement..
- Designed and developed Power BI dashboards to monitor daily data ingestion status.
- Implemented row-level security (RLS) to ensure sensitive data was only visible to authorized users.
- Handle the support work such as incident tickets data quality issue tickets and perform support activities.
- Managed day-to-day support tasks such as addressing incident tickets, investigating and resolving data quality issues, coordinating with data engineering teams, and ensuring timely resolution of support requests.
Education
Master of Science - Computer Science
K.T.H.M College
Nashik06-2019
Computer Science
K.T.H.M College
Nashik06-2017
Skills
- ETL development
- Big data processing
- Python programming
- Data warehousing
- Azure Data Factory
- Azure DataBricks
- SQL
- AZURE SQL
- Power BII
- Pyspark
Certification
- Databricks Certified Data Engineer
- Microsoft Power BI Data Analyst
Languages
English
Marathi
Hindi
Timeline
Senior Data Engineer
Bajaj Finserv
02.2022 - 09.2024
Software Engineer
IT Source Ltd
03.2021 - 02.2022
Master of Science - Computer Science
K.T.H.M College
Computer Science
K.T.H.M College
Similar Profiles
KARTIK D BHATTKARTIK D BHATT
Cluster Head at Bajaj Finance Limited (Bajaj Finserv)Cluster Head at Bajaj Finance Limited (Bajaj Finserv)
Vijay BansalVijay Bansal
Area Credit Manager at BAJAJ FINSERV LENDING (Bajaj Finance Pvt. Ltd)Area Credit Manager at BAJAJ FINSERV LENDING (Bajaj Finance Pvt. Ltd)
RAJESH RRAJESH R
Senior Area Manager - Collections at Bajaj Finserv, Bajaj Finance LtdSenior Area Manager - Collections at Bajaj Finserv, Bajaj Finance Ltd
Chandan Kumar H NChandan Kumar H N
Deputy Manager at Bajaj FinservDeputy Manager at Bajaj Finserv
Vinayak Jagannath PatilVinayak Jagannath Patil
L3 Integration Engineer at Nokia Solution and Networks Pvt. Ltd. Payroll-Sterlite Technologies LimitedL3 Integration Engineer at Nokia Solution and Networks Pvt. Ltd. Payroll-Sterlite Technologies Limited