SQL Server
Suyash Bhandarkar
Data Engineer
Mumbai
Summary
Data Engineer with 2.5+ years of experience in building large-scale data pipelines, ETL processes, and data warehouse solutions. Utilized technologies like Python, SQL, Spark, Azure Data Factory, Databricks and Spark Streaming
Overview
3
3
years of professional experience
4
4
years of post-secondary education
5
5
Certificates
Work History
Data Engineer
Capgemini
01.2024 - Current
- Managed and optimized end-to-end data pipelines for order and shipment data in Azure, ensuring 100% data accuracy and timely delivery for critical business operations.
- Defect management using ServiceNow
- Led job recovery processes in Databricks to minimize downtime and ensure business continuity, while aligning data engineering efforts with business goals and customer needs.
- Mentored a colleague throughout the project, providing guidance on project objectives, modules and project structure, ensuring my colleague knows the requirements and challenges associated with working for a client
Data Engineer
Capgemini
12.2022 - 01.2024
- Developed an end-to-end Azure data engineering solution using Azure Data Lake, Azure SQL Database, Azure Data Factory, and Databricks.
- Integrated Unity Catalog for governance, designed star schema models, managed SCD, and sourced data from GitHub to Azure SQL Database.
- Implemented Medallion architecture and built ETL pipelines with Azure Data Factory for incremental data loading and processing.
- Optimized data storage using Parquet format, improving performance over traditional CSV files.
- Technologies Used - Databricks, ADF, ADLS, Rapid API, Pandas, Unity Catalog
Education
Bachelor of Engineering - Information and Technology
Kavikulguru Institute Of Technology And Science
Nagpur, MH 06.2018 - 06.2022
Additional Information
- iPhone Data Analysis Spark Project
- End-To-End Azure Project 2- E-commerce Data Pipeline using Databricks
Certification
Microsoft Certified: Azure Fundamentals(AZ-900)
Timeline
Data Engineer
Capgemini
01.2024 - Current
Data Engineer
Capgemini
12.2022 - 01.2024
Bachelor of Engineering - Information and Technology
Kavikulguru Institute Of Technology And Science
06.2018 - 06.2022
Technical Skills
- Cloud Tech -Microsoft Azure
- Programming language - Pyspark,SQL
- Big Data Technologies - Spark,Pyspark,Spark SQL,Pandas,Numpy
- Streaming Technologies - Spark Structured Streaming,Kafka
- Cloud Computing - Databricks,Azure Data Factory(ADF),ADLS
- Data Engineering Tools - Azure,Data Modelling,ETL/ELT data pipeline
- Familiar-API,Rapid API,Docker,Service Now,
Skills
ETL development
Data pipeline design
Data modeling
Data warehousing
Pyspark
SQL
Databricks
Azure Data Factory
Work Preference
Work Type
Full TimePart TimeContract WorkLocation Preference
On-SiteRemoteHybridWork Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Quote
The way to get started is to quit talking and begin doing.
Walt Disney
Software
Docker
Languages
English
Bilingual or Proficient (C2)
Hindi
Bilingual or Proficient (C2)
Interests
Data Scraping