SQL Server
Suyash Bhandarkar
Data Engineer
Mumbai
Summary
Data Engineer with 2.5+ years of experience in building large-scale data pipelines, ETL processes, and data warehouse solutions. Utilized technologies like Python, SQL, Spark, Azure Data Factory, Databricks and Spark Streaming
Overview
3
3
years of professional experience
4
4
years of post-secondary education
5
5
Certificates
Work History
Data Engineer
Capgemini
01.2024 - Current
- Managed and optimized end-to-end data pipelines for order and shipment data in Azure, ensuring 100% data accuracy and timely delivery for critical business operations.
- Defect management using ServiceNow
- Led job recovery processes in Databricks to minimize downtime and ensure business continuity, while aligning data engineering efforts with business goals and customer needs.
- Mentored a colleague throughout the project, providing guidance on project objectives, modules and project structure, ensuring my colleague knows the requirements and challenges associated with working for a client
Data Engineer
Capgemini
12.2022 - 01.2024
- Developed an end-to-end Azure data engineering solution using Azure Data Lake, Azure SQL Database, Azure Data Factory, and Databricks.
- Integrated Unity Catalog for governance, designed star schema models, managed SCD, and sourced data from GitHub to Azure SQL Database.
- Implemented Medallion architecture and built ETL pipelines with Azure Data Factory for incremental data loading and processing.
- Optimized data storage using Parquet format, improving performance over traditional CSV files.
- Technologies Used - Databricks, ADF, ADLS, Rapid API, Pandas, Unity Catalog
Education
Bachelor of Engineering - Information and Technology
Kavikulguru Institute Of Technology And Science
Nagpur, MH 06.2018 - 06.2022
Additional Information
- iPhone Data Analysis Spark Project
- End-To-End Azure Project 2- E-commerce Data Pipeline using Databricks
Certification
Microsoft Certified: Azure Fundamentals(AZ-900)
Timeline
Data Engineer
Capgemini
01.2024 - Current
Data Engineer
Capgemini
12.2022 - 01.2024
Bachelor of Engineering - Information and Technology
Kavikulguru Institute Of Technology And Science
06.2018 - 06.2022
Technical Skills
- Cloud Tech -Microsoft Azure
- Programming language - Pyspark,SQL
- Big Data Technologies - Spark,Pyspark,Spark SQL,Pandas,Numpy
- Streaming Technologies - Spark Structured Streaming,Kafka
- Cloud Computing - Databricks,Azure Data Factory(ADF),ADLS
- Data Engineering Tools - Azure,Data Modelling,ETL/ELT data pipeline
- Familiar-API,Rapid API,Docker,Service Now,
Skills
ETL development
undefinedWork Preference
Work Type
Full TimePart TimeContract WorkWork Location
On-SiteRemoteHybridWork Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Quote
The way to get started is to quit talking and begin doing.
Walt Disney
Software
Docker
Languages
English
Bilingual or Proficient (C2)
Hindi
Bilingual or Proficient (C2)
Interests
Data Scraping
Similar Profiles
Sai Amulya NarravulaSai Amulya Narravula
Guidewire Functional Tester at CapgeminiGuidewire Functional Tester at Capgemini
INDHIRAN RINDHIRAN R
Senior Consultant at CapgeminiSenior Consultant at Capgemini
Aasma ShaikhAasma Shaikh
Manager- GADM North America (Transformation Lead -Industrialization & Automation) and Sales to Delivery Handover Facilitator at CapgeminiManager- GADM North America (Transformation Lead -Industrialization & Automation) and Sales to Delivery Handover Facilitator at Capgemini
Bélinda BONACINABélinda BONACINA
Document Management, quality and configuration at CAPGEMINIDocument Management, quality and configuration at CAPGEMINI
Rohit PandeyRohit Pandey
Associate Technical Support Engineer at Red HatAssociate Technical Support Engineer at Red Hat