Rahul Dube
Pune
Summary
Detail-oriented Data Engineer designs, develops and maintains highly scalable, secure and reliable data structures. Accustomed to working closely with system architects, software architects and design analysts to understand business or industry requirements to develop comprehensive data models. Proficient at developing database architectural strategies at the modeling, design and implementation stages.
Overview
2
2
years of professional experience
1
1
Certification
Work History
Data Engineer
PibyThree Consulting Services Private Limited
11.2022 - Current
- Revamped architecture for major client in highly regulated industry, optimizing their existing costs by 90%.
- Created a robust Azure Synapse ingestion framework for a Finance Client.
- Spearheaded efforts to strengthen security measures and minimize credential risks via the utilization of temporary credentials for accessing AWS S3 storage
- Implemented efficient data pipelines by leveraging Snowflake and various AWS services
- Successfully addressed intricate business challenges using exceptional problem-solving abilities, resulting in significant contributions to various projects and initiatives.
- Led a team to achieve significant milestones after only one year of joining the organization.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Streamlined complex workflows by breaking them down into manageable components for easier implementation and maintenance.
Junior Software Engineer
PibyThree Consulting Services PvT Ltd
08.2022 - 10.2022
- Trained under senior industry experts.
- Achieved the distinction of being the only person in the organization to clear the SnowPro Core certification by Snowflake within the first month of training.
- Gained proficiency in niche technologies such as Azure ADF, Matillion ETL/ELT, and DBT Cloud.
Completed two mini-projects:
- Handled 120 objects from Salesforce and created an Enterprise Data Warehouse (EDW) in Snowflake using Azure Data Factory (ADF) as the ETL tool.
- Developed a similar project using Matillion ELT as the ETL tool.
Education
Bachelor of Computer Engineer - Computer Science
Amrut Vahini Engineering College
Sangamner, Maharashtra05.2022
Skills
- Cloud Platforms (AWS/Azure)
- Snowflake
- SQL Expertise
- Python
- Data Modeling
- Problem-Solving
- Data Pipeline Design
- ETL development
- Data Migration
- Shell Scripting
- NoSQL Databases
- Data warehousing expertise
Certification
- SnowPro Core Certified, Snowflake - [09/2024-09/2026]
- AWS Cloud Practitioner, AWS - [12/2023-12/2026]
- Matillion Associate Developer, Matillion - [09/2023-09/2026]
- Dataiku Advanced Designer, Dataiku Academy - [03/2024-03/2026]
Personal Information
Title: DATA ENGINEER
LinkedIn Profile - https://linkedin.com/in/rahul-dube
Projects
AWS Cloud Architecture Revamp
- Environment: AWS Cloud
- Issue: $200K bill due to architectural flaws.
- Actions: Evaluated and redesigned architecture.
Implemented serverless solutions (AWS Lambda, ECR, Batch, Step Functions).
Established event-driven architecture (S3, CloudTrail, EventBridge).
Created dynamic pipeline for file processing and storage.
Used DynamoDB for metadata and audit logs.
Developed PowerBI dashboard for cost analysis.
- Outcome: Achieved 90% cost reduction.
- Environment: Azure Cloud
- Initial Implementation: Developed framework for 25 scheduled and 4 real-time Salesforce objects.
Used Azure Synapse Analytics (ETL) with built in SQL server pool to store the auditing and error logging tables.
Implemented error-handling, audit logs, and email alerts.
Stored data in ADLS Gen2 in Parquet format to be consumed by BI teams.
- Current Work: Migrating framework to Salesforce-ADF-(Azure Blob)-Snowflake on client request.
Accomplishments
In the first three months of my initial project, I identified issues in the existing architecture for file ingestion. I then successfully conducted an architectural analysis, redesigned the system, and developed a more robust and efficient solution.
Languages
English
Upper intermediate (B2)
Hindi
Advanced (C1)
Marathi
Bilingual or Proficient (C2)
Timeline
Data Engineer
PibyThree Consulting Services Private Limited
11.2022 - Current
Junior Software Engineer
PibyThree Consulting Services PvT Ltd
08.2022 - 10.2022
Bachelor of Computer Engineer - Computer Science
Amrut Vahini Engineering College
Similar Profiles
Deo Nath PaswanDeo Nath Paswan
Biomedical Engineer at T & M Services Consulting Private Limited.Biomedical Engineer at T & M Services Consulting Private Limited.
Bharath Kumar RBharath Kumar R
Senior Developer at Virtusa Consulting Services Private LimitedSenior Developer at Virtusa Consulting Services Private Limited
Ashutosh RanjanAshutosh Ranjan
Customer Service Associate at T & M Services Consulting Private LimitedCustomer Service Associate at T & M Services Consulting Private Limited