Abhishek Kumar
Pune
Summary
Experienced Cloud Data Engineer with over 5 years of expertise in designing and implementing scalable data pipelines and enterprise-grade ETL solutions on AWS. Proficient in AWS Glue, Lambda, Python, PySpark, SQL, and Databricks, with a focus on automating data workflows and optimizing performance. Skilled in CI/CD practices using AWS CodePipeline and Git, with hands-on experience in version control and code deployment. Strong background in data modeling, historical data migration, and processing large volumes of both structured and semi-structured data.
Overview
6
6
years of professional experience
1
1
Certification
Work History
AWS Data Engineer
WIPRO TECHNOLOGIES
11.2019 - Current
- Designed and implemented end-to-end data pipelines using AWS Glue, Lambda, Redshift, and Step Functions for telecom analytics workloads.
- Automated ingestion and transformation of large datasets from source systems to Redshift, implementing historical data strategies using SCD (Types I, II, III).
- Developed and optimized ETL scripts using PySpark and SQL for large-scale data processing on AWS Glue and Databricks.
- Built and maintained data warehouse solutions using Amazon Redshift, designing schemas (star and snowflake) to support business reporting.
- Reduced ETL runtime by 30% through performance tuning and code refactoring in PySpark and SQL jobs.
- Leveraged AWS Athena for interactive querying and data validation.
- Integrated CI/CD pipelines for Glue job deployment using AWS CodeCommit, CodePipeline, and Git, supporting automated testing and deployment.
- Created monitoring and alerting solutions using CloudWatch for ETL health and performance tracking.
- Collaborated closely with data analysts and business users to translate reporting requirements into scalable data models.
Education
Bachelor of Science - Computer Science Engineering and Technology
Institute of Engineering And Rural Technology
06.2019
Skills
- Cloud Platforms & Services:
AWS (Glue, Lambda, Redshift, Step Functions, S3, Athena, CloudFormation) - Programming & Data Processing:
Python, PySpark, Spark SQL, SQL - ETL & Data Integration Tools:
AWS Glue (ETL & Workflows), Informatica PowerCenter - Workflow Orchestration:
AWS Step Functions, Glue Workflows
- Infrastructure as Code (IaC):
AWS CloudFormation (proficient in authoring reusable templates) - Data Modeling & Warehousing:
Star Schema, Snowflake Schema, Slowly Changing Dimensions (SCD Types I, II, III) - CI/CD & DevOps:
AWS CodeCommit, CodePipeline, GitHub — experience with version control, automated builds, and deployment pipelines
Certification
- Teradata Vantage Certified Associate Advanced SQL Engine
- AWS Certified Solutions Architect Associate
Languages
English
Hindi
Hobbies and Interests
Reading Book, Travelling
Timeline
AWS Data Engineer
WIPRO TECHNOLOGIES
11.2019 - Current
Bachelor of Science - Computer Science Engineering and Technology
Institute of Engineering And Rural Technology
Similar Profiles
Ragavendran ChandranRagavendran Chandran
QA Engineer at WIPRO TechnologiesQA Engineer at WIPRO Technologies
RIYA TAYADERIYA TAYADE
Data Security Administrator at Wipro TechnologiesData Security Administrator at Wipro Technologies
Sujayeendra HKSujayeendra HK
Senior Software Test Engineer at Wipro TechnologiesSenior Software Test Engineer at Wipro Technologies
Loganathan SengottaiyanLoganathan Sengottaiyan
Technical Lead (Automation & QA) | Travelport at Wipro TechnologiesTechnical Lead (Automation & QA) | Travelport at Wipro Technologies
Niraj DigheNiraj Dighe
Lead Software Engineer at Cloud Software GroupLead Software Engineer at Cloud Software Group