Unmesh Joshi
Lead Data Engineer
Pune
Summary
Skilled & Passionate business solutions technology professional with immense love for data. Accomplished in building brand new systems that meet complex business requirements. Expertise includes Data Ingestion and Data Processing Analytical problem-solver with a detail-oriented and methodical approach. Prepared to offer 8 years of related experience to a dynamic new position with room for advancement.
Overview
11
11
years of professional experience
6
6
years of post-secondary education
3
3
Certificates
Work History
Lead Data Engineer
Globant
08.2021 - Current
- Built Data ingestion flow to Azure Storage/Delta Tables from Azure storage queue & Event hub and processing data in Azure Databricks.
- Develop Spark applications using pyspark and spark SQL for analyzing and transforming data uncover insight into customer usage patterns
- Enhanced data quality and reliability for real-time analytics by designing and deploying robust data pipelines.
- Reduced latency in real-time analytics applications by optimizing query performance through indexing strategies and proper database design principles.
- Established strong working relationships with stakeholders across multiple departments, facilitating clear communication channels regarding project requirements and progress updates.
- Increased efficiency of ETL processes by automating manual tasks, reducing processing time and resource consumption.
- Achieved cost-effective cloud-based storage solutions for handling vast amounts of data, resulting in reduced operational expenses and increased scalability.
- Delivered high-quality code reviews for colleagues'' contributions following established coding standards and best practices, maintaining consistency throughout projects.
Application Development Team Lead
Accenture
12.2018 - 08.2021
- Develop Metadata driven ingestion framework to inject Large volumes of data into HDFS & Hive using NiFi
- Formulated strategies for application development framework creation and developmental processes - Specially Automation which has reduced Support work by 7% & 2 hours of customer time in validating the data.
Module Lead
Persistent Systems
06.2015 - 12.2018
- Worked With Persistent's product development team,Shareinsights-An ETL tool on Hadoop which enables users to mine meaningful insights from data sources that matter to them and create visualization.
- Developed Custom functionalities in Pyspark as per client requirements and integrated it with shareinsights.
Trainee Web Developer
Imagine Works
02.2014 - 12.2014
- Develop Campus connect-an online for students
- Investigated and resolved application issues for web-based programs
Education
Bachelor of Engineering - Computer Engineering
Padre Conceicao College of Engineering
Goa 06.2009 - 05.2013
HSSC - Computer Science
Dnyanprasarak Mandal College of Science
Goa 06.2008 - 05.2009
SSC - Science
New Goa's GS Amonkar Vidyamandir
Goa 06.2006 - 05.2007
Skills
PySpark & SparkSQL
Certification
Microsoft Certified Azure Fundamentals
Additional Information
Believe in Embracing & Adapting to the changes happening in life, if you cannot embrace, you wont learn, Grow and Become. keep learning & Keep Growing :)
Timeline
Databricks Data Engineer Associate
12-2023
Microsoft Certified Azure Fundamentals
08-2022
Lead Data Engineer
Globant
08.2021 - Current
Taming Big Data With Apache Spark & Python
05-2019
Application Development Team Lead
Accenture
12.2018 - 08.2021
Module Lead
Persistent Systems
06.2015 - 12.2018
Trainee Web Developer
Imagine Works
02.2014 - 12.2014
Bachelor of Engineering - Computer Engineering
Padre Conceicao College of Engineering
06.2009 - 05.2013
HSSC - Computer Science
Dnyanprasarak Mandal College of Science
06.2008 - 05.2009
SSC - Science
New Goa's GS Amonkar Vidyamandir
06.2006 - 05.2007
Hobbies
I Love to Follow My routines,Travel, Workout, Trekk, Badminton/Cricket. A big foodie !
Awards
- ACE : Customer Delivery / Bravo : Learning & Delivery
Similar Profiles
Delfina LotteroDelfina Lottero
Human Resources Junior Advanced at GlobantHuman Resources Junior Advanced at Globant
Yogesh HemnaniYogesh Hemnani
Senior Software Engineer at GlobantSenior Software Engineer at Globant
Matias NürnbergMatias Nürnberg
Senior Backend Developer NodeJs | NestJs at GlobantSenior Backend Developer NodeJs | NestJs at Globant