Summary
Overview
Work History
Education
Skills
Accomplishments
Technical Competencies
Personal Information
Timeline
Generic

Mahendhar Egolapu

Hyderabad

Summary

Accomplished Big Data Solution Architect with 11 years of extensive experience in designing, developing, and optimizing data pipelines. Proficient in collaborating with system architects, data scientists, and analysts to streamline the flow of data within pipelines, ensuring consistency in data delivery and utilization across diverse projects. Adept at translating complex business requirements into scalable technical solutions, with expertise in various Big Data ecosystem tools and technologies.

Overview

12
12
years of professional experience

Work History

Solution Architect

Wipro Technologies
08.2019 - Current
  • Translated intricate business requirements into scalable technical solutions, adhering to data warehousing design standards, and proactively devised generic solutions to enhance efficiency.
  • Demonstrated expertise in data modeling and proficiency in programming languages including Java, Scala, and Python, facilitating the development of robust solutions.
  • Managed and maintained large-scale production Kafka Clusters and streaming applications using Spark within the Big Data ecosystem, ensuring seamless data processing and analysis.
  • Possessed a deep understanding of relational and NoSQL databases such as RDBMS, MySQL, Cassandra, and Redis, with advanced knowledge in replication and performance tuning techniques.
  • Proficient in various Big Data ecosystem tools including Hadoop, MapReduce, Scala, Spark Streaming, SparkSQL, Impala, Hive, and Oozie, enabling comprehensive data processing and analysis.
  • Conducted capacity planning at both table and database/file storage levels to accommodate smooth data growth and ensure optimal performance.
  • Implemented Continuous Integration and Continuous Deployment (CICD) practices, managing code repositories in Git and GitHub, and deploying batch pipelines using Jenkins and Rio tools.
  • Familiarity with scheduling tools like Airflow and Oozie for orchestrating Spark and MapReduce applications, facilitating streamlined workflow management and task scheduling.

Senior Analyst

Accenture Services Pvt Limited
06.2015 - 07.2019
  • Analyzed Hadoop cluster utilizing various big data analytic tools such as Sqoop, Hive, Oozie, Spark, and SparkSQL
  • Implemented Spark SQL over Hadoop Yarn to execute analytics on both structured data in Hive and unstructured data formats including CSV, XML, and JSON
  • Facilitated data import and export operations between SQL Server, Oracle databases, and HDFS, encompassing both local and external filesystems
  • Executed data cleansing, integration, and transformation tasks proficiently using Hive and SparkSQL programming.
  • Produced comprehensive technical documentation detailing the deployment procedures for launching applications onto the Hadoop cluster, along with guidelines for executing Hive and SparkSQL applications.

Senior Software Engineer

iGate Global Solution Limited
12.2012 - 02.2015
  • Utilized Sqoop to seamlessly load data from diverse sources like DB2 into HDFS, followed by ingestion into partitioned Hive tables.
  • Developed and optimized Hive queries for cross-cluster analysis, demonstrating a proficient understanding of partitioning and bucketing techniques for performance enhancement.
  • Very good understanding of partitions, bucketing concepts in Hive designed both managed and external tables Hive to optimize the performance
  • Engineered Oozie workflows to automate daily incremental data loads from RDBMS sources into Hive tables, ensuring data freshness and accuracy.
  • Created custom Hive User Defined Functions (UDFs) in Java to transform unstructured data into structured formats, enhancing data usability and efficiency.
  • Successfully integrated Kerberos authentication within Hadoop clusters, bolstering security measures and ensuring secure data access and processing.

Software Engineer

Bartronics Global Solution Limited
06.2012 - 12.2012
  • Utilized Sqoop to seamlessly load data from diverse sources like DB2 into HDFS, followed by ingestion into partitioned Hive tables.
  • Developed and optimized Hive queries for cross-cluster analysis, demonstrating a proficient understanding of partitioning and bucketing techniques for performance enhancement.
  • Very good understanding of partitions, bucketing concepts in Hive designed both managed and external tables Hive to optimize the performance
  • Engineered Oozie workflows to automate daily incremental data loads from RDBMS sources into Hive tables, ensuring data freshness and accuracy.
  • Created custom Hive User Defined Functions (UDFs) in Java to transform unstructured data into structured formats, enhancing data usability and efficiency.
  • Successfully integrated Kerberos authentication within Hadoop clusters, bolstering security measures and ensuring secure data access and processing.


Education

Master of Computer Application -

A.V PG Colleage, Osmania University
Hyderabad, India
06.2011

Bachelor of Science -

Goutham Sai Degree Colleage, Katatiya University
Godavarikhani
05.2007

State Board Of Intermediate Education(M.P.C) -

Vani Vidya Vhiar Junior College
GodavariKhani
2004

Telangana Board of Secondary Education -

Nethaji High School
GodavariKhani
01.2002

Skills

Big Data Tools:

  • Hive
  • Kafka
  • MapReduce
  • Oozie
  • SparkSQL
  • Spark Streaming
  • Cloudera Distribution

Programming Languages:

  • Java
  • Scala

Build Configuration Tools:

  • Jenkins
  • Rio

Databases:

  • RDBMS (Relational Database Management Systems)
  • MySQL
  • Redis

Accomplishments

  • VMware Certified Associate Data Center Virtualization
  • AchievedHabit Flagbearer - Being Responsive Award in Wipro 2023.
  • AchievedVictory League Award in Wipro 2022.
  • Achieved Maestro-Execution Excellence Award in Wipro 2022
  • Achieved Habit Flagbearer - Building Trust Award in Wipro 2022
  • Achieved Inspiring Performance Award in Wipro 2021
  • VMware Certified Associate Data Center Virtualization 2013

Technical Competencies

Hive, Kafka, Map Reduce, Oozie, SparkSQL, Spark Streaming, Cloudera Distribution, Java, Scala, Bash/Unix Scripting, Maven, Gradle, Gitlab, Jenkins, Airflow, Oracle DB, My SQL, Hive & Impala, Redis

Personal Information

 Data Engineer & Solution Architect

Timeline

Solution Architect

Wipro Technologies
08.2019 - Current

Senior Analyst

Accenture Services Pvt Limited
06.2015 - 07.2019

Senior Software Engineer

iGate Global Solution Limited
12.2012 - 02.2015

Software Engineer

Bartronics Global Solution Limited
06.2012 - 12.2012

Master of Computer Application -

A.V PG Colleage, Osmania University

Bachelor of Science -

Goutham Sai Degree Colleage, Katatiya University

State Board Of Intermediate Education(M.P.C) -

Vani Vidya Vhiar Junior College

Telangana Board of Secondary Education -

Nethaji High School

Similar Profiles

CREATE PROFILE
Mahendhar Egolapu