Komal Satpute

Project: Sage Publications (Sales Analytics)

Role: Azure Data Engineer

• Modernized data workflows by transitioning legacy on-premise ETL jobs (daily/monthly batches) to serverless Azure Synapse pipelines, cutting runtime by 35%.
• Designed and implemented scalable PySpark-based data transformations in Azure Synapse Analytics, processing millions of records daily, and optimizing ETL performance.
• Revamped SQL performance in Synapse serverless and dedicated SQL pools through workload management optimizations.
• Architected a medallion lakehouse model (Bronze, Silver, Gold) with Delta Lake on ADLS Gen2, improving data reliability for analytics teams.
• Spearheaded the lift-and-shift of SSIS workflows to cloud-native Synapse pipelines.
• Established a data governance framework using Jira-based issue tracking, with automated Confluence documentation sync, reducing metadata discrepancies by 90%.
• Pioneered cost-saving strategies by right-sizing Synapse clusters, and implementing auto-pause/resume for non-peak hours.
• Fortified data security via Azure Private Endpoints, data masking, and audit logging for compliance.

Project: Sage Publications - BI Cloud Migration

Role: Azure Data Engineer

• Designed and orchestrated robust ETL data pipelines using Azure Data Factory to ingest and process data from diverse source systems into Azure Synapse Analytics.
• Developed scalable, serverless PySpark transformations on Azure Databricks, replacing legacy scripts, and reducing processing time.
• Tuned and optimized SQL queries and stored procedures within Azure SQL DB, improving performance and lowering query costs by over 30%.
• Implemented a Delta Lake-based Lakehouse architecture, enabling efficient data versioning, time travel, and schema evolution.
• Migrated SSIS packages of on-premise ETL processes to Azure Synapse Analytics.
• Managed Azure Synapse SQL pools and optimized data partitioning strategies.
• Worked with Azure Blob Storage and ADLS Gen2 for structured/unstructured data storage.
• Ensured data security and compliance using Azure Key Vault and Managed Identity.
• Collaborated with BI teams to build Power BI dashboards for business insights.
• Collaborated with cross-functional teams for seamless integration of data sources into the company's data ecosystem.
• Actively attended Agile ceremonies, including sprint planning, retrospectives, and daily stand-ups, ensuring alignment between the development and testing teams.