Azure Data Engineer with 5+ years of hands-on experience building enterprise-scale data platforms, ETL pipelines,and cloud infrastructure. Specialized in Azure Data Factory, Synapse Analytics, Databricks, and SQL with proven ability to reduce data processing time by 60% and improve system reliability to 99.9%. Strong background in DevOps practices, real-time streaming architectures, and data governance frameworks that support business intelligence and analytics for financial services and technology sectors.
Azure Data Engineer with 5+ years of hands-on experience building enterprise-scale data platforms, ETL pipelines,and cloud infrastructure. Specialized in Azure Data Factory, Synapse Analytics, Databricks, and SQL with proven ability to reduce data processing time by 60% and improve system reliability to 99.9%. Strong background in DevOps practices, real-time streaming architectures, and data governance frameworks that support business intelligence and analytics for financial services and technology sectors.
- Designed and deployed enterprise data lake using Azure Data Lake Gen2, Synapse Analytics, and Databricks, migrating 5TB+ of
- trading data from on-premises to cloud and reducing storage costs by 40% for 500+ users.
- Engineered 50+ ETL/ELT pipelines with Azure Data Factory, PySpark, and Databricks to ingest Bloomberg and FactSet data,
- processing 2M+ daily records with 99.9% uptime and zero data loss.
- Implemented CI/CD pipelines using Azure DevOps, Terraform, and Git with automated testing frameworks, reducing deployment
- time by 70% and eliminating 85% of production incidents.
- Built real-time streaming architecture with Azure Event Hubs, Stream Analytics, and Kafka, reducing market data latency from 15
- minutes to 30 seconds for investment banking analytics supporting $3B+ deal flow.
- Developed infrastructure-as-code with Terraform and ARM templates for Azure resource provisioning, creating reusable modules
- that improved consistency and reduced environment setup time by 80%.
- Partnered with cross-functional teams to establish data governance using Azure Purview, cataloging 100+ data sources with
- automated lineage tracking to meet SEC and FINRA compliance requirements.
- Developed 40+ cloud data solutions using Azure Data Factory, Databricks, and Synapse Analytics, processing 10TB+ monthly data
- for 1000+ users across banking, healthcare, and e-commerce clients.
- Led cloud migration of 15+ legacy data warehouses to Azure using DMS, Python, and PowerShell automation, achieving 99.5% data
- accuracy and reducing infrastructure costs by 50% while maintaining zero downtime.
- Architected batch and real-time data pipelines with Azure Data Factory, Event Hubs, and REST APIs to integrate Salesforce, SAP,
- and Oracle ERP systems for unified BI and ML platforms.
- Implemented DevOps best practices with Azure DevOps, Jenkins, and Git, establishing CI/CD workflows with automated unit and
- integration testing that reduced deployment failures by 80%.
- Built distributed data processing using Apache Spark, Databricks, and Delta Lake for banking risk analytics and healthcare patient
- analysis, ensuring ACID transactions and 99.99% data consistency.
- Established monitoring and observability with Azure Monitor, Application Insights, and Log Analytics, creating custom dashboards
- that reduced MTTR by 45% and issue detection time by 60%.
- Implemented security and compliance using Azure Key Vault, RBAC, and data encryption to ensure HIPAA and GDPR compliance for
- healthcare and financial services clients with zero audit violations.
- Optimized Azure resource utilization through reserved instances, auto-scaling, and cost monitoring, reducing monthly cloud spending
- by 35% while maintaining performance SLAs for mission-critical workloads.