Location
London, England, UK
Salary
Not specified
Type
fulltime
Posted
Today
via linkedin
Job Description
Role: Data Engineer
Location: London (2 or 3 days in a week)
Employment: Fulltime (Sponsorship not available)
Key Responsibilities
- Design, develop, and maintain robust, scalable ETL/ELT pipelines using Azure Data Factory (ADF)
- Optimizing SQL queries, stored procedures, and functions for data transformation and performance tuning
- Own end-to-end delivery of data engineering tasks — from requirement gathering to deployment and support
- Mentor junior data engineers and review their code/pipeline designs
- Implement data quality checks, validation frameworks, and error-handling mechanisms within pipelines
- Integrate data from structured/unstructured sources (APIs, flat files)
- Collaborate with data analysts, and business stakeholders to translate requirements into technical solutions
- Contribute to CI/CD implementation for data pipeline deployments
- Maintain technical documentation for pipelines, data flows, and architecture
Required Skills
- Strong hands-on experience with SQL (complex joins, window functions, query optimization, indexing, stored procedures)
- 4\+ years of experience with Azure Data Factory (ADF) – pipelines, mapping data flows, triggers, linked services, integration runtimes
- Solid understanding of Data Engineering principles
- Strong working knowledge of the Azure data ecosystem: Azure Data Lake Storage (ADLS Gen2), Azure SQL Database
- Experience with performance tuning and troubleshooting pipeline/data issues
- Experience with version control (Git) and CI/CD pipelines (Azure DevOps preferred)
- Understanding of data governance, security, and compliance practices
- Strong analytical, debugging, and problem-solving skills
Preferred/Nice-to-Have Skills
- Experience with Databricks
- Familiarity with real-time/streaming data
- Microsoft Azure Data Engineer Associate (DP-203) certification
Looking for more opportunities?
Browse thousands of graduate jobs and entry-level positions.