Data Engineer

About the Role

Viable Solutions is seeking

5 experienced Data Engineers

to join our team and deliver critical ETL pipeline solutions for an enterprise client. You will be responsible for designing, building, and operating automated ETL jobs that extract data from SQL databases and CSV files, transform them into consumer-defined formats, and securely deliver them to downstream systems via SFTP and similar mechanisms. This role requires self-starters who can independently design and deliver robust data pipeline solutions while ensuring the highest standards of data security and PII protection.

Key Responsibilities

ETL Pipeline Development

• Design, build, and maintain end-to-end ETL pipelines for extracting, transforming, and loading data across enterprise systems
• Read and process data from

SQL databases and CSV files

• Transform and reformat data into consumer-defined

CSV file interfaces

• Deliver processed data files securely to consumer systems via

SFTP or similar file transfer mechanisms

• Build reusable, modular, and maintainable ETL components and frameworks
• Optimise ETL jobs for performance, reliability, and scalability

Data Transformation \& Quality

• Develop complex data transformation logic — filtering, aggregation, mapping, cleansing, and enrichment
• Parse and process

XML and CSV

data formats across multiple source systems

• Implement data quality checks, validation rules, and reconciliation processes
• Identify and resolve data issues, gaps, and inconsistencies across pipelines

Deployment \& Environment Management

• Deploy ETL solutions to

non-production and production environments

with appropriate controls

• Implement and maintain CI/CD pipelines for ETL workloads
• Manage deployment processes with proper change management and approval controls
• Support testing — unit testing, SIT, and UAT — across all pipeline deployments

PII \& Data Security

• Implement appropriate controls to

protect Personally Identifiable Information (PII)

throughout the data pipeline

• Ensure data masking, encryption, and access controls are applied consistently
• Adhere to data governance, privacy, and compliance requirements across all data assets
• Follow security best practices for file transfer and data delivery mechanisms

Design \& Architecture

• Independently design and propose appropriate technical solutions for ETL and data pipeline requirements
• Document technical designs, data flows, and pipeline architecture
• Collaborate with business stakeholders and consumer teams to understand data requirements and output specifications
• Contribute to technical reviews and architecture discussions

AWS Cloud Operations

• Deploy and operate ETL workloads on

AWS

— Lambda, Glue, S3, EC2, Step Functions, or similar

• Manage AWS infrastructure supporting data pipeline operations
• Ensure high availability, performance, and cost efficiency of cloud-based ETL solutions

Required Skills \& Experience

• 5–8\+ years of hands-on data engineering experience
• Strong proficiency in

Python

— ETL scripting, automation, and pipeline development

(mandatory)

• Strong proficiency in

Java

— enterprise-grade data processing components

(mandatory)

• Advanced

SQL

skills — complex querying, stored procedures, and database interactions

(mandatory)

• Experience with

XML

— parsing, transformation, and data format handling

(mandatory)

• Hands-on

AWS

experience — Glue, Lambda, S3, Step Functions, EC2, or similar

(mandatory)

• Proven experience building and operating

ETL pipelines

in production environments

• Experience with

SFTP and secure file transfer

mechanisms

• Experience processing and transforming

CSV and flat file formats

• Strong understanding of

PII data protection

and data privacy best practices

• Experience deploying to

non-production and production environments

with appropriate controls

• Ability to work as a

self-starter

and independently design and deliver solutions

• Strong analytical and problem-solving skills with high attention to detail