Data Engineer

Job Description

Data Engineer

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Requirements

Advanced

English skills (B2\+).

Experience in

ETL and Azure tools

: A minimum of 2-5 years of experience in developing

ETL processes

using

Azure Data Factory, Azure Databricks, and other Azure cloud tools

.

Knowledge of

Apache Spark and Databricks

: Experience using Apache Spark for distributed data processing and knowledge of

Databricks

for data integration and transformation.

Proficiency in

Python

and

SQL:

Advanced skills in Python for automating processes and manipulating data, along with a strong understanding of SQL for querying and transforming data.

Handling large volumes of data: Ability to manage, transform, and optimize large volumes of data using cloud platforms and processing technologies like Spark.

Teamwork and communication: Collaborative skills with multidisciplinary teams and effective communication ability to interact with both technical and non-technical stakeholders.

Responsabilities

Develop and maintain efficient ETL pipelines using Azure Data Factory and Databricks to process and transform large datasets for analysis.

Analyze large datasets and build machine learning models using Python and Spark to extract actionable insights and solve business problems.

Utilize Apache Spark to process and analyze large volumes of data in a distributed environment, ensuring scalability and performance.

Deploy machine learning models to production using Azure and Databricks, and monitor their performance for continuous improvement.

Work closely with cross-functional teams (data engineers, business analysts, etc.) to understand requirements and communicate insights and results effectively to stakeholders.

What You´ll Love About Working Here

We recognize the significance of flexible work arrangements to provide support. Be it remote work, or flexible work hours, you will get an environment to maintain healthy work life balance.

At the heart of our mission is your career growth. Out array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities.

Equip yourself with valuable certification in the latest technologies.

Works in the area of Software Engineering, which encompasses the development, maintenance and optimization of software solutions/applications.1\. Applies scientific methods to analyse and solve software engineering problems.2\. He/she is responsible for the development and application of software engineering practice and knowledge, in research, design, development and maintenance.3\. His/her work requires the exercise of original thought and judgement and the ability to supervise the technical and administrative work of other software engineers.4\. The software engineer builds skills and expertise of his/her software engineering discipline to reach standard software engineer skills expectations for the applicable role, as defined in Professional Communities.5\. The software engineer collaborates and acts as team player with other software engineers and stakeholders.