Calfus Inc - Data Engineering Lead/Architect

About The Role

As a Data Engineering Lead BI Analytics \& DWH, you will play a pivotal role in designing and implementing comprehensive business intelligence solutions that empower our organization to make data-driven decisions.

You will leverage your expertise in Power BI, Tableau, and ETL processes to create scalable architectures and interactive visualizations.

This position requires a strategic thinker with strong technical skills and the ability to collaborate effectively with stakeholders at all levels.

What Youll Do

• BI Architecture \& DWH Solution Design : Develop and design scalable BI Analytical \& DWH Solution that meets business requirements, leveraging tools such as Power BI and Tableau.
• Data Integration : Oversee the ETL processes using SSIS to ensure efficient data extraction, transformation, and loading into data warehouses.
• Data Modelling : Create and maintain data models that support analytical reporting and data visualization initiatives.
• Database Management : Utilize SQL to write complex queries, stored procedures, and manage data transformations using joins and cursors.
• Visualization Development : Lead the design of interactive dashboards and reports in Power BI and Tableau, adhering to best practices in data visualization.
• Collaboration : Work closely with stakeholders to gather requirements and translate them into technical specifications and architecture designs.
• Performance Optimization : Analyse and optimize BI solutions for performance, scalability, and reliability.
• Data Governance : Implement best practices for data quality and governance to ensure accurate reporting and compliance.
• Team Leadership : Mentor and guide junior BI developers and analysts, fostering a culture of continuous learning and improvement.
• Azure Databricks : Leverage Azure Databricks for data processing and analytics, ensuring seamless integration with existing BI solutions.

On your first day, we'll expect you to have :

• Bachelors degree in computer science, Information Systems, Data Science, or a related field.
• 6 to 12 years of experience in BI architecture and development, with a strong focus on Power BI and Tableau.
• Proven experience with ETL processes and tools, especially SSIS.
• Strong proficiency in SQL Server, including advanced query writing and database management.
• Exploratory data analysis with Python.
• Familiarity with the CRISP-DM model.
• Ability to work with different data models.
• Familiarity with databases like Snowflake, Postgres, Redshift \& Mongo DB.
• Experience with visualization tools such as Power BI, Quick sight and Plotly and or Dash.
• Code quality and management using version control and collaboration in data engineering projects.
• Strong programming foundation with Python with versatility to handle as :
• Data Manipulation and Analysis : using Pandas, NumPy \& PySpark.
• Data serialization \& formats like JSON, CSV and Parquet \& Pickle.
• Database interaction to query cloud-based data warehouses.
• Data Pipeline and ETL tools like Airflow for orchestrating workflows and, managing ETL pipelines : Scripting and automation.
• Cloud services \& tools such as S3, AWS Lambda to manage cloud infrastructure.

We'd Be Super Excited If You Have

• Azure SDK.
• Ability to interact with REST APIs and perform web scraping tasks.
• BI Architecture \& DWH Solution Design leveraging tools such as Power BI and Tableau.

(ref:hirist.tech)