Data Engineer

Databricks Developer

Franklin Park, IL

$125K-$155K

Permanent

About the Role

We're hiring a Databricks Developer to build and own our cloud-based data platform from the inside out. This is a newly created, high-impact position reporting to the Director of Enterprise Applications and Data Analytics within Information Technology.

You'll be transitioning work currently handled externally, taking full ownership of the Databricks environment and working closely with both technical teams and business stakeholders to deliver scalable, reliable data solutions. You'll be the specialist on a small, collaborative team — which means broad influence, real visibility, and the opportunity to shape standards, architecture, and best practices from day one.

This role is for someone who is ready to hit the ground running — not grow into it. If you thrive in environments where your work has direct, measurable impact and you enjoy wearing multiple hats, this is the right opportunity.

What You'll Be Doing

Data Platform Engineering

• Design, develop, and maintain scalable data pipelines and ELT/ETL workflows using Databricks and Apache Spark (PySpark/Spark SQL)
• Build and optimize lakehouse architecture using Delta Lake and related formats (Parquet, Iceberg)
• Apply medallion architecture principles — bronze, silver, and gold layers — across solution design
• Develop production-grade data workflows using Databricks Workflows and/or Declarative Pipelines
• Implement data governance, security, and access controls using Unity Catalog

Cloud \& Migration

• Support migration from legacy data warehouse systems to modern, cloud-based architectures
• Design and implement solutions on AWS, Azure, or GCP
• Implement CI/CD pipelines and infrastructure-as-code (Terraform, Databricks Asset Bundles, GitHub Actions)
• Monitor, troubleshoot, and resolve production pipeline issues to ensure reliability and performance

Collaboration \& Standards

• Partner with technical and business stakeholders to translate requirements into scalable data solutions
• Facilitate technical workshops to identify opportunities and deliver business value
• Participate in code reviews, testing, documentation, and deployment activities
• Contribute to the continuous improvement of data engineering standards, tools, and best practices
• Provide technical support during implementation and stabilization phases

What We're Looking For

Required

• 5\+ years of data engineering experience
• 4\+ years of hands-on experience with the Databricks platform
• Strong proficiency in Apache Spark (PySpark and/or Spark SQL)
• Experience designing and implementing solutions on AWS, Azure, or GCP
• Hands-on expertise in ELT processes, data security, data wrangling, and cloud computing
• Proficiency in SQL, data integration/EAI, database technologies, and visualization platforms
• Cross-functional experience — you've worked across multiple environments, not been siloed in one specialty
• Highly analytical, detail-oriented, and self-motivated with strong written and verbal communication skills
• Bachelor's degree in Engineering, IT, Computer Science, or a related field (preferred)

Nice to Have

• Databricks certification (especially valuable if no degree)
• Experience with business analytics design and development
• Familiarity with business processes and company-wide systems
• Background in manufacturing or similarly complex operational environments
• Strong change enablement and business process redesign skills