Senior AI Data Engineer
Location
USA
Salary
Not specified
Type
Full-time
Posted
Today
Job Description
About Us
About the Role
The Senior Data Engineer sits on Scorpion's AI team and plays a critical role in building and evolving the trusted data foundation that powers our AI products, tools, and decision-making. In this role, you'll build Scorpion's unified analytical data layer, providing AI agents, machine learning models, and internal teams with a single, reliable, and secure source of client and business data.
You'll partner closely with engineering, data science, product, and AI leaders to design scalable analytical systems, build production-grade data pipelines from operational and third-party sources, and ensure data access is performant, consistent, and aligned with business needs. Your work will directly influence how Scorpion leverages data and AI to deliver value to clients and employees.
Beyond day-to-day engineering, you'll help shape Scorpion's long-term AI and data platform strategy, determining how data is organized, governed, secured, and leveraged to support future products, insights, and AI-powered experiences. You'll establish and maintain data quality standards, reliability expectations, and service-level agreements that ensure trusted, queryable data is available across the organization.
What Your Success Will Look Like
- Evaluate and improve data quality, completeness, and consistency across 30+ databases, applications, platforms, and APIs.
- Design and build Scorpion's analytical data platform, creating a trusted source of truth for business and client data.
- Develop and maintain scalable data pipelines that efficiently move data from operational systems into the analytical platform.
- Help teams transition from querying production databases directly to using trusted analytical data sources.
- Design data access patterns that enable AI agents and applications to quickly retrieve relevant client and business information.
- Build secure, scalable solutions that deliver client context and business insights to internal applications and AI-powered experiences.
- Define, monitor, and improve service level agreements (SLAs) for data freshness, availability, reliability, and performance.
- Partner with engineering, product, and data science teams to establish data standards, governance practices, and data contracts.
- Continuously improve the scalability, performance, and reliability of Scorpion's data ecosystem.
Who You Are And What You Bring
- Education
- Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
- Experience
- 7+ years of data engineering experience, including designing and operating production-scale analytical data platforms.
- Experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments.
- Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms.
- Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions.
- Experience designing scalable data models that support analytics, reporting, and AI-driven applications.
- Experience establishing data governance standards, data contracts, and documentation practices across teams.
- Technical Skills
- Data Processing & Lakehouse Technologies
- Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation.
- Data Warehousing & Analytics
- Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
- Programming & Query Languages:
- Advanced SQL skills, including query optimization, execution planning, and performance tuning.
- Strong Python skills for data pipeline development, automation, transformation, and integration with production systems.
- Data Pipeline & Orchestration Tools
- Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools.
- Architecture & Security
- Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
- Data Processing & Lakehouse Technologies
- Professional Skills
- Ability to collaborate effectively across engineering, product, data science, and business teams.
- Strong communication skills with the ability to translate business requirements into scalable data solutions.
- Strong analytical and problem-solving skills with a focus on building scalable, maintainable systems.
- Ability to balance long-term platform strategy with near-term business priorities.
Our Scorpion Values
- Winning Mindset: When our clients win, we win.
- Genuine Care: We only succeed when we are truly invested in our clients and each other.
- Unmatched Results: We deliver more than expected–and then some–driving the best results and impacting lives.
- Constant Improvement: We believe there is always a better way. We learn we ask “What if?” we build and then do it again.
- Unbeatable Teamwork: We come from different backgrounds but have the same vision. We only get there by doing it together, as a team.
Compensation
We acknowledge that states have passed legislation promoting pay transparency. As a national employer, Scorpion has made the decision to post our expected pay rate or pay range (as applicable) in all our job postings, regardless of geographic location.
- The base salary range is $155,000 (entry-level) - $185,000 (highly experienced), exclusive of fringe benefits. If you are hired at Scorpion, your final base salary compensation will be determined based on factors such as geographic location, skills, education, and/or experience. Additionally, we believe in the importance of pay equity and consider the internal equity of our current team members as a part of any final offer. Please keep in mind that the range mentioned above is the total salary range for the role. Hiring at the maximum of the range would not be typical in order to allow for future & continued salary growth.
- The compensation package may also include incentive compensation opportunities in the form of discretionary bonuses or commissions.
Our Benefits
We invest in our employees by offering them diverse benefits from best-in-class carriers. These benefits provide enough choice and flexibility to keep our employees and their families healthy and happy—today and tomorrow.
- 100% employer-paid medical, dental, and vision insurance
- Flexible paid time off, so you can rest, relax, and recharge away from work
- Paid parental leave
- Paid cell phone and service
- Remote office allowance
- Professional development and development courses
- Regular manager check-ins to drive performance and career growth through Lattice
Work Location & Flexibility
Scorpion supports a range of work arrangements, including in-office, hybrid, and remote roles. For positions designated as remote, employees who live within commuting distance of a Scorpion office may be asked to work from the office based on team needs, collaboration opportunities, or business priorities. Specific expectations will be discussed during the interview process.
Looking for more opportunities?
Browse thousands of graduate jobs and entry-level positions.