
Sr. Data Engineer
Position Summary
DataSpring runs the largest healthcare data foundation in the U.S. The Sr. Data Engineer builds and owns the pipelines and data models behind our provider data platform and the ProView suite. You will spend most of your time writing production code on Azure Databricks and Azure SQL: ingesting provider data from many sources, modeling it with history and lineage, and deciding which source wins when they disagree. You will also own our data modeling standards and the automation that enforces them, and review the data model work of internal engineers and vendor delivery teams.
The Sr. Data Engineer is a full-time, remote, exempt position and reports to the Senior Director, Data Engineering & Architecture.
Specific Responsibilities
- Design, build, and operate production pipelines on Azure Databricks and Azure SQL that ingest, integrate, and publish provider data from internal and third-party sources.
- Design the data models those pipelines load, including integration and master-data layers with history (SCD Type 2), source lineage, and field-level survivorship rules.
- Write production-grade SQL, PySpark, Python, and DDL, and tune performance and cost on large datasets.
- Build data quality checks, reconciliation, monitoring, and alerting so problems surface before customers find them.
- Own the data modeling and naming standards for SQL Server, Azure SQL, and Databricks (Delta Lake, Unity Catalog), and build the automated checks in Azure DevOps CI/CD pipelines that enforce them.
- Review data models, schema changes, and pull requests from internal engineers and vendor teams, and record modeling decisions so they can be traced later.
- Maintain source-to-target mappings, data dictionaries, and ERDs, generated from the systems themselves wherever possible so they stay current.
- Partner with Data Science, product, billing, and application teams to turn business requirements into data models and clear data contracts.
- Protect PHI (Protected Health Information), including classification of sensitive columns, and maintain compliance with HIPAA, HITRUST, and SOC 2 audit requirements.
Supervisory Responsibilities
None. This role sets technical direction for internal engineers and vendor delivery teams without direct reports.
Skills
- Expert SQL and strong PySpark and Python, with a track record of building and running production pipelines, not only designing them.
- Deep relational and dimensional modeling skills, including history (SCD), entity resolution, and knowing when each approach is the wrong choice.
- Hands-on experience with Azure Databricks: Delta Lake, Unity Catalog, medallion architecture, job orchestration (e.g., Databricks Asset Bundles), and performance tuning.
- Git-based workflows and CI/CD in Azure DevOps or an equivalent platform, including database deployment automation with gated promotion across environments.
- Experience with data quality testing and pipeline observability.
- Ability to explain design decisions clearly to engineers, product owners, and leadership, and to hold a technical line with vendor teams while keeping the relationship productive.
Experience
Required:
- 8+ years in data engineering, including at least 4 years designing data models that reached production at scale.
- Recent, hands-on production engineering. You will be expected to write and ship code, not only review it.
- Demonstrated experience building master data management, entity resolution, or survivorship logic across multiple data sources.
- Experience defining data modeling standards and automating their enforcement.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
Preferred:
- Healthcare data experience, especially provider data, credentialing, or member eligibility data.
- Experience reviewing or directing the work of vendor or offshore delivery teams.
- Experience with data quality platforms (e.g., Ataccama) and data modeling tools (e.g., ER/Studio).
- Experience using AI-assisted development tools to build engineering automation.
Who We Are
DataSpring is the trusted data connector at the core of healthcare. For more than 25 years, we have powered the industry with the largest and most complete healthcare data foundation in the U.S., including more than 4.8 million provider data records sourced directly from providers and member data representing 75% of covered lives supplied by health plans. By improving how essential information flows across the system, DataSpring helps healthcare operate more efficiently, accurately, and with greater confidence.
What You Get
At DataSpring, you will do meaningful work at the intersection of healthcare, data, and technology, helping solve complex problems that make the healthcare system work better. You will collaborate with experienced professionals who care deeply about accuracy, trust, and meaningful impact in a fully remote environment.
DataSpring offers competitive compensation and a comprehensive benefits package for full-time employees, including medical, dental, and vision coverage, a 401(k) with company contributions and matching, paid parental leave, tuition assistance, and generous paid time off. We are committed to investing in our people and supporting professional growth over time.
Equal Opportunity Employer
DataSpring is proud to be an equal opportunity employer and is committed to fostering a workplace where all individuals are valued, respected, and empowered.
Employment decisions at DataSpring are made without regard to race, color, religion, sex, national origin or ancestry, age, marital status, disability, protected veteran status, personal appearance, sexual orientation, gender identity or expression, familial status, family responsibilities, matriculation, political affiliation, genetic information, source of income or any other characteristic protected by law. DataSpring does not tolerate unlawful discrimination or harassment of any kind.
Applicants have rights under the Family and Medical Leave Act (FMLA), Equal Employment Opportunity (EEO), and the Employee Polygraph Protection Act (EPPA). If you need a reasonable accommodation to apply for a posted position, please contact the DataSpring People & Culture team at careers@dataspring.com or 202-517-0436.
A faixa salarial para essa função é:
140.000 – 155.000 USD por ano (Remote (United States))
Data & Analytics
Remote (United States)
Compartilhar no: