Senior Data Engineer- Healthcare Interoperability
We are seeking an experienced Senior Data Engineer to join our healthcare technology team with a primary focus on healthcare interoperability. This role will be instrumental in designing, building, and maintaining our Azure-based data infrastructure, including databases, data pipelines, analytics platforms, and business intelligence solutions — with an emphasis on integrating with Electronic Health Record (EHR) systems and healthcare data exchange standards (FHIR, C-CDA, HL7). The ideal candidate will have deep expertise in the Microsoft data stack, strong architectural thinking, and experience with healthcare data compliance requirements. This senior-level position will also provide technical leadership, mentorship to the broader engineering team and reports to the Director of Data Engineering.
Duties & Responsibilities:
- Design and implement scalable, secure data architectures on Azure to support business intelligence, analytics, and operational systems
- Build and maintain data pipelines using Azure Data Factory, Azure Synapse and related services
- Contribute to database designs across multiple platforms (Azure SQL Database, SQL Managed Instance, PostgreSQL, CosmosDB)
- Optimize data storage strategies across Azure Blob Storage, Data Lake, and structured databases
- Design data models and structures that enable efficient analytics and reporting
- Design, develop, and maintain complex stored procedures, functions, triggers, and views
- Implement database DevOps processes including schema versioning, deployment automation, and rollback procedures
- Perform database performance tuning, indexing strategies, and query optimization
- Ensure data integrity, security, and compliance with HIPAA/HITRUST requirements for PHI data
- Manage database lifecycle across development, pre-production, and production environments utilizing RedGate Flyway
- Design and implement ETL/ELT processes to integrate data from multiple sources
- Build event-driven data processing solutions including message producers, consumers, and workers using Azure Service Bus, Event Grid, and related messaging services
- Integrate with external REST APIs for data ingestion and develop internal data APIs using Python (FastAPI/Flask) on Azure Container Apps or Functions
- Develop data transformation logic and orchestration workflows
- Ensure data quality, consistency, and lineage across the data platform
- Integrate with Azure AI services and machine learning endpoints as needed
- Review designs of Power BI solutions including semantic models, reports, & dashboards
- Collaborate with stakeholders to translate business requirements into technical solutions
- Optimize data structures for reporting and analytics performance
- Provide technical guidance and mentorship to junior developers and engineers
- Contribute to data engineering best practices, standards, and patterns
- Participate in architecture reviews and technical decision-making
- Collaborate with DevOps and Infrastructure teams on platform improvements
- Drive continuous improvement in data quality, performance, and reliability
- Create and maintain comprehensive technical documentation including data dictionaries, architecture diagrams, and process flows
- Document data lineage, transformation logic, and business rules
- Ensure all data handling practices meet HIPAA/HITRUST compliance requirements
- Maintain audit trails and documentation for compliance purposes
- Troubleshoot and resolve complex data-related issues across the platform
- Provide escalation support for production incidents
- Collaborate with cross-functional teams to support business operations
- Participate in on-call rotation as needed
Preferred:
- Build and maintain integrations with EHR systems using FHIR resources (e.g., Patient, DocumentReference) and C-CDA document parsing/transformation
- Support HL7 v2/MDM/ADT message flows where needed, including message parsing and acknowledgment handling
- Define and maintain OpenAPI specifications and API versioning; write contract tests to prevent breaking changes
- Lead the document templating framework and server-side rendering pipeline for HTML-to-PDF output; ensure accessibility and compliance requirements
Experience & Qualifications:
Required:
- Bachelor’s degree in computer science, Information Systems, Data Engineering, or related field, or equivalent work experience
- 6+ years of experience in data engineering, database development, or related roles
- Expert-level proficiency in T-SQL and Microsoft SQL Server
- Expert-level proficiency of Python
- Experience building REST APIs and background workers in Python (FastAPI/Flask)
- Understanding of event-driven architectures and asynchronous processing patterns
- Strong experience with Azure data services (Azure SQL, Data Factory, Synapse, Blob Storage, etc.)
- Hands-on experience building and maintaining data pipelines and ETL/ELT processes
- Knowledge of Power BI development skills including DAX, data modeling, and performance optimization
- Solid understanding of database design principles, normalization, and data modeling
- Experience with version control systems (Git) and CI/CD practices
- Strong analytical and problem-solving abilities with attention to detail
- Excellent written and verbal communication skills
- Ability to work both independently and collaboratively in a team environment
- Microsoft certification (Azure Data Engineer Associate, Azure Database Administrator, Power BI Data Analyst)
- Knowledge of Infrastructure as Code (Terraform, Bicep, ARM templates)
- Knowledge of additional Azure services (Container Apps, Functions, Logic Apps)
- Experience with other database platforms (PostgreSQL, CosmosDB)
- Understanding of HIPAA/HITRUST compliance requirements for healthcare data
- Experience PowerShell for automation and scripting
- Experience with Azure DevOps or similar platforms for CI/CD
- Experience with data governance, cataloging, and metadata management
- Background in healthcare technology or regulated industries
- Experience with OpenAPI/Swagger specification design and contract testing
- Proficient in advanced usage of AI development tooling (e.g., Claude Code, GitHub Copilot)
- Azure API Management and private networking patterns
- Travel up to 15%.
Preferred:
- Practical experience with FHIR (resources, search parameters, OAuth2/SMART on FHIR) and C-CDA parsing/transformation
- Experience integrating with Epic, Cerner, Athena, or other EHR/EMR systems
- Experience with HL7 v2 (MLLP/MDM/ADT) message handling
Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, & activities may change at any time with or without notice.
