Senior Data Engineer (REMOTE OR HYBRID MA)

Senior Data Engineer role with The Hanover, responsible for designing, developing, and implementing data solutions using Azure and on-premises platforms. The role involves driving larger projects independently and mentoring junior engineers. Strong experience in data engineering and best practices is required.

Requirements

• Proven experience in data engineering and best practices for data storage, integration, transformation, and access within Azure and on-premises platforms.
• Proven expertise in designing and implementing data solutions utilizing Azure Resources (Azure Data Factory, Azure Synapse, ADLS, etc).
• Strong experience with data integration, ETL processes, and data warehousing.
• Advanced proficiency in SQL, Python, and PowerShell.
• Proven knowledge of data modeling, governance, and data engineering best practices and patterns.
• Hands-on experience with optimizing data ingestion pipelines and notebooks for scale, performance, reliability, and cost efficiency.
• Familiarity with integration connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST).
• Strong problem-solving, communication, and collaboration skills.
• Ability to create documentation for data processes and solutions.
• Ensure data security and compliance with industry standards.
• Experienced in agile development methodologies and DevOps best practices.
• Git/Github experience for CI/CD.
• Coaching, mentoring, and technical guidance for junior team members.
• Analytical skills for profiling and analyzing large data sets.
• Critical thinking and attention to detail.
• Debugging skills for data solution issues.
• Collaborate with data scientists, analysts, and stakeholders.
• Monitor and maintain data pipelines.
• Design, develop, and test data mapping with transformation rules.
• Ensure data quality and reliability.
• Develop and maintain documentation for data integration and ETL solutions.

Benefits

• Medical, dental, vision, life, and disability insurance
• 401K with a company match
• Tuition reimbursement
• PTO
• Company paid holidays
• Flexible work arrangements
• Cultural Awareness Day in support of IDE
• On-site medical/wellness center (Worcester only)