Senior Data Engineer

Summary

Job Description

Responsibilities

• Participate in multiple simultaneous projects with a focus on data preparation and pipeline development for predictive modeling and machine learning. Includes:

• Data interrogation, exploratory data analysis, profiling, and reconciliation

• Data pipeline creation, revision and monitoring based on product manager and data scientist/actuarial input

• Feature creation, initial testing, and ongoing management

• Work collaboratively with other staff including product managers, data scientists, other data analysts, architects to solve problems, develop innovative approaches, and provide project status

• Create and manage data assets, datasets, features, and code with a focus on simplicity, scalability, reusability, and clear documentation

• Additional work assignments not related to specific project work such as new feature development, external data research, providing user feedback on new products and tools under development

• At Guidewire, we foster a culture of curiosity, innovation, and responsible use of AI—empowering our teams to continuously leverage emerging technologies and data-driven insights to enhance productivity and outcomes.

Qualifications

• Bachelors or Masters degree or equivalent industry experience

• Passion for solving complex data problems

• 7-10+ years of relevant experience

• Advanced, hands on experience building modeling datasets, pipelines and features for predictive modeling

• Extensive experience using DBT, Apache Iceberg, and AWS data capabilities like Airflow, Glue, Redshift, EMR to build ML data pipelines, with a strong focus on data quality and governance.

• Expert SQL skills, including advanced functions, table design, view creation, stored procedure and script design and coding, general performance tuning

• Proficient in data processing and transformations using Apache Spark.

• Working knowledge of Python

• Experience with version control systems (e.g., Git) for managing data pipelines and features.

• Understanding of MLOps principles and practices related to data preparation and feature engineering; experience using Sagemaker and feature stores a plus

• Familiarity with common challenges in integrating RDBMS-sourced data into a data warehouse, including temporal data handling, Change Data Capture (CDC), Slowly Changing Dimensions (SCD), and data modeling methodologies like Kimball and Data Vault

• Experience within a regulated industry (finance, insurance, etc…); P&C policy administration and claims processing concepts as well as US/Canadian P&C standard lines of business experience a plus

• Self-motivated and detail-oriented with desire to solve problems

• Demonstrated ability to embrace AI and apply it to your role as well as use data-driven insights to drive innovation, productivity, and continuous improvement.

Disability Accommodations and Guidewire’s Appeals Process. Guidewire provides accommodations to the hiring process to create a fair opportunity for candidates with disabilities to contend for open positions. Accommodation requests should be directed to Accommodations@guidewire.com. If things do not go as hoped, we invite you to use our appeals process. Guidewire promises to independently review any denied accommodation and any decision not to offer you the position. The appeals process is the same in either case. Within five business days of receiving a notice of denial of an accommodation, or receiving a notice of your non-selection for a vacancy, e-mail Accommodations@guidewire.com to make an appeal. Guidewire will assign a new decision-maker to review the request and/or hiring decision, who will then notify you in writing of a decision within 10 business days.

About Guidewire

Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently. We combine digital, core, analytics, and AI to deliver our platform as a cloud service. More than 540+ insurers in 40 countries, from new ventures to the largest and most complex in the world, run on Guidewire.

As a partner to our customers, we continually evolve to enable their success. We are proud of our unparalleled implementation track record with 1600+ successful projects, supported by the largest R&D team and partner ecosystem in the industry. Our Marketplace provides hundreds of applications that accelerate integration, localization, and innovation.

For more information, please visit www.guidewire.com and follow us on Twitter: @Guidewire_PandC.

Guidewire Software, Inc. is proud to be an equal opportunity and affirmative action employer. We are committed to an inclusive workplace, and believe that a diversity of perspectives, abilities, and cultures is a key to our success. Qualified applicants will receive consideration without regard to race, color, ancestry, religion, sex, national origin, citizenship, marital status, age, sexual orientation, gender identity, gender expression, veteran status, or disability. All offers are contingent upon passing a criminal history and other background checks where it's applicable to the position.