Staff Engineer – Data Platform and Lakehouse ( Databricks)

We are seeking and experienced Staff Engineer – Data Platform and Lakehouse to lead the design and implementation of our cloud-native Data Platform that support AI, advanced analytics, and machine learning applications in our ecosystem of B2B SaaS applications in the FinTech vertical You’ll work with a diverse team of talented engineers, AI and ML scientists, and product managers to build our next generation data and AI platforms, support migration of products from legacy infrastructure, and help product engineering teams leverage the Data platform and Lakehouse to launch new products and build new genAI applications. As a company that specializes in data-driven insights, the reliability, scalability, and effectiveness of our data & AI platforms are integral to our product offerings. This role requires deep technical expertise, strategic thinking, and strong collaboration across engineering, data science, and product teams.

Key Responsibilities:

• Design and implement scalable, secure, and maintainable data platforms on Databricks and AWS cloud infrastructure.
• Provide architectural leadership across engineering domains, ensuring consistency, scalability, and resilience
• Architect distributed data processing systems using Apache Spark and optimize for performance and scalability.
• Lead development of reusable data pipelines and workflows using Databricks Workflows.
• Translate business objectives into platform capabilities in collaboration with Product Managers and cross-functional teams.
• Support AI/ML initiatives through robust data engineering, including feature engineering, model deployment.
• Champion best practices in ETL/ELT, data quality, monitoring, observability, and Agile development.
• Drive adoption of data governance standards: access control, metadata management, lineage, and compliance.
• Establish and maintain CI/CD pipelines and DevOps automation for data infrastructure.
• Evaluate and integrate emerging technologies to enhance development, testing, deployment, and monitoring.

Salary Range: $180,000 -$220,000 (plus bonus)

Desired Skills and Expertise:

• 15+ years of experience in software development, covering the full SDLC: ideation, design, development, testing, deployment, and support.
• Strategic mindset, capable of aligning technical decisions with business goals and driving architectural vision.
• Excellent collaboration and communication skills across functions, including data scientists, MLOps engineers, and product managers.
• Advanced proficiency in Python and SQL, with a strong foundation in software engineering principles.
• Extensive experience with distributed computing frameworks, particularly Apache Spark, including performance tuning and scalability.
• Required hands-on experience with Databricks, including Unity Catalog, Feature Store, and Delta Live Tables.
• Proficiency in data pipeline orchestration tools using Databricks Workflows, Airflow, or AWS Glue; Databricks required.
• Strong command of data engineering best practices and tools, including ETL/ELT design, data quality validation, monitoring, and observability. Experience with Monte Carlo preferred.
• Proven ability to build scalable, cloud-native data architectures on Databricks, AWS, Azure, or GCP; Databricks required.
• Experience enabling AI/ML workloads including feature engineering, model deployment, and real-time processing.
• Strong understanding of data governance and security, including access control, data lineage, compliance, and metadata management.

Why work at Curinos?

• Competitive benefits, including a range of Financial, Health and Lifestyle benefits to choose from
• Flexible working options, including home working, flexible hours and part time options, depending on the role requirements – please ask!
• Competitive annual leave, floating holidays, volunteering days and a day off for your birthday!
• Learning and development tools to assist with your career development
• Work with industry leading Subject Matter Experts and specialist products
• Regular social events and networking opportunities
• Collaborative, supportive culture, including an active DE&I program
• Employee Assistance Program which provides expert third-party advice on wellbeing, relationships, legal and financial matters, as well as access to counselling services

Applying:

We know that sometimes the 'perfect candidate' doesn't exist, and that people can be put off applying for a job if they don't meet all the requirements. If you're excited about working for us and have relevant skills or experience, please go ahead and apply. You could be just what we need!

If you need any adjustments to support your application, such as information in alternative formats, special requirements to access our buildings or adjusted interview formats please contact us at careers@curinos.com and we’ll do everything we can to help.

Inclusivity at Curinos:

We believe strongly in the value of diversity and creating supportive, inclusive environments where our colleagues can succeed.  As such, Curinos is proud to be an Equal Opportunity Employer. We do not discriminate on the basis of race, color, ancestry, national origin, religion, or religious creed, mental or physical disability, medical condition, genetic information, sex (including pregnancy, childbirth, and related medical conditions), sexual orientation, gender identity, gender expression, age, marital status, military or veteran status, citizenship, or other protected characteristics.

Curinos empowers financial institutions to make better, faster and more profitable decisions through industry-leading proprietary data, technologies and insights. With decades-long expertise in the financial services industry and a relentless focus on the future, Curinos technology and analytics ecosystem allows clients to anticipate customer needs and optimize their go-to market decisions in an increasingly competitive market.

Curinos operates in a hybrid/remote model, and this position is hybrid in the Greater New York, Boston or Chicago metropolitan areas.