The Principal Data Engineer (Databricks Platform) will design, develop, and maintain scalable data pipelines, ETL processes, and data warehouses to support data ingestion, transformation, and storage. The role requires strong Python/PySpark coding skills, collaboration with stakeholders, and evaluation of technologies and tools for data processing, storage, and analytics.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
- 12+ years of software engineering experience, with a focus on designing and implementing data platforms.
- Proven track record of successfully architecting and delivering large-scale data solutions.
- Strong proficiency in programming languages such as Python, Java, or Scala.
- Hands-on experience with data processing frameworks like Apache Spark or Apache Flink.
- Extensive knowledge of data warehousing, data modeling, relational databases, and NoSQL databases.
- Hands-on experience with AWS and cloud-based data services and solutions (e.g., Databricks).
- Excellent problem-solving skills, analytical thinking, and the ability to thrive in a fast-paced, dynamic environment.
Benefits
- Medical, Vision and Dental benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs)
- Generous paid time off policy including paid holidays, sick time and paid days off for your birthday, Free concert tickets
- 401(k) program with company match, Stock Program
- New parent programs & support including caregiver leave and childcare cash, infertility support
- Tuition reimbursement, student loan repayment internal growth and development programs & trainings
- Volunteer time off, crowdfunding network