United States onlyAt Hypersonix, we are building the leading Generative AI Platform for Commerce. We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and infrastructure on Databricks.
Requirements
- 5+ years of experience in data engineering roles
- Expert-level proficiency in Databricks (Unity Catalog, Delta Live Tables, Workflows, SQL Warehouses)
- Strong understanding of cluster configuration, optimization, and serverless SQL compute
- Advanced SQL skills including query optimization, indexing strategies, and performance tuning
- Production experience with DBT (models, tests, documentation, macros, packages)
- Proficient in Python for data engineering (PySpark, pandas, data validation libraries)
- Hands-on experience with Git workflows (branching strategies, pull requests, code reviews)
- Proven track record implementing CI/CD pipelines (Jenkins, GitLab CI)
- Working knowledge of Snowflake architecture and migration patterns
- Additional technical skills: Experience with Apache Spark and PySpark optimization techniques (caching, partitioning, broadcast joins), understanding of data modeling concepts (dimensional modeling, data vault, normalization), knowledge of orchestration tools (Airflow, Databricks Workflows), familiarity with cloud platforms (AWS, Azure, or GCP) and their data services, experience with data governance, security frameworks and SOC2, ability to use Databricks system tables and monitoring tools for cost analysis
Benefits
- Competitive salary
- Full-time employment
India only
