- As a Databricks Data Engineer, you will work directly with clients across multiple industries to design, implement, and optimize Databricks-based data solutions
- You will be a key member of our Professional Services delivery teams, delivering high-quality projects on time and within scope while building strong client relationships
This is a client-facing role that combines hands-on technical delivery with consulting best practices
Key Responsibilities
- Lead and contribute to end-to-end Databricks implementations for clients, including data migration, Lakehouse architecture, and pipeline development
- Gather technical requirements, design solutions, and present recommendations to client stakeholders (technical and business)
- Build scalable ETL/ELT pipelines using PySpark, Delta Lake, Delta Live Tables (DLT), and Databricks Workflows
- Design and implement Databricks Genie
- Design and implement semantic layers
- Use Databricks AI features to accelerate development, debugging, and code optimization
- Design and implement Lakebase architectures for operational and analytical workloads, including transactional data use cases
- Develop solutions using SDLC best practices, including modular code design, testing, and documentation
- Use Git based version control with proper branching strategies
- Implement CI/CD pipelines for Databricks asset
- Implement data quality checks, validations, and expectations within workflows
- Design and implement Unity Catalog governance, security, and lineage solutions
- Optimize Databricks workloads for performance, cost, and reliability (Photon, cluster policies, Liquid Clustering, Auto Loader, etc.)
- Integrate Databricks with client ecosystems (Azure, AWS, GCP, Snowflake, Kafka, legacy systems, etc.)
- Support client workshops, proof-of-concepts (POCs), and knowledge transfer sessions
- Collaborate with client data teams to ensure successful adoption and handover of solutions
- Deliver projects following consulting methodologies while meeting quality, timeline, and budget expectations
- Document architectures, runbooks, and best practices for client use
Participate in solutioning activities (scoping, estimation, technical demos) as needed
Requirements (Must-Have)
- 3 -5 years of hands-on Databricks experience (or strong Spark experience with significant recent Databricks work)
- Proven experience delivering Databricks projects in a consulting or professional services environment (preferred) or equivalent client-facing project delivery
- Strong proficiency in PySpark, Spark SQL, Python, and SQL
- Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs
- Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows
- Cloud platform experience (Azure Databricks, AWS, or GCP - at least one)
- Excellent client-facing and communication skills - able to explain complex concepts to both technical and non-technical audiences
- Solid understanding of data governance, security, and Lakehouse best practices
Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience)
Nice-to-Haves
- Databricks certifications (Data Engineer Associate / Professional, Lakehouse, etc.)
- Experience with dbt, Airflow, Terraform, Databricks Asset Bundles (DABs), or MLflow
- Background in specific industries (Financial Services, Healthcare, Retail, Manufacturing, etc.)
- Experience with large-scale data migrations or legacy system modernization
Knowledge of streaming (Spark Structured Streaming / Kafka) and real-time analytics
Skills & Qualities
- Strong consulting mindset: ownership, adaptability, and client success focus
- Excellent problem-solving, analytical, and presentation skills
- Ability to work independently and as part of a delivery team
- High emotional intelligence and stakeholder management ability
Commitment to delivering exceptional client outcomes
What We Offer
Datavail is one of the largest data focused services company in North America and provides both professional and managed services and expertise in Database Management, Application Development and Management, Cloud & Infrastructure Management, Packaged Applications and BI/Analytics
Databricks Data Engineer
Datavail is a leading provider of database management services, specializing in solutions that enhance database performance and reliability.
Stay safe on Himalayas
Never send money to companies. Jobs on Himalayas will never require payment from applicants.
About the job
Education
Bachelor degree
Experience
3 years minimum
Experience accepted in place of education
Location requirements
Hiring timezones
United States +/- 0 hoursJob categories
About Datavail
Learn more about Datavail and their company culture.
Founded with a mission to help companies effectively manage their data through top-notch database services, Datavail has become a leader in the data management industry. Datavail offers a range of services designed to enhance the performance, availability, and overall success of database solutions.
The company specializes in providing database administration, development, and support services for a multitude of database platforms. With a focus on customer satisfaction, Datavail implements tailored solutions to meet the unique needs of each client, ensuring seamless data operations and management. Their expertise spans across various industries, allowing for customized approaches that facilitate growth and operational efficiency.
Tech stack
Learn about the tools and technologies that Datavail uses to build, market, and sell its products.
.NET
Amazon Redshift
Snowflake
AWS Glue
Talend
Tableau
Amazon Quicksight
Microsoft Azure
Salesforce
MySQL
PostgreSQL
5 moreDatavail employees can create an account to update this tech stack.
Employee benefits
Learn about the employee benefits and perks provided at Datavail.
Unlimited time off
Datavail's PTO and Vacation policy typically gives unlimited days off a year.
Flexible working hours
We embody flexibility for availability. That means we put the needs of our clients first but also understand our employees' work-life balance.
Learning and development budget
We hire great people and invest in them to expand their skillsets. That's how we've been able to grow. We happily give great people the chance to grow with us.
Datavail
Company size
1001-5000 employees
Founded in
2007
Chief executive officer
Scott Frock
Markets
Employees live in
Similar remote jobs
Here are other jobs you might want to apply for.
6 remote jobs at Datavail
Explore the variety of open remote roles at Datavail, offering flexible work options across multiple disciplines and skill levels.
Remote companies like Datavail
Find your next opportunity by exploring profiles of companies that are similar to Datavail. Compare culture, benefits, and job openings on Himalayas.
Find your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
India only