Senior Data Engineer
We are the only solution in the market today that offers vulnerability-free open source language packages and containers and Intelligent Remediation, which identifies which vulnerabilities to prioritize, assesses the impact of updates causing breaking changes, prioritizes what to fix first, securely builds open source packages from source, and facilitates the build and deploy process to get fixes into production quickly and easily.
All from the trusted partner that pioneered and continues to lead enterprise adoption and use of open source software.
This position is open to experienced candidates with a track record in this area. We build our systems to find, understand, and secure all of the open source code on the planet, and we’re looking for someone who knows how to find, ingest, model, and manage this kind of data to help us secure the Internet’s source code!
Key Responsibilities
Our data is our most powerful, most important asset. Your work will influence our decisions and our success at every level.
This position is a mixture of development and operations; good coding and communication skills are as essential as data management and modeling expertise.
Develop and Maintain Scalable Data Infrastructure. You will design, build, and optimize data pipelines using tools like Airflow and Athena, ensuring efficient data ingestion, transformation, and analysis while maintaining integrity and accessibility.
Skills, Knowledge and Expertise
- At least five years of experience working with ETL processes, data pipelines, and data infrastructure, demonstrating your ability to manage complex data systems.
- Proficient in Python (preferred) or another programming language such as Go, Perl, Ruby, or Java, using code to automate and streamline data processes.
- Experience working with Athena, Snowflake, Redshift, Luigi, or similar data management platforms, allowing you to build and optimize effective data storage solutions.
- Skilled in visualization tools such as Tableau, Power BI, or Google Data Studio, ensuring that you can present data in a clear and meaningful way.
- Strong analytical and problem-solving skills, with experience working with structured and unstructured datasets to uncover insights and trends.
- Excellent communicator, both in writing and in speech, able to translate technical concepts into understandable information for non-technical audiences.
- Practical approach to data ownership, ensuring that stakeholders have the resources and guidance they need to access and interpret data effectively.
ASSETS
- Build engineering, especially for languages such as Java, Go, and Rust
- Open Source projects and culture, especially dependency management and library maintenance
- Experience with open-source data processing tools such as Kafka, Hadoop, Airflow, PrestoDB, dbt, and similar technologies
- Background in cloud-based data engineering, particularly in AWS or GCP environments
- Previous experience working with sales or marketing analytics
- Contributions to open-source projects and communities
Benefits
- The chance to grow and grow with a team, as we expand our data portfolio and team.
- The chance to collaborate with a smart, considerate, enthusiastic team of people.
- The chance to work on a project that will change the work lives of developers around the world, including your own!
- Competitive salary and bonus plan.
- Comprehensive benefits package and health/wellness credit program.
- Unlimited PTO and work-from-anywhere programs.
- Working for a stable and growing company that offers the environment and personal growth potential of a start-up as well as the stability of a successful business with established revenue.
