Lead System Architect and Data Processing Engineer

We are seeking a highly skilled and experienced Lead System Architect and Data Processing Engineer to drive the development of our data collection, processing, and analysis system, which is based on a Python/Django/Postgres stack. As the lead individual contributor (IC), you will play a crucial role in defining the architecture and actively participating in the implementation of a system that will revolutionize the cybersecurity landscape for Python, Java, and JavaScript ecosystems.

Responsibilities:

• Define the overall architecture and design of the data collection, processing, and analysis system, including components for data fetching, consuming, cleaning, analysis, and LLM analysis
• Act as the lead IC, collaborating with the Senior Data Engineer and other team members to build and optimize data pipelines, processing components, and storage solutions
• Make hands-on contributions to the codebase, ensuring the implementation aligns with the architectural vision
• Provide technical leadership and guidance to the team while remaining deeply involved in the day-to-day development process
• Ensure the system meets performance, scalability, and maintainability requirements, capable of processing millions of events and generating industry-leading datasets
• Mentor and guide the Senior Data Engineer and other team members
• Integrate AI technologies, such as GPT, Claude, and Copilot, into the development process to enhance productivity and quality
• Embrace a fast-paced, iterative development approach, delivering working solutions quickly and continuously improving based on feedback

Impact:

By joining our team, you will have the opportunity to build a groundbreaking data processing system that will result in an industry-leading dataset, protecting and securing the Python, Java, and JavaScript ecosystems. Your work will have a massive impact on the cybersecurity landscape, empowering organizations worldwide to safeguard their software supply chains and mitigate vulnerabilities. You’ll be part of a team that is at the forefront of innovation, leveraging AI technologies to revolutionize the way we approach cybersecurity.

If you are excited about having an opportunity to make a significant impact in the cybersecurity domain and build a world-class data processing system, we want to hear from you! Join our dynamic and fast-paced startup, where you'll have the chance to work with cutting-edge technologies, shape the future of software supply chain security, and deliver impactful results through iterative deployments.

Requirements

• 12+ years of overall technical experience
• 7+ years of experience designing and building large-scale data processing systems
• Strong hands-on development skills and a track record of making significant contributions to complex systems
• Deep expertise in event-driven architectures, data pipelines, and cloud technologies (AWS or Google Cloud preferred)
• Proven ability to lead by example and work collaboratively with a team of engineers
• Excellent problem-solving, communication, and leadership skills
• Experience using AI systems like GPT, Claude, and Copilot in daily work
• Passionate about leveraging AI tools to drive innovation and efficiency
• Thrives in a fast-paced startup environment, comfortable with rapid iterations and adaptable to changing requirements
• Resourceful and creative problem-solver, able to deliver results with limited resources and tight deadlines