United States onlyAt Two Six Technologies, we build, deploy, and implement innovative products that solve the world’s most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what’s possible to empower our team and support our customers in building a safer global future.
Would you like to use your full stack engineering skills to help policy makers, corporate leaders, and operators make sense of increasingly complex information spaces? Two Six Technologies provides Information Advantage to Government, Military, and Fortune 50 customers tasked with mission critical decision making.
Our products collect and synthesize huge quantities of publicly available data in multiple languages, then serve that data to be easily queried by our expert analysts and used in machine learning analytics. As the lead engineer on our data collection team you will drive the engineering efforts of our data collection team, and you will collaborate with architects, data scientists, and devops to design, implement, and support data collection solutions at scale, using the latest approaches and technologies in the web scraping space.
As a top candidate you have extensive knowledge of HTTP, HTML, CSS, JavaScript, and other web technologies, and you understand how these technologies interact to make websites work. You have been working with Python for multiple years and you have experience building solutions using AWS, Linux, and with containerization technologies like Docker and Kubernetes. You also have been a member of remote engineering teams working in Agile software development environments.
You have previously built and maintained web scraping tools that navigate and collect publicly available data at scale. You also enjoy working out novel solutions to technical challenges, and staying current with the latest developments in the web scraping community. You have previously been a key resource or a technical lead for an application, or platform capability. You have experience being a “go-to” technical expert, leading the implementation of features and fixes, while ensuring the continued quality, scalability, and security of the codebase.
Most importantly you share our passion for applying technology to solve hard problems and finding innovative ways to collect and derive insights from high-volume data.
Responsibilities:
- Leading the development of high volume data collection solutions that enable analysis by both human experts and machine learning solutions
- Collaborating with architects and Product leads on the roadmap for data collection capabilities
- Staying current with the latest technological developments in web scraping and the challenges of maintaining collection as data sources quickly evolve
- Overseeing the data collection codebase, setting and maintaining coding standards, patterns, and best practices
- Supporting the data collection capability, researching and responding quickly to issues, adapting collection to meet new challenges
- Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
- Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
- Considering security best practices at every phase of software development
- Continuously learning and improving
- Working within Agile software development methodologies and being an active part of our continuous improvement efforts
- Working in a fully remote team with a diverse set of skills and experiences
- Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions
- Actively participating in the peer code review process, both providing feedback, but also being open and receptive to feedback
- Creating and executing both manual and automated testing
Qualifications:
- Experience with the design, development, testing, and support of scalable, data-driven applications written in Python and deployed to production SaaS environments
- Experience with web scraping and other techniques for collecting data from the internet
- Deep understanding of HTTP, HTML, JavaScript, CSS, and other technologies that power websites
- Experience with AWS or similar cloud-based infrastructure
- Experience as a technical lead or key resource for an application, capability, or code base
- Experience working independently and as a part of an Agile team
Optional Skills / Domain Experience
- Experience with Scrapy or other web scraping technologies is a huge plus
- Experience with Docker and Kubernetes
- Experience with Object Oriented Programming (OOP)
- Experience with database technologies, ideally Elastic and Postgres
- AWS certification
Looking for other great opportunities? Check out Two Six Technologies Opportunities for all our Company’s current openings!
Ready to make the first move towards growing your career? If so, check out the Two Six Technologies Candidate Journey! This will give you step-by-step directions on applying, what to expect during the application process, information about our rich benefits and perks along with our most frequently asked questions. If you are undecided and would like to learn more about us and how we are contributing to essential missions, check out our Two Six Technologies News page! We share information about the tech world around us and how we are making an impact! Still have questions, no worries! You can reach us at Contact Two Six Technologies. We are happy to connect and cover the information needed to assist you in reaching your next career milestone.
Two Six Technologies is an Equal Opportunity Employer and does not discriminate in employment opportunities or practices based on race (including traits historically associated with race, such as hair texture, hair type and protective hair styles (e.g., braids, twists, locs and twists)), color, religion, national origin, sex (including pregnancy, childbirth or related medical conditions and lactation), sexual orientation, gender identity or expression, age (40 and over), marital status, disability, genetic information, and protected veteran status or any other characteristic protected by applicable federal, state, or local law.
If you are an individual with a disability and would like to request reasonable workplace accommodation for any part of our employment process, please send an email to [email protected]. Information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.
Additionally, please be advised that this business uses E-Verify in its hiring practices.
EOE, including disability/vets.
By submitting the following application, I hereby certify that to the best of my knowledge, the information provided is true and accurate.
