We're looking for a Lead Big Data Developer to join our dynamic and collaborative team at Lumen. You'll work with cutting-edge technologies to identify and disrupt malicious threats on the Internet. As a remote position, you'll have the flexibility to thrive and deliver lasting impact.
Requirements
- Provide technical direction in the creation, implementation, and integration of complex big data solutions
- Collaborate and translate business requirements into implementation design and participate in the design, evaluation, and selection of best software solutions to achieve business objectives
- Design, develop, test, and deploy scalable and reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies
- Extract, transform, and load data from various sources and formats, such as relational databases, APIs, JSON, XML, CSV, etc.
- Perform data quality checks and validations, and handle data anomalies and issues
- Collaborate with other developers, data engineers, data analysts, and business stakeholders to understand data requirements and deliver data solutions
- Develop scalable systems that enable real-time validation of identified resources
- Mentor junior developers and engineers on the team and champion industry best practices
- Explore, evaluate, and conduct PoC to determine new technology solutions that would improve our ability to detect newer threats or add efficiency to current processes
Benefits
- Comprehensive package featuring a broad range of Health, Life, Voluntary Lifestyle benefits and other perks that enhance your physical, mental, emotional and financial wellbeing
- Bonus Structure
- Learn more about Lumen's benefits and bonus structure