Bluelight is a leading software consultancy dedicated to designing and developing innovative technology that enhances users' lives. With a steadfast commitment to delivering exceptional service to our clients, Bluelight excels in its focus on quality and customer satisfaction. Our mission is not only to create cutting-edge applications but also to foster a collaborative and enriching work environment where each team member can grow and thrive.
Requirements
- ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks, and/or Azure Synapse Analytics Pipelines
- Data warehousing, understanding star schemas, facts, and dimensions
- Data source expertise, including REST APIs, SWL database tables, and CSV files
- Azure Synapse Analytics expertise, including designing and optimizing data notebooks/pipelines for scalability and performance
- Data fabric concepts, including data lakes, lakehouses, delta lakes, and data cataloging
- Data modeling and collaborating with data architects
- Data quality checks and validation processes
- Performance tuning and identifying and resolving performance bottlenecks
- Monitoring and troubleshooting of ETL jobs
- Documentation of ETL data engineering processes, data flows, and data transformations
- Collaboration with cross-functional teams
- Security and compliance with data governance and privacy standards
Benefits
- Competitive salary and bonuses
- Generous paid-time-off policy
- Flexible working hours
- Work remotely
- Continuing education, training, conferences
- Company-sponsored coursework, exams, and certifications
