HimalayasHimalayas logo
LightcastLI

Data Engineer - 1010

We connect people with jobs by providing businesses, communities, and education institutions with the best labor market data possible.

Lightcast

Employee count: 501-1000

RU and US only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

The Data Engineer is responsible for building and maintaining systems that improve data reliability, quality, and accessibility. This role focuses on developing software and data pipelines that extract, transform, and load (ETL) large volumes of data from multiple sources into consistent, machine-readable formats. Data Engineers design and test architectures that support data extraction and transformation for predictive and prescriptive analytics. Working within an agile Scrum environment, the Data Engineer participates in two-week sprint cycles, contributing to sprint planning, development, and review processes to continuously improve data infrastructure and product capabilities.

Major Responsibilities:

  • Data Transformation: Collect, manage, and transform large-scale raw data from multiple sources into structured, reliable, and usable formats that meet business and analytical requirements.

  • Data Tool Creation: Design, develop, and maintain data architectures, pipelines, and applications using appropriate tools and frameworks to support scalable data processing and product development.

  • ETL Development: Build and maintain robust extract, transform, and load (ETL) processes that ensure data accuracy, efficiency, and availability across systems.

  • Root Cause Analysis & Continuous Improvement: Perform root cause analysis to identify data issues, system inefficiencies, or process gaps, and implement improvements that enhance data quality and operational performance.

  • Agile Collaboration: Work in an agile Scrum environment by contributing to sprint planning, development tasks, testing, and sprint reviews to deliver reliable and scalable data solutions

Education and Experience:

  • Bachelor’s in Computer Science, Mathematics, Statistics, or related field (or equivalent experience)

  • 2+ years in data engineering, data analysis, or similar roles

  • Experience with ETL, data warehousing, and scalable data systems.

  • Solid understanding of statistical methods and data analysis

  • Strong communication skills with ability to work independently and in teams

  • Proficiency in Python and SQL; familiarity with Java, C/C++, or similar

  • Strong software engineering, programming, and QA skills

  • Experience with Linux/Unix (POSIX systems) and Git

  • Preferred Qualifications

  • Experience with Docker, Terraform, and AWS (Batch, EMR/Spark, ecosystem tools)

  • Familiarity with GitLab and Scala

Lightcast is a global leader in labor market insights with our headquarters located in Moscow, ID (US) and other offices in the United Kingdom, Europe, and India. We work with partners across six continents to help drive economic prosperity and mobility by providing the insights needed to build and develop our people, our institutions and companies, and our communities.

Lightcast is proud to be an equal opportunity workplace and does not discriminate on the basis of federally protected statuses. Lightcast has always been, and always will be, committed to diversity of thought and unique perspectives. We seek dynamic professionals from all backgrounds to join our teams, and we encourage our employees to bring their authentic, original, and best selves to work.

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Education

Bachelor degree

Experience

2 years minimum

Experience accepted in place of education

Location requirements

Hiring timezones

Russian Federation +/- 0 hours, and 1 other timezone

About Lightcast

Learn more about Lightcast and their company culture.

View company profile

We connect people with jobs by providing businesses, communities, and education institutions with the best labor market data possible. Our data-driven insight enables better, faster decisions.

What we do

At Lightcast, our software products, APIs, and consulting solutions bring clarity to the fast-changing world of work.

Formerly Emsi Burning Glass, Lightcast has over two decades of experience in finding solutions and delivering the competitive edge our clients demand. With world-class customer service, we provide the answers and insight to meet your specific need—because every decision made without data is just a shot in the dark.

By helping communities, businesses, and education institutions succeed, our ultimate goal is connecting individuals with the right skills and right jobs in the right places. People are at the heart of everything we do, and we want to create a job market that works for everyone.

How we do it

Lightcast is a global pioneer in the collection and big-data analysis of information on the labor market. Our data provides the world’s most detailed information about occupations, skills in demand, and career pathways.

Our tools collect real-time data from over 65,000 sources every day, contributing to a database with over 1 billion job postings and billions of other data points. We combine that with curated input from dozens of other statistical sources, like government agencies, to provide the most complete view possible of the fast-changing labor market. We put that information to work for businesses, communities, and education providers by showing them the granular details and big-picture trends they need in their organizations.

Whether you’re interested in software salaries in Seattle, need new skills in New Zealand, or looking for anything in between, Lightcast data can provide the insight you need.

Where you can find us

Headquartered in Boston, Massachusetts, and Moscow, Idaho, we are active in more than 30 countries and have offices in the United Kingdom, Italy, New Zealand, Canada, and India. Lightcast is backed by global private equity leader KKR.

Lightcast Principles

Live the mission: We genuinely care about the work we do and never lose sight of the human behind the data.

Innovate, inside and out: We take personal responsibility for finding new and better ways to do all things—large and small, internally and externally.

Give customers the unexpected: We aim to exceed customer expectations and seek opportunities to excite and delight with every interaction.

Hide nothing, own everything: We strive to be transparent in our actions, own our mistakes, and remain humble in our approach.

Teamwork makes the data work: We work together, respect our differences, play to our strengths, and celebrate our successes. #crushedit

Employee benefits

Learn about the employee benefits and perks provided at Lightcast.

View benefits

Employee Ownership

Recognizing dedication, Lightcast grants employee ownership shares, aligning team success with company growth.

Retirement Savings Match

Employees at Lightcast can take advantage of a 401(k) plan with a company match to build their retirement savings.

Life & Disability Insurance

Lightcast offers life insurance, short-term and long-term disability coverage to protect employees and their families.

Commuter Benefits

Lightcast supports its employees' commute by providing parking, gas, and public transit benefits, easing the daily journey to work.

View Lightcast's employee benefits
Claim this profileLightcast logoLI

Lightcast

Company size

501-1000 employees

Founded in

2000

Chief executive officer

Chris Kibarian

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

6 remote jobs at Lightcast

Explore the variety of open remote roles at Lightcast, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Lightcast

Remote companies like Lightcast

Find your next opportunity by exploring profiles of companies that are similar to Lightcast. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan