Medium logo

Senior Data Engineer

Medium’s mission is to help people deepen their understanding of the world and discover ideas that matter.

Medium

Icons/design/feather/users

201-500

Medium’s mission is to help people deepen their understanding of the world and discover ideas that matter. We are building a place where ideas are judged on the value they provide to readers, not the fleeting attention they can attract for advertisers. We are creating the best place for reading and writing on the internet—a place where today’s smartest writers, thinkers, experts, and storytellers can share big, interesting ideas.

We are looking for a Staff Data Engineer that will help build, maintain, and scale our business critical Data Platform. In this role, you will help define a long-term vision for the Data Platform architecture and implement new technologies to help us scale our platform over time. You'll also lead development of both transactional and data warehouse designs, mentoring our team of cross functional engineers and Data Scientists.

At Medium, we are proud of our product, our team, and our culture. Medium’s website and mobile apps are accessed by millions of users every day. Our mission is to move thinking forward by providing a place where individuals, along with publishers, can share stories and their perspectives. Behind this beautifully-crafted platform is our engineering team who works seamlessly together. From frontend to API, from data collection to product science, Medium engineers work multi-functionally with open communication and feedback.

What Will You Do


  • Work on high impact projects that improve data availability and quality, and provide reliable access to data for the rest of the business.
  • Drive the evolution of Medium's data platform to support near real-time data processing and new event sources, and to scale with our fast-growing business.
  • Help define the team strategy and technical direction, advocate for best practices, investigate new technologies, and mentor other engineers.
  • Design, architect, and support new and existing ETL pipelines, and recommend improvements and modifications.
  • Be responsible for ingesting data into our data warehouse and providing frameworks and services for operating on that data including the use of Spark.
  • Analyze, debug and maintain critical data pipelines.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Spark and AWS technologies.

About You


  • You have 7+ years of software engineering experience.
  • You have 3+ years of experience writing and optimizing complex SQL and ETL processes, preferably in connection with Hadoop or Spark.
  • You have outstanding coding and design skills, particularly in Java/Scala and Python.
  • You have helped define the architecture, tooling, and strategy for a large-scale data processing system.
  • You have hands-on experience with AWS and services like EC2, SQS, SNS, RDS, Cache etc or equivalent technologies.
  • You have a BS in Computer Science / Software Engineering or equivalent experience.
  • You have knowledge of Apache Spark, Spark streaming, Kafka, Scala, Python, and similar technology stacks.
  • You have a strong understanding & usage of algorithms and data structures.

Nice To Have


  • Snowflake knowledge and experience
  • Looker knowledge and experience
  • Dimensional modeling skills

At Medium, we foster an inclusive, supportive, fun yet challenging team environment. We value having a team that is made up of a diverse set of backgrounds and respect the healthy expression of diverse opinions. We embrace experimentation and the examination of all kinds of ideas through reasoning and testing. Come join us as we continue to change the world of digital media. Medium is an equal opportunity employer.

Interested? We'd love to hear from you.

About this role

February 6th, 2022

December 31st, 2020

Full Time

Icons/design/dot -10.00
Icons/design/dot -9.50
Icons/design/dot -9.00
Icons/design/dot -8.00
Icons/design/dot -7.00
Icons/design/dot -6.00
Icons/design/dot -5.00
Icons/design/dot -4.00
Icons/design/dot -3.50
Icons/design/dot -3.00
Icons/design/dot -2.00
Icons/design/dot 14.00

Apply now

Please let Medium know you found this job on Himalayas. This will help us grow!

Apply now

About Medium

Learn about Medium and their company culture.

View company profile

Welcome to Medium, where words matter. Medium taps into the brains of the world’s most insightful writers, thinkers, and storytellers to bring you the smartest takes on topics that matter. So whatever your interest, you can always find fresh thinking and unique perspectives.

We believe:

  • Great ideas can come from anywhere

  • People create better things together

  • Design matters at a deep level

We also care deeply about how media shapes the lives of individuals and the decisions of society — and we think it can be better.

We have a world-class engineering and design team, which we are looking to grow slowly and deliberately. Let us know if you're interested.

Tech stack

Learn about the technology and tools that Medium uses.

View tech stack
News
Icons/design/feather/users

201-500

2012

Ev Williams

Icons/design/feather/country/us United States

Similar remote jobs

These are some of our top picks for great remote jobs on Himalayas.

View all jobs
DNSFilter logo
Icons/design/feather/country/us United States only
Akash Network logo
Icons/design/feather/country/us United States only

5 remote jobs at Medium

Medium is hiring Senior Data Engineer, Staff Software Engineer - Data Platform, and more.

View all jobs at Medium
Medium logo

Medium

Icons/design/feather/users

201-500

Medium logo
Icons/design/feather/country/us United States only
Medium logo
Icons/design/feather/country/us United States only
Medium logo
Icons/design/feather/country/us United States only
Medium logo
Icons/design/feather/country/us United States only

Remote companies like Medium

These are some great remote companies operating in similar industries to Medium.

View all companies
QuillBot logo

QuillBot is developing state-of-the-art AI technology to make writing painless.

Airmeet is a platform for virtual summits, meetups & workshops with a social lounge to deliver a rich networking experience.

Want to build the future of the Internet? Akash Network is developing the world’s first and only decentralized cloud computing marketplace, enabling any data center and anyone with a computer to become a cloud provider by offering their unused compute cycles in a safe and frictionless marketplace.

Cozy Cloud logo

Cozy is your own personal Cloud: a private server you can trust to store your personal data and host your personal web apps.

Xometry logo

Xometry is your one-stop-shop for manufacturing on demand.

WebRTC.ventures logo

WebRTC. ventures builds and licenses custom video and voice applications for telehealth, online education, broadcasting, and more!

The latest jobs in your inbox

We'll keep you updated with the best new remote jobs.

Read about our privacy policy

Hiring remotely?
Start posting jobs today.

Start posting jobs for only $50.

Post remote jobs on Himalayas