Andrew andy
@andrewandy
Senior Data Engineer specializing in scalable ML and analytics pipelines.
What I'm looking for
I am a Senior Data Engineer with a strong track record designing, building, and scaling ETL/ELT pipelines across enterprise analytics, high-volume marketplace systems, and robotics ML training. I bring deep expertise in SQL, Python, Spark, Trino, and modern orchestration frameworks like Airflow and Flyte to deliver reliable data systems.
I have led production analytics and ML-data efforts, creating standardized analytics frameworks, reusable dashboards, and observability patterns that accelerated experimentation and reduced engineering effort during feature launches. I built large-scale preprocessing and feature-generation pipelines for robotic perception, optimized data storage and query performance, and implemented automated dataset pipelines and quality checks.
I collaborate effectively with Product, ML, DS, and Engineering partners to translate ambiguous business and modeling needs into clear data outcomes. I thrive in fast-paced, high-ownership environments, consistently delivering high-quality engineering work under tight timelines.
Experience
Work history, roles, and key accomplishments
Led development of production ETL/ELT pipelines and orchestration (Airflow, Flyte) for Marketplace Management, standardizing feature tracking and delivering reusable analytics patterns that improved experiment evaluation and reduced engineering effort during launches.
Senior Data Engineer
Diligent Robotics
Jul 2017 - Dec 2020 (3 years 5 months)
Built and maintained large-scale Python/Spark data pipelines and automated preprocessing workflows for robotic perception model training, improving dataset preparation speed and reliability for object-recognition and grasp-planning.
Education
Degrees, certifications, and relevant coursework
Texas Tech University
Master of Science, Computer Science
2012 - 2013
Completed a master's degree program in Computer Science focused on advanced computing topics and research-oriented coursework.
Texas Tech University
Bachelor of Science, Computer Science
2008 - 2012
Completed a bachelor's degree program in Computer Science covering core software engineering and data systems coursework.
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Andrew?
You can contact Andrew and 90k+ other talented remote workers on Himalayas.
Message AndrewFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
