Thomas Kilgore
@thomaskilgore
Staff Data Engineer building large-scale AI-ready data platforms and distributed systems to drive reliable, high-impact decisions.
What I'm looking for
I’m an engineering leader with 15+ years building large-scale data platforms, AI infrastructure, machine learning systems, and analytics products. I specialize in data engineering, MLOps, distributed systems, machine learning infrastructure, and cloud-native architectures.
Across my roles, I’ve architected and scaled production-grade pipelines—leading RLHF data infrastructure that supports frontier large language model development. I also built and scaled geospatial processing to more than 100 million location events per day while maintaining performance and reliability.
I enjoy partnering across engineering, product, analytics, and research to turn complex business needs into high-impact technical solutions. I’ve led organizations delivering production AI and analytics systems, and I’ve developed frameworks for data governance, observability, lineage, and quality monitoring to improve trust in organizational data assets.
I’m also hands-on at building teams and technical foundations—mentoring engineers, setting standards, and investing in platform work that accelerates data-driven decision making. Before joining enterprise engineering teams, I founded and operated an analytics consulting firm for seven years, strengthening my ability to deliver end-to-end solutions from discovery through deployment.
Experience
Work history, roles, and key accomplishments
Lead the design and implementation of large-scale data platforms supporting critical business and AI initiatives. Architect scalable data pipelines and storage processing billions of records, and establish data governance, observability, lineage, and quality monitoring frameworks across teams.
Data Engineer
Surge AI
Dec 2023 - Nov 2025 (1 year 11 months)
Architected and developed core data infrastructure for Reinforcement Learning from Human Feedback (RLHF) workflows used to train and evaluate frontier large language models. Built scalable ETL and data processing pipelines with data quality/validation frameworks, and implemented monitoring and observability tooling to improve reliability.
Head of Engineering
Freightflows
Aug 2020 - Dec 2023 (3 years 4 months)
Led a multidisciplinary engineering team building predictive analytics products for global commodity and maritime trade intelligence. Architected geospatial processing systems for 100M+ location events per day, directed machine learning forecasting for commodity flows, and built cloud-native data platforms to deliver actionable business intelligence.
Founder & Lead Software Engineer
Serengeti Analytics
Aug 2013 - Aug 2020 (7 years)
Founded and operated a data analytics consulting firm delivering software engineering, machine learning, and data platform solutions for enterprise clients. Led full-cycle client engagements and designed enterprise analytics platforms, including audience intelligence systems linking television advertising exposure with consumer behavior across social media platforms.
Senior Data Engineer
Handshake
Jun 2019 - May 2020 (11 months)
Designed and developed scalable data pipelines supporting analytics, reporting, and product development initiatives. Improved data reliability and accessibility through enhanced data modeling and pipeline architecture, and implemented monitoring and validation processes to reduce data quality issues and operational overhead.
Information Engineering Manager
Lattice Engines
May 2011 - Jul 2013 (2 years 2 months)
Led development of a business intelligence platform with information on more than 22 million small businesses. Architected data acquisition, enrichment, and processing systems, managed engineering initiatives across data collection, machine learning, and quality assurance, and developed anomaly detection algorithms to identify data quality issues.
Senior Business Analyst
Lattice Engines
Oct 2009 - May 2011 (1 year 7 months)
Built predictive machine learning models using decision trees, random forests, and logistic regression, including work that increased sales conversion rates by more than 9% for a Fortune 500 client. Designed entity-resolution algorithms to match and reconcile business records across large-scale data sources and presented analytical findings to technical and executive stakeholders.
Delivered analytical solutions supporting supply chain optimization initiatives for enterprise clients. Analyzed transportation, logistics, and operational data to identify efficiency and cost-saving opportunities and developed reporting frameworks and performance dashboards for client stakeholders.
Education
Degrees, certifications, and relevant coursework
Cornell University
Master of Engineering (M.Eng.), Operations Research and Industrial Engineering
2005 - 2006
Master of Engineering (M.Eng.) in Operations Research and Industrial Engineering at Cornell University from 2005 to 2006.
Cornell University
Bachelor of Science (B.S.), Operations Research
2001 - 2005
Bachelor of Science (B.S.) in Operations Research at Cornell University from 2001 to 2005.
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Thomas?
You can contact Thomas and 90k+ other talented remote workers on Himalayas.
Message ThomasGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
