James Paul
@jamespaul2
Senior AI Data Engineer specializing in lakehouse architectures and production AI infrastructure.
United StatesWhat I'm looking for
I am a Senior AI Data Engineer with 10+ years designing and scaling distributed data platforms and AI-ready lakehouse architectures. I have architected petabyte-scale pipelines on Delta Lake and Photon, led enterprise rollouts of Unity Catalog across AWS and Azure, and built fine-tuning and evaluation pipelines to productionize LLMs and GenAI workloads.
I focus on building governed, high-performance AI infrastructure—implementing end-to-end lineage, cross-cloud governance, streaming-first ingestion, and cost-optimized compute. My work has reduced query costs, improved data freshness to near real-time, and supported large enterprise migrations from Snowflake to lakehouse architectures.
Experience
Work history, roles, and key accomplishments
DAArchitected enterprise-scale Lakehouse platforms and petabyte-scale Delta Lake pipelines to support GenAI and LLM workloads, leading Unity Catalog rollouts and reducing enterprise query costs by 38% through performance optimizations.
NOScaled behavioral analytics from 1M to 20M+ users by building ELT and streaming pipelines, reducing data freshness SLA from 24 hours to under 10 minutes and enabling product experimentation for growth.
GABuilt multi-tenant customer health scoring and secure ingestion pipelines integrating Salesforce APIs, improving distributed Spark/Hive processing efficiency by 27% and enabling churn prediction and renewal forecasting.
Education
Degrees, certifications, and relevant coursework
UDUniversity of Texas at Dallas
Master of Science, Computer Science
2013 - 2015
Completed a Master of Science in Computer Science focused on advanced topics in data systems and machine learning.
UDUniversity of Texas at Dallas
Bachelor of Science, Computer Science
2009 - 2013
Completed a Bachelor of Science in Computer Science with coursework and projects in software engineering, data systems, and algorithms.
Tech stack
Software and tools used professionally
Availability
Location
United StatesAuthorized to work in
Job categories
Skills
Interested in hiring James?
You can contact James and 90k+ other talented remote workers on Himalayas.
Message JamesFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
