T Wittels
@twittels
Cloud-first Lead Data Engineer with 6+ years of experience.
What I'm looking for
I am a Cloud-first Lead Data Engineer with over 6 years of experience in building scalable data architectures across AWS and GCP. My expertise lies in constructing ETL/ELT pipelines using tools like Airflow, Snowflake, PySpark, and Dagster. I have a proven track record of creating both batch and real-time solutions leveraging EMR, Kinesis, and BigQuery. My commitment to mentoring teams and enforcing coding standards has significantly reduced data processing latency through performance optimization.
In my current role at Walmart, I engineered scalable data pipelines that support demand forecasting across Snowflake and BigQuery. I developed structured ETL processes for PST email data and integrated near real-time streaming pipelines using EMR and Kinesis. My previous experience at Motive involved architecting real-time IoT ingestion pipelines and designing modular ETL pipelines, which improved maintainability and enhanced reporting workflows. Additionally, I am recognized as a course author on Udemy, focusing on big data technologies, which has reached over 5,000 global learners.
Experience
Work history, roles, and key accomplishments
Lead Data Engineer
Walmart x Confiz
Feb 2023 - Present (2 years 7 months)
Engineered scalable data pipelines supporting demand forecasting across Snowflake and BigQuery. Developed structured ETL processes for PST email data using Codex APIs and Delta Lake.
Lead Data Engineer
Motive
Jul 2021 - Jan 2023 (1 year 6 months)
Architected real-time IoT ingestion pipelines using Kinesis and Spark on EMR. Designed modular ETL pipelines via Airbyte, dbt, and Dagster, improving maintainability.
Software Engineer
ArbiSoft
Apr 2019 - Oct 2019 (6 months)
Wrote custom scrapers in Python for structured data collection across domains. Designed and deployed Django-based inventory management with PySpark integration.
Education
Degrees, certifications, and relevant coursework
Unknown
Bachelor of Science, Computer Science
Completed a Bachelor of Science degree with a focus on Computer Science. Gained foundational knowledge in various aspects of computing.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring T?
You can contact T and 90k+ other talented remote workers on Himalayas.
Message TFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
