I seek a senior data engineering role where I can design and scale robust data pipelines, leverage AWS and Airflow, drive automation, and mentor teams while contributing to data‑driven decision making in a forward‑thinking organization.
JK
Looking for a job
Joshua Kelly
@joshuakelly
Senior Data Engineer at Instacart building replayable catalog and availability pipelines for 1.4B+ item listings.
United StatesWhat I'm looking for
At Instacart, I own store-level pricing and assortment ingestion for the Grocery Catalog, building PySpark pipelines on Databricks that absorb SFTP, API, and third-party feeds. I also built the entity-resolution and canonicalization stage that merges retailer, third-party, and internal attributes into the catalog.
Previously at USAA, I owned streaming ingestion for BSA/AML transaction monitoring and built audit-ready claims data layers. At Interface People, LP, I built MEDITECH extraction and archive-loading pipelines for HIPAA-compliant clinical archives, along with data engineering systems for healthcare and logistics clients.
Experience
Work history, roles, and key accomplishments
Current
Owned store-level pricing and assortment ingestion for the Grocery Catalog, building PySpark pipelines on Databricks that absorb SFTP, API, and third-party feeds from 1,500+ retail banners. Developed incremental dbt and Airflow transformation layers in Snowflake for pricing, nutrition, and taxonomy domains, processing billions of daily attribute updates.
Owned the Kafka and Spark Structured Streaming ingestion layer for BSA/AML transaction monitoring, consolidating deposit, card, and transfer feeds into detection-ready datasets. Built the Databricks Delta Lake bronze-to-silver conformance layer for auto and property claims data, and migrated insurance reporting workloads to Snowflake on AWS.
IL
Data Engineer
Interface People, LP
Apr 2014 - Jan 2019 (4 years 9 months)
Built MEDITECH extraction and archive-loading pipelines for hospital EHR archiving engagements using SQL Server, SSIS, and HL7 feeds. Owned the ELT re-platforming track for a client enterprise warehouse migration to Amazon Redshift, and introduced Apache Airflow for multi-client ETL orchestration.
Education
Degrees, certifications, and relevant coursework
Jackson State University
Master of Science, Mathematics
2012 - 2015
Master of Science in Mathematics from Jackson State University from 2012 to 2015.
Oklahoma Baptist University
Bachelor of Science, Mathematics
2009 - 2012
Bachelor of Science in Mathematics from Oklahoma Baptist University from 2009 to 2012.
Tech stack
Software and tools used professionally
Availability
Looking for a job
Location
United StatesAuthorized to work in
Salary expectations
130k+ USD
Social media
Interested in hiring Joshua?
You can contact Joshua and 90k+ other talented remote workers on Himalayas.
Message JoshuaGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
