Looking for a job

Daniel Hunt

@danielhunt

Senior Data Engineer, 10 years at Amgen, Realtor.com, and Amazon Prime Video. Reliable pipelines on AWS with Databricks, Snowflake, Airflow, and dbt.

United States

Message

What I'm looking for

Remote Senior data engineering role where reliability is part of the job: validation gates, idempotent backfills, monitoring, and shared pipeline frameworks on Databricks, Snowflake, Airflow, and dbt on AWS. I want to own a real slice of the platform, use AI inside a verified workflow, and join a team that values code review, documentation, and mentoring.

At Amgen, I designed a Unity Catalog pipeline framework that lifted job success from 95% to 99.2% across 45 Databricks jobs. I also reduced Databricks spend by right-sizing clusters and moving nine small jobs to shared serverless compute.

At Realtor.com, I built Airflow and dbt pipelines on Snowflake that raised on-time delivery from 88% to 98% for marketing segments. I added anomaly checks that cut data incidents from seven to two per quarter.

Earlier at Amgen, I led a Delta Lake migration that accelerated nightly refreshes from six to three and a half hours. I also replaced Informatica mappings with incremental PySpark pipelines on Databricks.

At Amazon, I rebuilt hourly Hive jobs as Spark sessionization on Amazon EMR, providing quality metrics from roughly two billion daily events across about 30 device types. I also implemented a Java Kinesis consumer with DynamoDB and CloudWatch alarms for Thursday Night Football.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Amgen

Apr 2024 - Present (2 years 6 months)

Designed a Unity Catalog pipeline framework lifting job success from 95% to 99.2% across 45 Databricks jobs. Reduced dashboard p95 latency from 6s to 1.5s by modeling a Kimball star schema on Databricks SQL.

Python SQL Pl SQL AWS Databricks Terraform Docker Kubernetes Oracle PostgreSQL Spark Prophecy Amazon Bedrock LangGraph Cursor Collibra Power BI Jenkins

Senior Data Engineer

Realtor.com

Nov 2021 - Apr 2024 (2 years 5 months)

Built Airflow and dbt pipelines on Snowflake raising on-time delivery from 88% to 98% for marketing segments. Cut data incidents from 7 to 2 per quarter by implementing anomaly detection and idempotent backfill DAGs.

Python SQL AWS Snowflake Terraform DBT Airflow Kafka Cursor InfluxDB Grafana GitHub Actions

Software Engineer

Amazon

Jun 2016 - Mar 2019 (2 years 9 months)

Rebuilt hourly Hive jobs as Spark (Scala) sessionization on Amazon EMR, providing quality metrics from ~2B daily events. Implemented a Java Kinesis consumer with DynamoDB and CloudWatch alarms for live-event alerting.