# Andy Rodriguez

Andy Rodriguez is a remote worker on Himalayas, Senior Data Engineer at Walmart Connect, based in United States.

Source: https://himalayas.app/@andyrodriguez1

```text
I build scalable real-time data platforms for analytics and machine learning.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | United States |
| Authorized to work in | United States |
| Salary expectations | 100k+ USD |
| Job categories | Data Engineer, Data Architect, Analytics Engineer |
| Skills | Python, SQL, Scala, Apache Spark, PySpark, Kafka, Spark Structured Streaming, ETL, ELT, CDC, Data Ingestion, Data Integration, REST APIs, Databricks, Delta Lake, Snowflake, DBT, AWS, S3, Amazon EMR, AWS Glue, AWS Lambda, AWS IAM, Cloudwatch, Azure, Azure Data Factory, PostgreSQL, SQL Server, Relational Databases, Data Modeling, Data Warehouse, Data Lake, Lakehouse Architecture, Distributed Systems, Event Driven Architecture, Airflow, CI CD, Git, Terraform, Data Quality, Data Validation, Data Observability, Data Governance, Metadata Management, Schema Evolution, Power BI, Customer Analytics, Marketing Analytics, Campaign Analytics, KPI Reporting, Business Intelligence, Performance Optimization, Testing Automation, Code Review, Agile, Scrum, Technical Leadership, GitHub Co Pilot, ChatGpt, Claude |

## About

```text
At Walmart Connect, I build data platforms that process more than 3 billion advertising events annually for campaign delivery, attribution, reporting, and machine learning. I develop batch and streaming pipelines with Python, SQL, Spark, Kafka, Databricks, Delta Lake, dbt, Airflow, Snowflake, and AWS.

I've improved Spark processing time by 42%, structured more than 15 billion historical event records in Delta Lake, and automated over 35 production workflows. I also build trusted campaign and audience datasets, strengthen data quality, and reduce production investigation time through observability and operational controls.

Previously, I delivered enterprise data solutions at IBM Consulting and modernized healthcare ETL platforms at athenahealth. I enjoy translating business requirements into practical data models and pipelines, leading design reviews, and mentoring engineers through optimization, code reviews, and production troubleshooting.
```

## Experience

### Senior Data Engineer (current)

[Walmart Connect](https://himalayas.app/companies/walmart-connect). Sep 2021 - Present

```text
Processed 3B+ advertising events annually by developing Python, SQL, Spark, Kafka, and Databricks pipelines. Cut end-to-end processing time by 42% across 8 high-volume Spark workloads and built 20+ batch and streaming pipelines.
```

Skills: Python, SQL, Apache-Spark, Kafka, Databricks, Delta-Lake, DBT, Airflow, AWS, Snowflake, ETL, Data-Modeling, Data-Quality, CI-CD, Git, Terraform, Power-BI

### Data Engineer II

[IBM Consulting](https://himalayas.app/companies/ibm-com). Jan 2018 - Aug 2021

```text
Delivered data solutions across 10+ enterprise client engagements in healthcare, retail, and financial services. Modernized 12+ legacy ETL workflows and built reusable ingestion frameworks for 20+ data sources.
```

Skills: Python, SQL, Apache-Spark, PySpark, Kafka, Snowflake, Airflow, AWS, Azure, ETL, Data-Modeling, Data-Quality, CI-CD, Git

### Data Engineer

[athenahealth](https://himalayas.app/companies/athenahealth). Jun 2015 - Dec 2017

```text
Reduced healthcare data processing time by 35% across 4 core ETL pipelines by rewriting legacy SQL scripts into optimized Python and Spark workflows. Automated ingestion for 12+ healthcare data sources.
```

Skills: Python, SQL, Apache-Spark, AWS, ETL, Data-Quality, Data-Validation, Amazon-EMR, S3

## Education

### University of Miami

Bachelor of Science, Computer Science. 2011 - 2015

```text
Bachelor of Science in Computer Science from the University of Miami, Coral Gables, FL, from 2011 to 2015.
```

## Tech stack

- Snowflake
- Apache Spark
- AWS Glue
- AWS IAM
- Amazon CloudWatch
- Amazon S3
- PySpark
- dbt
- PostgreSQL
- Databricks
- Terraform
- Python
- Scala
- Kafka
- AWS Lambda
- Git
- Airflow
- Amazon EMR
- SQL
- Delta Lake
- GitHub Copilot
- ChatGPT
- Power BI

To contact Andy, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Anthony S](https://himalayas.app/@anthonys): Senior Data Engineer, Walmart Global Tech
- [Christopher Rose](https://himalayas.app/@christopherrose1): Senior Data Engineer / Architect, Walmart
- [Sabal Subedi](https://himalayas.app/@sabalsubedi): Data Engineer, Change Healthcare
- [Zulfiqar Sindhu](https://himalayas.app/@Zulfiqarsindhu): Staff Data Engineer, Lateetud
- [Spencer Young](https://himalayas.app/@spenceryoung): Senior Data Engineer, Expedia Group
- [Ryan Frueh](https://himalayas.app/@ryanfrueh): Senior Data Engineer AI & Analytics, Vizient
- [Vishnu K](https://himalayas.app/@vishnuk1): AWS Data Engineer, Integris Health
- [Ashish Singh](https://himalayas.app/@ashishsingh17): AWS Data Engineer, PWC
- [Shweta Sah](https://himalayas.app/@shwetasah): Senior Data Engineer, Humana Inc.
- [Yuanfeng Wang](https://himalayas.app/@yuanfengwang): Senior Data Engineer, Perspecta