Looking for a job

Ruthvik User

@ruthvikuser1

Senior Solutions Engineer at Astronomer building Apache Airflow platforms, including orchestration patterns supporting 100+ pipelines.

India

Message

At Astronomer, I lead Apache Airflow and Astronomer implementations for multiple customers, designing DAG architectures and migration strategies for 100+ pipelines. I also designed Kubernetes-based remote execution environments with queue-depth-based autoscaling and observability.

At Wayfair, I led the migration of 20+ teams to GCP Cloud Composer, streamlining 200+ ETL pipelines and saving $60K in platform costs. I engineered a self-service platform that automated provisioning of Cloud Composer and Dataproc infrastructure.

At Fanatics Inc., I built production data pipelines and migrated Hive/Spark and Redshift workflows to Snowflake with Airflow orchestration, reducing warehouse refresh time from 6 hours to 45 minutes. Earlier, at Predible Health and Quantiphi Analytics Pvt. Ltd, I developed deep learning and NLP solutions, including a model for identifying abnormalities in Head CT scans.

Experience

Work history, roles, and key accomplishments

Current

Senior Solutions Engineer

Current

Astronomer

May 2025 - Present (1 year 6 months)

Lead enterprise-scale Apache Airflow and Astronomer implementations, driving DAG architecture design and migration strategy. Optimized Kubernetes-based execution environments and built reusable orchestration patterns.

Airflow Kubernetes Docker Terraform Python CI CD Observability GCP AWS Snowflake Spark Dataproc BigQuery DBT

Data Engineer II

Wayfair

Jan 2024 - Apr 2025 (1 year 3 months)

Led migration of 20+ teams to GCP Cloud Composer, streamlining 200+ ETL pipelines and saving $60K in platform costs. Engineered a self-service data platform using Backstage, Python, Terraform, and Jenkins.

Airflow GCP Cloud Composer Dataproc Python Terraform Jenkins Backstage Spark ETL

Data Engineer II

Fanatics Inc.

May 2021 - Jan 2024 (2 years 8 months)

Built and monitored production data pipelines supporting daily warehouse refreshes across 250 warehouse tables and 700+ data lake tables. Implemented alerting, reconciliation, and data quality pipelines.

Airflow AWS S3 AWS MWAA DMS Snowflake Spark Hive Redshift Data Quality CDC

Deep Learning Engineer

Predible Health

Nov 2019 - Feb 2021 (1 year 3 months)

Developed a multi-class ResNeXt-based deep learning model for Head CT abnormality detection with high sensitivity and specificity. Built a medical report parser and contributed to end-to-end deep learning pipelines.

Deep Learning ResNeXt Python NLP Medical Imaging Model Training Validation

Machine Learning Engineer

Quantiphi Analytics Pvt. Ltd

Jul 2018 - Oct 2019 (1 year 3 months)

Built NLP and NLU solutions for question answering and sequence modeling. Developed a seq2seq model for generating semantically similar questions and built APIs to serve ML models.

NLP NLU Python Seq2Seq Deep Learning APIs Machine Learning