Open to opportunities

Diya Patel

@diyapatel4

Message

Lead data engineer building scalable ETL/ELT pipelines and analytics platforms with AWS, Python, and Spark.

India

Message

What I'm looking for

I’m looking for a team where I can own end-to-end data engineering—building scalable pipelines, strengthening data quality and monitoring, and using AWS, Spark, and Airflow to deliver trustworthy analytics that stakeholders can rely on.

I’m a Lead Data Engineer focused on building reliable, scalable ETL/ELT systems that turn raw data into dependable analytics. I bring hands-on experience designing data pipelines end-to-end—from ingestion and transformation to monitoring and governance.

In my projects, I designed and implemented scalable ETL pipelines for structured and unstructured data using Python, SQL, Apache Spark, and Apache Airflow. I automated data ingestion workflows to reduce manual processing time, improved reliability with validation and logging, and built optimized SQL queries and data models for analytics reporting.

In my current role, I develop and maintain data lakes, data warehouses, and data models to support business intelligence. I optimize performance through query tuning, indexing, and workflow automation while collaborating closely with analysts, data scientists, and stakeholders to deliver high-quality data solutions.

Experience

Work history, roles, and key accomplishments

Lead Data Engineer

AuxoAI

Jun 2022 - May 2026 (3 years 11 months)

Designed, developed, and maintained scalable ETL/ELT pipelines for structured and unstructured data. Built and optimized data models and data warehouses/lakes, implemented data quality checks and governance, and improved performance through query tuning, indexing, and workflow automation.

Python SQL ETL Data Modeling Data Warehousing Data Lake Data Quality Governance AWS S3 RDS EC2 Apache Spark

Education

Degrees, certifications, and relevant coursework

Lok Jagruti University

Bachelor of Science, Computer Science

2018 - 2022

Grade: CGPA 8.7

Activities and societies: Projects Lead: Real-Time Data Pipeline & Analytics Platform—ETL pipelines with Python/SQL/Apache Spark/Airflow, AWS integration (S3/EC2/RDS/CloudWatch), optimized SQL/data models, data validation/monitoring/logging, and Power BI KPI dashboards.

Earned a Bachelor of Science in Computer Science (CGPA 8.7) at Lok Jagruti University from Nov 2018 to Nov 2022. Led development of a real-time data pipeline and analytics platform using Python, SQL, Apache Spark, Airflow, AWS, and Power BI.