Giridhar Reddy Tatiparthi
@giridharreddyt
Data Engineer focused on reliable, scalable ETL and real-time data pipelines.
What I'm looking for
I am a Data Engineer with hands-on experience in building and supporting scalable data pipelines in hybrid cloud environments. I have worked in the Fintech domain at Walmart, where I was part of both the Finance Data Lakehouse (FDLH) and Finance Connected Platform (FCP) teams. My work involved processing large volumes of daily store and eCommerce transaction data used for financial reporting and reconciliation.
On the GCP side, I worked with SAS upstream systems that pushed data into Google Cloud Storage. We used Automic as the enterprise orchestration tool to manage workflows and trigger Spark jobs on Dataproc clusters. I contributed to ETL development, partition-based incremental processing, and storing optimized Parquet datasets for downstream consumption.
I am particularly interested in real-time data processing, scalable ETL design, and cloud-native data architectures. I continuously work on strengthening my skills in Azure, Databricks, streaming technologies, and modern lakehouse architecture.
My long-term goal is to grow into a senior data engineering role where I can design end-to-end data platforms, optimize performance, and contribute to building reliable, production-grade data systems that drive business decision-making.
Experience
Work history, roles, and key accomplishments
• Developed and maintained Spark-based ETL pipelines on Google Cloud Dataproc to process daily store and eCommerce sales transaction data for finance reporting.
• Built and managed multi-layer data pipelines (Raw → Curated → Enriched → Consumption) in Databricks on a hybrid GCP + Azure architecture.
Data Engineer
Walmart Global Tech
Apr 2024 - Jun 2025 (1 year 2 months)
Designed and developed Azure Data Factory pipelines integrated with Databricks to process 10M+ daily records. Implemented incremental ingestion to cut runtime from 4 hours to 90 minutes (70% improvement) and maintained 99%+ SLA adherence through hybrid Azure+GCP orchestration and monitoring.
Data Scientist
wengerwatson
Nov 2023 - Jan 2024 (2 months)
Supported end-to-end ETL workflows in Hive and BigQuery, maintained incremental historical datasets with Apache Hudi, and automated ingestion monitoring to cut manual work by 50%.
System Administrator
Wenger & Watson Pvt Ltd
Nov 2023 - Jan 2024 (2 months)
Built and maintained ETL workflows using Apache Hive and BigQuery for analytics and reporting pipelines. Managed incremental and historical datasets with Apache Hudi to ensure consistency and remove duplicates, and troubleshot PySpark and Kafka streaming failures to reduce downtime.
Education
Degrees, certifications, and relevant coursework
SCSVMV University
Bachelor of Technology, Computer Science and Engineering
2019 - 2023
Grade: 9.10/10.0
Activities and societies: NA
Completed a B.Tech in Computer Science and Engineering with a CGPA of 9.10/10.0 at SCSVMV University in Kanchipuram.
Availability
Location
Authorized to work in
Portfolio
giridharreddy-t.github.ioSalary expectations
Job categories
Skills
Interested in hiring Giridhar Reddy?
You can contact Giridhar Reddy and 90k+ other talented remote workers on Himalayas.
Message Giridhar ReddyFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
