Abhijeet Rayapeddi

I’m a Senior Software Engineer and data/AI engineer specializing in real-time data processing and cloud-native analytics on GCP. I bring strong Python/Java development experience and a focus on building production-grade, scalable data platforms.

At HSBC Technology India, I created an LLM-based SQL generation system for complex SQL transformations, decreasing manual effort by 70% and improving query efficiency. I implemented Airflow DAGs across the full pipeline lifecycle (ingestion, transformation, validation, and cross-team dependencies) and built synthetic data generation to cut setup time by 50% while eliminating reliance on live financial records in non-production environments.

I also built and operated high-scale payment streaming pipelines—processing 50,000 events daily via Pub/Sub and Dataflow, reducing processing time from 7 days to 2 minutes and improving operational efficiency by 95%. By optimizing BigQuery workloads (30% performance gain) and implementing exactly-once delivery with event-time windowing, late-data triggers, and idempotent writes in Apache Beam, I improved reliability under sub-hour SLA windows and managed schema-drift incidents while coordinating across multiple time zones. Earlier, at Wiley Edge, I built Java-based Dataflow pipelines for XML parsing into BigQuery and authored SQL scripts/stored procedures to reduce manual handoffs.