karthik buddhavarapu

Architected end-to-end migration from AWS Glue/Redshift to Databricks, managing 800+ tables and 200+ workflows via Unity Catalog. Developed a custom Python metadata utility using Databricks GenAI, reducing manual governance effort by 70%.

Architected the firm's initial Big Data infrastructure and engineered high-throughput pipelines using Kafka and Spark for near real-time credit-lending and fraud detection insights. Delivered optimized Data Marts ensuring consistent KPI definitions and 100% self-service reporting.

Managed design and delivery of critical application modules, aligning product roadmaps with business goals. Engineered a custom ingestion framework integrated with Talend ETL, reducing total data life cycle runtime by 4 hours.

Consulted for HDFC, JM Financial, and UPL to architect scalable Data Lakes on AWS and Azure. Engineered Single View of Customer platforms by deduplicating disparate silos into unified lakes, enabling advanced propensity modeling.

Contributed to large-scale Hadoop applications, focusing on high-volume processing using MapReduce and early-stage Spark. Held end-to-end responsibility for critical modules, including feature development, bug fixes, and Hive performance tuning.

Pursued a Bachelor of Technology in Computer Science from JNTU-Hyderabad, graduating in 2013.