Ratnesh Kumar

I’m a Data Engineer who builds and optimizes end-to-end batch/streaming pipelines. In my current role, I designed incremental pipelines and focused on performance tuning to reduce cost and improve reliability.

I implement strong data governance practices so teams can rely on standardized security, access control, and compliant data management. I also built event-driven workflows where Pub/Sub detects asynchronous file arrivals and triggers Databricks jobs to complete ingestion.

I’ve migrated pipelines from Databricks to DBT and ran them through Databricks using Jobs UI and API. I’ve led a BigQuery architecture redesign that improved the codebase and delivered an annual 20% GCP cost reduction.

Beyond production work, I’ve built a YouTube data analysis ingestion pipeline into partitioned BigQuery tables with dashboards in Looker. I also developed a news sentiment analysis pipeline using Bing API, Azure Data Factory, and SynapseML, and I’m certified as a Databricks Data Engineer.