Krishna Pole

I’m an Azure Data Engineer with 3 years of experience building scalable ETL/ELT pipelines and cloud-based data platforms on Azure. I focus on large-scale data transformation and warehousing, using Azure Data Factory, Azure Databricks, PySpark, and Delta Lake to support analytics and AI/ML workloads.

In my current role at Globestar Software Limited, I developed ETL/ELT pipelines that process 500K+ records per day across multiple sources. I built PySpark transformation workflows across 10+ ingestion pipelines using Bronze/Silver/Gold architectures, and optimized Azure Synapse Analytics queries to reduce reporting execution time by ~30%. I also automated CI/CD deployments for ADF pipelines and Databricks notebooks using Azure DevOps, improving consistency and reducing manual release effort.

I bring a strong software engineering and DevOps foundation, including secure cloud access patterns with VNets, NSGs, RBAC, Managed Identities, and Azure Bastion. Beyond data engineering, I’ve built MLOps and RAG solutions—like a containerized MLOps pipeline with MLflow/FastAPI/Docker and a contextual RAG document search system using LangChain, LangGraph, FAISS, and LangSmith.