Kanishk Gupta

I’m a Data Engineer focused on building scalable, production-grade ETL/ELT systems and cloud data platforms. Currently, I’m driving data initiatives for Fortune 500 clients at Sigmoid Analytics, with a strong emphasis on Medallion Architecture and production-grade automation.

At Sigmoid Analytics, I’ve architected end-to-end pipelines for global deployments using Azure Databricks and PySpark, implementing Bronze/Silver/Gold layers to improve data quality and business readiness. I also manage complex workflow orchestration with Apache Airflow and Snowflake, improving reliability through targeted debugging and refactoring of SQL/Python for performance. To reduce manual effort, I build self-served ingestion tools using Azure Data Factory (ADF) and the Python SDK, and I standardize environments with Docker for consistent local, staging, and production delivery.

Earlier, as a Software Engineering Intern at Tata Steel (SNTI), I built a full-stack transcription-to-translation application using React.js and Web Workers for high-performance background processing. I integrated OpenAI Whisper for a 10x speedup versus traditional APIs through optimized local model execution, and I implemented Xenova Transformers for real-time translation across 10+ languages with over 85% accuracy. I’m also a Databricks Certified Data Engineer Associate and enjoy leading technical ecosystems—whether running workshops or directing campus technical events with large teams.