Open to opportunities

Arun K C

@arunkc1

Message

Data Engineer with 5+ years building scalable data platforms, pipelines, and cloud optimization.

India

Message

What I'm looking for

I seek roles with end-to-end ownership of data platforms, collaborative startup or product teams, opportunities to optimize cloud costs and performance, and scope to mentor and contribute to open source.

I am a versatile Data Engineer with 5+ years of experience delivering scalable data platforms and metadata-driven frameworks in fast-paced startup and enterprise environments. I build and optimize ETL pipelines, design CI/CD for data systems, and drive cloud cost and performance improvements—achieving a 50% runtime reduction and 40% cost savings.

I have led and mentored teams, contributed to open-source projects, and implemented secure, production-grade infrastructure on AWS using PySpark, Glue, Lambda, ECS, and related services. I thrive on end-to-end ownership, modular design, and reducing tech debt while accelerating iteration for lean engineering teams.

Experience

Work history, roles, and key accomplishments

Current

Open Source Contributor

Current

naas.ai

Jan 2021 - Present (4 years 8 months)

Developed custom notebooks and integrations for naas.ai to automate notifications and extend platform functionality for users.

Python Notebooks Automation)APIs

Current

Open Source Contributor

Current

Elementary Data

Jan 2021 - Present (4 years 8 months)

Implemented upload feature to Azure Blob Storage and resolved bugs to improve report ingestion and reliability.

Python Azure Blob Storage CI CD

Data Engineer

PYOR

Dec 2023 - Aug 2025 (1 year 8 months)

Built and optimized scalable data platforms and CI/CD for trading systems, reducing pipeline runtime by 50% and cloud costs by 40% while improving infrastructure security and availability.

Python Pyspark AWS ECS CI CD Data Pipelines Infrastructure Security Superset Metabase

Technology Analyst

Infosys

Oct 2022 - Nov 2023 (1 year 1 month)

Led a team of 5 to build DBT-based data pipelines and a metadata-driven framework, migrating data to AWS and creating GitHub workflows to automate deployments.

DBT Python AWS Glue Redshift GitHub Actions Data Driven Framework Data Modeling

Senior Systems Engineer

Infosys

Jan 2022 - Sep 2022 (8 months)

Led a team of 10 to build self-healing SFTP-to-Redshift pipelines with data quality checks and optimized a metadata-driven framework for performance.

AWS RedShift Data Quality Python Data Driven Framework Lambda ETL

Systems Engineer

Infosys

Jan 2020 - Dec 2021 (1 year 11 months)

Developed metadata-driven pipeline generator and deployed end-to-end ETL solutions using AWS serverless tech, reducing development time by ~80% for batch and near-real-time workloads.