# Arun K C

Arun K C is a remote worker on Himalayas, Open Source Contributor at naas.ai, based in India.

Source: https://himalayas.app/@arunkc1

```text
Data Engineer with 5+ years building scalable data platforms, pipelines, and cloud optimization.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | India |
| Authorized to work in | India |
| Job categories | Data Engineer, Data Engineer, Backend Engineer, DevOps Engineer, Cloud Engineer, Data Platform Engineer, Site Reliability Engineer, Infrastructure Engineer, Open Source Contributor, Data Engineering, Cloud Data Engineer, DataOps Engineer |
| Skills | Spark, PySpark, Pandas, Jupyter Notebooks, AWS Glue, AWS Lambda, AWS ECS, AWS CodeBuild, AWS CodeDeploy, AWS CodePipeline, Athena, Cloudwatch, IAM, Secret Management, ETL Processes, Data Pipelines, Airflow, Python, SQL, C++, JavaScript, Java, Solidity, React NextJS, Docker, Docker Compose, Shell Scripting, Git, GitHub, Bitbucket, Jira, Confluence, Apache Hudi, Redshift, Kinesis, S3, EC2, CloudFormation, Delta Lake, Superset, Metabase, Jupyter, DBT, JSON, Windows, Serverless, Core Data, Okta, AWS Copilot, Dune Analytics, React, AWS |

## What I'm looking for

```text
I seek roles with end-to-end ownership of data platforms, collaborative startup or product teams, opportunities to optimize cloud costs and performance, and scope to mentor and contribute to open source.
```

## About

```text
I am a versatile Data Engineer with 5+ years of experience delivering scalable data platforms and metadata-driven frameworks in fast-paced startup and enterprise environments. I build and optimize ETL pipelines, design CI/CD for data systems, and drive cloud cost and performance improvements—achieving a 50% runtime reduction and 40% cost savings.

I have led and mentored teams, contributed to open-source projects, and implemented secure, production-grade infrastructure on AWS using PySpark, Glue, Lambda, ECS, and related services. I thrive on end-to-end ownership, modular design, and reducing tech debt while accelerating iteration for lean engineering teams.
```

## Experience

### Open Source Contributor (current)

naas.ai. Jan 2021 - Present

```text
Developed custom notebooks and integrations for naas.ai to automate notifications and extend platform functionality for users.
```

Skills: Python, Notebooks, APIs, Automation

### Open Source Contributor (current)

Elementary Data. Jan 2021 - Present

```text
Implemented upload feature to Azure Blob Storage and resolved bugs to improve report ingestion and reliability.
```

Skills: Python, Azure-Blob-Storage, CI-CD

### Data Engineer

PYOR. Dec 2023 - Aug 2025

```text
Built and optimized scalable data platforms and CI/CD for trading systems, reducing pipeline runtime by 50% and cloud costs by 40% while improving infrastructure security and availability.
```

Skills: Python, PySpark, AWS-ECS, CI-CD, Data-Pipelines, Infrastructure-Security, Superset, Metabase

### Technology Analyst

[Infosys](https://himalayas.app/companies/infosys-limited). Oct 2022 - Nov 2023

```text
Led a team of 5 to build DBT-based data pipelines and a metadata-driven framework, migrating data to AWS and creating GitHub workflows to automate deployments.
```

Skills: DBT, Python, AWS-Glue, Redshift, GitHub-Actions, Data-Driven-Framework, Data-Modeling

### Senior Systems Engineer

[Infosys](https://himalayas.app/companies/infosys-limited). Jan 2022 - Sep 2022

```text
Led a team of 10 to build self-healing SFTP-to-Redshift pipelines with data quality checks and optimized a metadata-driven framework for performance.
```

Skills: AWS-RedShift, Data-Quality, Python, Data-Driven-Framework, Lambda, ETL

### Systems Engineer

[Infosys](https://himalayas.app/companies/infosys-limited). Jan 2020 - Dec 2021

```text
Developed metadata-driven pipeline generator and deployed end-to-end ETL solutions using AWS serverless tech, reducing development time by ~80% for batch and near-real-time workloads.
```

Skills: AWS-Glue, Lambda, S3, Apache-Hudi, Kinesis, Python, ETL, PostgreSQL

## Education

### APJ Abdul Kalam Technological University

Bachelor of Technology, Computer Science and Engineering. 2015 - 2019. Grade: 7.3/10

Activities and societies: Kerala Startup Mission Idea Fest 2018 Finalist

```text
Completed a Bachelor of Technology in Computer Science and Engineering with a CGPA of 7.3/10 from KTU between August 2015 and August 2019.
```

## Tech stack

- AWS Glue
- Superset
- Metabase
- GitHub
- Bitbucket
- Docker Compose
- AWS Copilot
- AWS CodePipeline
- AWS CodeBuild
- Jupyter
- Pandas
- PySpark
- dbt
- AWS CodeDeploy
- Gmail
- Okta
- Jira
- JavaScript
- Java
- JSON
- Windows
- AWS Lambda
- Serverless
- Airflow
- Amazon Web Services (AWS)
- SQL
- Core Data
- Dune Analytics
- Delta Lake
- Apache Hudi

To contact Arun, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [BHUMIKA SHARMA](https://himalayas.app/@bhumikasharma): Data Engineer, Quantiphi
- [Vinutha Vishwanatha Devadiga](https://himalayas.app/@vinuthavishwanathade): Senior Data Engineer, FIS
- [Lavanaya dayala](https://himalayas.app/@lavanayadayala): Senior Data Engineer, Accenture
- [Harshith Kumar K](https://himalayas.app/@harshithkumark): Senior Software Engineer (Data Engineering), TEKsystems Global Solution (American Automobile Association)
- [Kannan Thangaraju](https://himalayas.app/@kannanthangaraju): Senior Data Engineer, Fitch Group
- [Himanshu Saroj](https://himalayas.app/@himanshusaroj): Sales Data Analytics Engineer, Russell Investments
- [Anubhav Gupta](https://himalayas.app/@anubhavgupta1): Data Engineer II, Bristol Myers Squibb
- [Deepak Kumar](https://himalayas.app/@deepakkumar22): Senior Data Engineer, iSOCRATES Inc.
- [Kalash Jindal](https://himalayas.app/@kalashjindal): Senior Data Engineer, NASDAQ
- [Sachin khajuria](https://himalayas.app/@sachinkhajuria): Sr. Analyst Data Engineering, LatentView Analytics
