# Karan Nayyar

Karan Nayyar is a remote worker on Himalayas, Senior Data Engineer at Anko GCC, based in India.

Source: https://himalayas.app/@karannayyar

```text
Senior Data Engineer at Anko GCC building Spark and Kafka pipelines for real-time analytics and AI-enabled applications.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 140k+ USD |
| Job categories | Data Engineer |
| Skills | Data Engineering, Data Pipelines, Data Architecture, Distributed Systems, Real time Data Processing, ETL, Data Modeling, Data Warehouse, Data Lake, AI ML Data Pipelines, Large Language Models, RAG, Semantic Search, Vector Search, Embedding Pipelines |
| LinkedIn | https://linkedin.com/in/karrannayyar |

## About

```text
At Anko GCC, I design batch and real-time data architectures and build distributed pipelines with PySpark and Snowpark on an Iceberg-based lakehouse. I’ve implemented Snowflake CDC workflows and Kafka streaming ingestion to support fresher data and near-real-time analytics.

I also build data pipelines and retrieval workflows for AI-enabled applications, including embeddings and vector search with Azure OpenAI and Azure AI Search, and agent-based workflows using Google ADK. My work includes Snowflake performance optimization, PII governance, and workflow orchestration with Airflow.
```

## Experience

### Senior Data Engineer (current)

Anko GCC. Apr 2025 - Present

```text
- Designed scalable data architectures handling both batch and real-time workloads, making trade-offs between latency, cost, and performance using snowflake, spark and dbt.
- Built distributed data pipelines using PySpark and Snowpark over Iceberg-based lakehouse architecture
- Implemented CDC pipelines (Snowflake Streams/Tasks) improving data freshness and pipeline efficiency
- Designed streaming
```

### Data Engineer

Anko GCC. Mar 2024 - Apr 2025

```text
🔹 Domain Experience: International Supply Chain, Domestic Supply Chain, Sourcing, Retail
🔹 My Daily Responsibilities:

• Develop and implement data sink pipelines from AWS S3 to Snowflake and Confluent Kafka to Snowflake, ensuring efficient and reliable data transfer.
• Design and construct ETL pipelines within Snowflake utilizing Change Data Capture (CDC) through Snowflake streams, enabling real-
```

### Associate Engineer

Anko GCC. Oct 2022 - Apr 2024

```text
Worked as Associate Engineer at Anko GCC.
```

### Software Developer

[Xoriant](https://himalayas.app/companies/xoriant). Aug 2022 - Oct 2022

```text
🔹 Domain Experience: International Supply Chain, Domestic Supply Chain, Oil and Gas, Mattress Manufacturing, Aviation
🔹 Roles and Responsibilities:

• Team Collaboration: Work effectively both as a team member and independently.
• Requirements Analysis: Analyze requirements for sprints and releases; liaise with clients for clarifications and updates.
• Estimations and Planning: Gather requirement
```

### Associate Software Engineer

[Xoriant](https://himalayas.app/companies/xoriant). Jan 2021 - Aug 2022

```text
Worked as Associate Software Engineer at Xoriant.
```

## Education

### CHANDIGARH UNIVERSITY

Bachelor of Computer Science, Data Processing and Data Processing Technology/Technician

### CHANDIGARH UNIVERSITY

Bachelor of Engineering - BE, Computer Science. 2017 - 2021

### Microsoft

Microsoft Certified: Data Analyst Associate

```text
Oct 2021 · Expired Oct 2022
```

### CHANDIGARH UNIVERSITY

Android Development

```text
Jun 2019
```

### IBM

Mastery Award for Big Data Engineering

```text
2018 · Expired 2020
```

### Google

Architecting with Google Compute Engine

### UC San Diego

Big Data Integration and Processing

## Tech stack

- Snowflake
- Azure Synapse
- Apache Spark
- Google Compute Engine
- Amazon S3
- Kubernetes
- Amazon EKS
- Jenkins
- GitHub Actions
- PySpark
- dbt
- Terraform
- Python
- Avro
- AWS Lambda
- Docker
- Apache Iceberg
- Retrieval-Augmented Generation (RAG)
- Power BI
- Apache Kafka
- REST APIs

To contact Karan, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Saumya Ranjan](https://himalayas.app/@saumyaranjan1): Data Engineer, Axis Bank
- [Dillep Ballem](https://himalayas.app/@dillepballem): Sr. Data Engineer, Insight Software International Pvt. Ltd.
- [Devagya Awasthi](https://himalayas.app/@devagya): Senior Data Engineer, EZData Advisory
- [Aarsh User](https://himalayas.app/@aarshuser): Data Analyst Data Engineering, Innovaccer Analytics Pvt. Ltd.
- [Aditya Salabh](https://himalayas.app/@adityasalabh): Software Engineer (Data Infra), Zerberus Technology
- [Ritika Lahariya](https://himalayas.app/@ritikalahariya): Data Engineer, Globant
- [Ramakrishna Reddy](https://himalayas.app/@ramakrishnareddy): Data Engineer / Snowflake Developer, H&R Block Pvt Ltd
- [Aditi Vaidya](https://himalayas.app/@aditivaidya): Senior Data Engineer, Konverge.AI
- [Sanjai B](https://himalayas.app/@sanjaib): Data Engineer, Onward Technologies
- [Mohammed Abu Bakkar Kuchikar](https://himalayas.app/@mohammedabubakkarkuc): Data Engineer, GWC Data.AI
