Skip to main content
KN
Looking for a job

Karan Nayyar

@karannayyar

Senior Data Engineer at Anko GCC building Spark and Kafka pipelines for real-time analytics and AI-enabled applications.

India
Message

At Anko GCC, I design batch and real-time data architectures and build distributed pipelines with PySpark and Snowpark on an Iceberg-based lakehouse. I’ve implemented Snowflake CDC workflows and Kafka streaming ingestion to support fresher data and near-real-time analytics.

I also build data pipelines and retrieval workflows for AI-enabled applications, including embeddings and vector search with Azure OpenAI and Azure AI Search, and agent-based workflows using Google ADK. My work includes Snowflake performance optimization, PII governance, and workflow orchestration with Airflow.

Experience

Work history, roles, and key accomplishments

Anko GCC logoAG
Current

Senior Data Engineer

Anko GCC

Apr 2025 - Present (1 year 7 months)

- Designed scalable data architectures handling both batch and real-time workloads, making trade-offs between latency, cost, and performance using snowflake, spark and dbt.
- Built distributed data pipelines using PySpark and Snowpark over Iceberg-based lakehouse architecture
- Implemented CDC pipelines (Snowflake Streams/Tasks) improving data freshness and pipeline efficiency
- Designed streaming

Anko GCC logoAG

Data Engineer

Anko GCC

Mar 2024 - Apr 2025 (1 year 1 month)

🔹 Domain Experience: International Supply Chain, Domestic Supply Chain, Sourcing, Retail
🔹 My Daily Responsibilities:

• Develop and implement data sink pipelines from AWS S3 to Snowflake and Confluent Kafka to Snowflake, ensuring efficient and reliable data transfer.
• Design and construct ETL pipelines within Snowflake utilizing Change Data Capture (CDC) through Snowflake streams, enabling real-

Anko GCC logoAG

Associate Engineer

Anko GCC

Oct 2022 - Apr 2024 (1 year 6 months)

Worked as Associate Engineer at Anko GCC.

Xoriant logoXO

Software Developer

Aug 2022 - Oct 2022 (2 months)

🔹 Domain Experience: International Supply Chain, Domestic Supply Chain, Oil and Gas, Mattress Manufacturing, Aviation
🔹 Roles and Responsibilities:


• Team Collaboration: Work effectively both as a team member and independently.
• Requirements Analysis: Analyze requirements for sprints and releases; liaise with clients for clarifications and updates.
• Estimations and Planning: Gather requirement

Xoriant logoXO

Associate Software Engineer

Jan 2021 - Aug 2022 (1 year 7 months)

Worked as Associate Software Engineer at Xoriant.

Education

Degrees, certifications, and relevant coursework

CHANDIGARH UNIVERSITY logoCU

CHANDIGARH UNIVERSITY

Bachelor of Computer Science, Data Processing and Data Processing Technology/Technician

CHANDIGARH UNIVERSITY logoCU

CHANDIGARH UNIVERSITY

Bachelor of Engineering - BE, Computer Science

2017 - 2021

MI

Microsoft

Microsoft Certified: Data Analyst Associate

Oct 2021 · Expired Oct 2022

CU

CHANDIGARH UNIVERSITY

Android Development

Jun 2019

IB

IBM

Mastery Award for Big Data Engineering

2018 · Expired 2020

GO

Google

Architecting with Google Compute Engine

UD

UC San Diego

Big Data Integration and Processing

Interested in hiring Karan?

You can contact Karan and 600K+ other talented remote workers on Himalayas.

Message Karan

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan