Open to opportunities

Karthik Sekar

@karthiksekar1

Message

Seasoned Data Engineering Lead with 13+ years of experience.

Germany

Message

What I'm looking for

I am looking for a role that fosters innovation, encourages collaboration, and offers opportunities for professional growth in data engineering.

I am a seasoned Data Engineering Lead with over 13 years of experience in designing and deploying scalable, cloud-native data platforms. My expertise lies in building real-time and batch pipelines using modern data stack tools such as Snowflake, dbt, Kafka, Airflow, and Python. I have a strong background in modern data architectures, including Data Mesh, Data Lakehouse, and Data Vault 2.0, and I am adept at leading cross-functional teams to ensure data governance and enable rapid analytics adoption across businesses.

Throughout my career, I have successfully designed and implemented complex data architectures and pipelines, mentored junior engineers, and led technical hiring processes. My role as a Tech Lead at IMMO Capital has allowed me to develop real-time event processing pipelines and create governed data platforms that adhere to GDPR controls. I am passionate about empowering data-driven decision-making and have maintained a high on-time delivery rate for critical projects.

Experience

Work history, roles, and key accomplishments

Current

Tech Lead Data Engineering

Current

Immo Capital

Feb 2022 - Present (3 years 6 months)

Designed and implemented a Data Mesh architecture with domain-driven dbt models and contract-based microservices. Developed real-time event processing pipelines using AWS MSK + Spark Streaming, enabling low-latency data flows to analytical systems.

DBT CI CD GitHub Actions)Snowflake Apache Superset LookML Agile Cursor AI IDE LLMs)

Senior Data Engineer

Penta GmbH (now Qonto)

Oct 2021 - Present (3 years 10 months)

Developed and maintained core dbt models for analytics and regulatory reporting. Built ingestion pipelines using AWS DMS into Snowflake, with structured ELT models.

DBT DMS Snowflake CI CD GitHub Actions)Data Analysis

Senior Data Engineer

Idealo Internet GmbH

Mar 2020 - Present (5 years 5 months)

Built modular data pipelines using PySpark on EMR to process pricing, product, and partner datasets at scale. Implemented Airflow DAGs for job orchestration and monitoring of hourly and daily workflows.

Pyspark EMR Airflow ETL S3 Spark Tableau RESTful APIs Python Machine Learning Recommendation Systems

Big Data Engineer

Gogoair (Inflight Internet Company)

Jun 2019 - Present (6 years 2 months)

Engineered a real-time ingestion pipeline using Kafka, Spark, and AWS to process in-flight telemetry and internet usage data. Built curated datasets in Redshift and Hive to support analytics and optimization.

Kafka Spark AWS Redshift Hive Pyspark Data Science

Big Data Engineer

Nielsen India

Oct 2016 - Present (8 years 10 months)

Created and optimized ETL pipelines using Apache Spark, Hive, and SQL to process market research data. Transformed manual reporting systems into automated workflows, increasing delivery speed and reliability.

Apache Spark Hive SQL ETL Data Automation Hadoop Test Automation Agile

Software Engineer

Tata Consultancy Services

Dec 2011 - Present (13 years 8 months)

Developed and executed test cases, test plans, and regression suites for web-based and enterprise applications. Collaborated with developers to identify and resolve bugs, performance issues, and system defects during agile sprints.

Test Cases Test Plans Selenium Junit Manual Testing Automated Testing Bug Reporting API Testing SDLC Git CI CD

Education

Degrees, certifications, and relevant coursework

Anna University

B.E ELECTRONICS AND INSTRUMENTATION ENGINEERING, Electronics and Instrumentation Engineering

2007 - 2011

Completed a Bachelor of Engineering in Electronics and Instrumentation Engineering. Studied core concepts and practical applications within the field.