karthik k
@karthikk1
Data engineer specializing in Azure Databricks, PySpark and scalable, automated ETL pipelines.
IndiaWhat I'm looking for
I am a data engineer focused on designing and building scalable Azure-based data pipelines that modernize legacy systems into cloud-native solutions. I specialize in PySpark, Azure Databricks, Airflow orchestration, and implementing robust ETL practices like SCD Type 2 and data watermarking.
At Infosys, I modernized Informatica workflows for large-scale case management systems, migrated Oracle to ADLS Gen2, and integrated Databricks with Snowflake and Azure DevOps for CI/CD and monitoring. I also developed interactive Power BI dashboards during an earlier analytics internship and consistently emphasize data quality, automation, and performance.
I collaborate well in Agile, cross-functional teams, contribute to DevOps and DataOps practices, and pursue continuous learning—evidenced by a master’s in Advanced Computer Science and hands-on projects in real-time streaming, medallion architectures, and cloud-native ETL.
Experience
Work history, roles, and key accomplishments
Designed scalable PySpark pipelines on Azure Databricks and modernized legacy Informatica workflows for Cisco, improving ETL efficiency and data reliability across enterprise datasets. Orchestrated pipelines with Airflow, migrated data to ADLS Gen2, and implemented SCD Type 2 and validation frameworks to ensure accuracy and freshness.
Data Analyst Intern
Renalyx Health Systems Pvt Ltd
Sep 2020 - Feb 2021 (5 months)
Built interactive Power BI dashboards and transformed raw data into structured formats to deliver actionable insights, optimizing queries to improve dashboard load times and user experience. Collaborated with stakeholders to iterate on visualizations.
Education
Degrees, certifications, and relevant coursework
UNUniversity of Northumbria
Master of Science, Advanced Computer Science
2024 - 2025
Grade: Distinction
Activities and societies: Event Representative; coursework highlights include Advanced Database (90%)
Master's in Advanced Computer Science with coursework in Deep Learning, Machine Learning, GenAI, Big Data, Cloud Computing, and Distributed Information Systems.
National College, Bangalore University
Bachelor of Computer Applications, Computer Science and Applications
2018 - 2021
Activities and societies: Volunteered and organized coding competitions; member of IEEE IT Club
Bachelor of Computer Science and Applications covering Data Structures, Computer Architecture, Software Engineering, OOP, and Client-Server Programming.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring karthik?
You can contact karthik and 90k+ other talented remote workers on Himalayas.
Message karthikFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
