Abhijna P S
@abhijnaps
Data Engineer building scalable ETL/ELT pipelines and data services.
What I'm looking for
I’m a Data Engineer with 2.8 years of experience building scalable ETL/ELT pipelines and data platforms. I focus on turning messy inputs into dependable, production-ready data flows for analytics, reporting, and onboarding.
At MADTECH.AI (Jul 2023 – Feb 2026), I built automated ingestion pipelines using Airflow and PySpark—detecting daily files, preprocessing data, updating ingestion status, triggering Airbyte loads, and refreshing Redshift materialized views. I also automated client onboarding end-to-end with Airflow, Airbyte, S3, AWS Lambda, and Redshift, reducing setup time by 80% (8h → 1h).
I build the services around the data: I developed secure outbound REST APIs using Flask on AWS Lambda with RDS/API Gateway, including JWT authentication (access/refresh), validation, rate limiting, and pagination. I used dbt to manage and version-control client-specific materialized views, safely updating transformations during new client onboarding.
I’ve delivered measurable scale and reliability too—resolving 30K+ duplicate records across multi-client schemas, optimizing Redshift materialized views integrating GA4/Facebook Ads/external sources to improve cross-platform consistency by 95%, and reducing manual dashboard operations by 70% through AWS Lambda + API Gateway microservices for Superset cloning, alerts, and metadata replication.
Experience
Work history, roles, and key accomplishments
Data Engineer
Madtech.ai
Jul 2023 - Feb 2026 (2 years 7 months)
Built automated ETL/ELT pipelines with Airflow, PySpark, Airbyte, and Amazon Redshift, including client onboarding that reduced setup time by 80% (8h → 1h). Developed REST APIs on AWS Lambda with JWT auth and rate limiting, and delivered reliability improvements including resolving 30K+ duplicates and improving Redshift materialized view consistency by 95%.
Education
Degrees, certifications, and relevant coursework
Amrita Vishwa Vidyapeetham
Integrated Master of Computer Applications, Computer Applications
2018 - 2023
Grade: CGPA: 7.8
Completed an Integrated MCA at Amrita Vishwa Vidyapeetham, Mysuru, achieving a CGPA of 7.8 (2018–2023).
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Abhijna ?
You can contact Abhijna and 90k+ other talented remote workers on Himalayas.
Message AbhijnaFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
