Abhijna P S
@abhijnaps
Data Engineer building scalable ETL/ELT pipelines and data services.
What I'm looking for
I’m a Data Engineer with 2.8 years of experience building scalable ETL/ELT pipelines and data platforms. I focus on turning messy inputs into dependable, production-ready data flows for analytics, reporting, and onboarding.
At MADTECH.AI (Jul 2023 – Feb 2026), I built automated ingestion pipelines using Airflow and PySpark—detecting daily files, preprocessing data, updating ingestion status, triggering Airbyte loads, and refreshing Redshift materialized views. I also automated client onboarding end-to-end with Airflow, Airbyte, S3, AWS Lambda, and Redshift, reducing setup time by 80% (8h → 1h).
I build the services around the data: I developed secure outbound REST APIs using Flask on AWS Lambda with RDS/API Gateway, including JWT authentication (access/refresh), validation, rate limiting, and pagination. I used dbt to manage and version-control client-specific materialized views, safely updating transformations during new client onboarding.
I’ve delivered measurable scale and reliability too—resolving 30K+ duplicate records across multi-client schemas, optimizing Redshift materialized views integrating GA4/Facebook Ads/external sources to improve cross-platform consistency by 95%, and reducing manual dashboard operations by 70% through AWS Lambda + API Gateway microservices for Superset cloning, alerts, and metadata replication.
Experience
Work history, roles, and key accomplishments
Data Engineer
Madtech.ai
Jul 2023 - Feb 2026 (2 years 7 months)
Built automated ETL/ELT pipelines with Airflow, PySpark, Airbyte, and Amazon Redshift, including client onboarding that reduced setup time by 80% (8h → 1h). Developed REST APIs on AWS Lambda with JWT auth and rate limiting, and delivered reliability improvements including resolving 30K+ duplicates and improving Redshift materialized view consistency by 95%.
Education
Degrees, certifications, and relevant coursework
Amrita Vishwa Vidyapeetham
Integrated Master of Computer Applications, Computer Applications
2018 - 2023
Grade: CGPA: 7.8
Completed an Integrated MCA at Amrita Vishwa Vidyapeetham, Mysuru, achieving a CGPA of 7.8 (2018–2023).
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Abhijna ?
You can contact Abhijna and 90k+ other talented remote workers on Himalayas.
Message AbhijnaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
