maria deepa
@mariadeepa1
Senior Data Engineer designing scalable AWS/GCP data platforms and optimizing ETL/ELT pipelines with PySpark and Spark SQL.
What I'm looking for
I’m a Senior Data Engineer with 10 years of experience designing, developing, and optimizing enterprise-scale data platforms across AWS, GCP, Hadoop, and Spark ecosystems. I build end-to-end ETL/ELT pipelines using Python, PySpark, Spark SQL, Hive, and SQL, delivering scalable cloud-native data solutions. I also bring strong expertise in Data Warehousing, Data Modeling, Source-to-Target Mapping, BRDs, Technical Design Documents, ER Diagrams, and Data Validation.
In my recent work at Altimetrik, I designed scalable ETL/ELT pipelines on AWS EMR, integrated REST APIs and enterprise databases, and loaded curated datasets into Iceberg and Amazon Redshift. I build Airflow DAGs, automate CI/CD with Jenkins, and optimize Spark performance through techniques like Broadcast Join, Salting, Predicate Pushdown, AQE, and Partition Pruning—while handling production support and incident management. I’ve also led migration work including Teradata to Hadoop and Hadoop to GCP, supporting metadata analysis, schema mapping, and ETL redesign with tools like BigQuery, Cloud Storage, Dataproc, and Cloud Composer.
Experience
Work history, roles, and key accomplishments
Senior Software Engineer
Altimetrik
Oct 2020 - Present (5 years 9 months)
Designed scalable ETL/ELT pipelines using Python and PySpark on AWS EMR and integrated REST APIs and enterprise databases. Built Airflow DAGs, loaded curated datasets into Iceberg and Amazon Redshift, and optimized Spark performance for production support.
Participated in Hadoop to GCP migration by performing metadata analysis, schema mapping, and ETL redesign. Supported reconciliation, validation, and production deployment using BigQuery and GCP data services.
Developed HQL ETL pipelines for Teradata to Hadoop migration using Hive-based tooling. Performed query optimization, migration testing, validation, and production support.
Education
Degrees, certifications, and relevant coursework
maria hasn't added their education
Don't worry, there are 90k+ talented remote workers on Himalayas
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring maria?
You can contact maria and 90k+ other talented remote workers on Himalayas.
Message mariaGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
