Manichandana Gopireddy
@manichandanagopiredd
Experienced Data Engineer building scalable big-data pipelines and real-time analytics.
What I'm looking for
I am a data engineer with five years of hands-on experience designing and delivering scalable big-data pipelines and real-time analytics solutions across AWS, GCP, and hybrid cloud environments. I specialize in PySpark and Scala ETL/ELT development, Spark SQL, Delta Lake, and orchestration with Airflow and Step Functions, and have delivered high-performance platforms for clients including Sirius XM, Deloitte, and Hewlett Packard.
I focus on production-grade engineering: performance optimization, ACID-compliant architectures, data quality, schema evolution, and automated cluster lifecycle and workflow management. I bring practical experience with Spark Streaming, Kafka, OpenSearch, Databricks, Snowflake, and cloud-native services, and I prioritize reusable, testable components and reliable monitoring for enterprise analytics and data science initiatives.
Experience
Work history, roles, and key accomplishments
Data Engineer Intern
Sirius XM
May 2024 - Present (1 year 5 months)
Built and maintained scalable end-to-end AWS data pipelines using EMR, S3, EC2 and Airflow; developed PySpark jobs to extract and transform data from Snowflake, S3 and external WebAPIs and wrote final datasets to S3 and OpenSearch.
Data Engineer
Deloitte
Apr 2021 - Dec 2022 (1 year 8 months)
Designed and deployed distributed Spark pipelines on Google Dataproc and Databricks, integrating Kafka, GCS and Snowflake for batch and streaming ETL and implementing Delta Lake for ACID transactions and time travel.
Big Data Engineer
Connectial Infosolutions Pvt Ltd
May 2019 - Mar 2021 (1 year 10 months)
Managed Hive/Hadoop data platforms and developed ETL workflows using Spark, Sqoop and Informatica; wrote complex SQL and Python utilities to automate ingestion, validation and improve pipeline reliability for Hewlett Packard projects.
Education
Degrees, certifications, and relevant coursework
Grand Valley State University
Master of Science, Computer Science
Master of Science in Computer Science focusing on advanced topics relevant to data engineering and big data processing.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Manichandana?
You can contact Manichandana and 90k+ other talented remote workers on Himalayas.
Message ManichandanaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
