Sharan Reddy Appidi
@sharanreddyappidi
Data analyst and cloud data engineer driving scalable pipelines and actionable insights.
United StatesWhat I'm looking for
I am an accomplished Data Analyst and Cloud Data Engineer with over five years of experience designing, developing, and modernizing enterprise-scale data ecosystems across AWS, Azure, and Snowflake. I specialize in Python, SQL, and PySpark to build automated ETL/ELT pipelines that power analytics, reporting, and ML workloads.
I have designed and implemented Medallion Architecture and ODS models, built distributed processing solutions with Databricks, Spark, Hadoop, and Kafka, and optimized pipelines to reduce refresh times and compute costs. At Caterpillar, I improved data refresh time by 35% and lowered compute costs by 20% while strengthening governance and lineage.
My background includes migrating legacy ETL into cloud-native services, implementing real-time Kafka + Spark ingestion frameworks, and delivering curated datasets and dashboards that enable business decisions. I emphasize observability, automation, and compliance through tools such as ADF, Glue, Airflow, and RBAC practices.
I collaborate in Agile and DevOps environments, mentor junior analysts, and focus on delivering reliable, scalable data platforms that drive measurable business and federal outcomes.
Experience
Work history, roles, and key accomplishments
Data Analyst
Caterpillar Inc.
May 2023 - Present (2 years 5 months)
Designed and deployed multi-cloud data pipelines integrating IoT telemetry and ERP data into a medallion-layered data lake, cutting data refresh time by 35% and reducing manual interventions by 90%. Tuned Spark jobs and optimized clusters to lower compute costs by 20% while improving predictive maintenance analytics.
Cloud Data Engineer
Dell Technologies
Jan 2021 - Jul 2022 (1 year 6 months)
Migrated legacy ETL to cloud-native pipelines and built Kafka+Spark streaming frameworks for real-time ingestion, improving processing speed by 25% and enhancing observability and reliability across global datasets. Implemented data security and automated validation to improve SLA compliance.
Data Analyst
Karvy Analytics Limited
May 2019 - Dec 2020 (1 year 7 months)
Designed and automated SQL and Python ETL pipelines and built Power BI/Tableau dashboards that reduced reporting turnaround by 75% and improved data reliability for client-facing analytics. Established data quality frameworks and documentation to enhance governance.
Education
Degrees, certifications, and relevant coursework
CUCleveland State University
Master of Science, Information Systems
2022 - 2024
Completed a Master's in Information Systems with coursework and projects focused on data engineering, cloud platforms, and analytics.
Vignana Bharathi Institute of Technology
Bachelor of Technology, Electronics & Communication Engineering
2015 - 2019
Earned a Bachelor of Technology in Electronics and Communication Engineering with foundational training in engineering principles and programming.
Tech stack
Software and tools used professionally
Availability
Location
United StatesAuthorized to work in
Job categories
Interested in hiring Sharan Reddy?
You can contact Sharan Reddy and 90k+ other talented remote workers on Himalayas.
Message Sharan ReddyFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
