Prashant Gortakar
@prashantgortakar
Senior Data Engineer specializing in big data pipelines across Hadoop and cloud.
IndiaWhat I'm looking for
I’m a results-driven Senior Data Engineer with 7+ years of IT experience, including 4+ years specializing in Big Data and cloud-based data engineering. I design and implement large-scale data pipelines using the Hadoop ecosystem, combining Hive, Sqoop, Spark, HDFS, and Yarn with PySpark, Scala, and Python to deliver dependable, business-ready datasets.
In my recent role at HSBC Bank, I ingest files to HDFS, define schemas on raw data, and optimize query performance through partitioning. I execute HiveQL/SQL transformations and deliver final outputs to on-premise clusters or relational databases, with Apache Airflow supporting robust orchestration and Tableau enabling visibility.
Earlier, I led the ReconFramework project for reconciliation reporting, and built the G20 data pipeline for ingestion, transformation, and distributed delivery of filtered columns. I’ve also supported validation and reporting in environments like Micron and worked end-to-end with dashboards and data system validation, using Jira-driven testing and defect management to keep releases accurate and on track.
Experience
Work history, roles, and key accomplishments
Ingested files to HDFS, defined schemas on raw data, and partitioned datasets using Hive and PySpark for optimized query performance. Wrote HiveQL/SQL transformations and delivered final outputs to on-premise clusters or relational databases.
Imported customer data from relational databases into HDFS for analysis and developed dashboard queries for consolidated status reporting. Validated modules against customer-specific data to ensure accuracy.
Conducted validation and testing of data systems and hardware-software integrations to ensure system correctness. Performed verification activities across integrated components as part of the testing process.
Education
Degrees, certifications, and relevant coursework
Visvesvaraya Technological University
Master of Computer Applications (MCA), Computer Applications
Grade: 69%
Completed a Master of Computer Applications (MCA) at Visvesvaraya Technological University, Bangalore in 2014, scoring 69%.
Availability
Location
IndiaAuthorized to work in
Social media
Job categories
Interested in hiring Prashant?
You can contact Prashant and 90k+ other talented remote workers on Himalayas.
Message PrashantFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
