Looking for a job

Pranay Deshmukh

@pranaydeshmukh

Data Engineer at Simpplr building AWS and Snowflake pipelines, including Audio/Video Analytics models that reduced processing latency by 30%.

India

Message

At Simpplr, I designed data models and ETL pipelines for Audio/Video Analytics, Chat, and Recognition, reducing data processing latency by 30%.

I optimized SQL transformations and DBT models on Snowflake, cutting pipeline runtimes and data turnaround time. I also implemented archiving for 30+ transformation tables to reduce DAG execution time.

I built an AWS Lambda solution to fetch and process the latest files automatically, and contributed to migrating data pipelines from Salesforce to AWS.

At Bolt Solutions, I developed data pipelines with Spark and Scala and worked across AWS, Azure, and Google BigQuery. Earlier, as a Data Science Intern at Avegen Pvt Ltd, I optimized SQL queries and created interactive dashboards in Google Data Studio.

Experience

Work history, roles, and key accomplishments

Current

AWS Data Engineer

Current

Simpplr

Sep 2024 - Present (2 years 1 month)

Optimized ETL pipeline performance by 60-90% through SQL and data transformation query optimization. Reduced DAG execution time by 40-70% by implementing archiving for 30+ Snowflake transformation tables.

SQL ETL Snowflake DBT AWS Lambda Data Modeling Data Quality Data Sharing

Data Engineer

Bolt Solutions

Jan 2022 - Sep 2024 (2 years 8 months)

Created and executed comprehensive data pipelines integrating diverse data sources using Apache Spark, Scala, Hive, and MySQL. Improved data processing efficiency by 30% through Spark-Scala integrations.

Apache Spark Scala Hive MySQL Airflow BigQuery Databricks AWS Azure Python PostgreSQL SQL Server S3 Data Warehouse ETL

Data Science Intern

Avegen Pvt Ltd

Aug 2021 - Oct 2021 (2 months)

Engineered and executed complex SQL queries in a BigQuery environment, extracting diverse datasets and refining query performance. Produced interactive dashboards using Google Data Studio to present vital metrics.

SQL BigQuery Google Data Studio Data Visualization