Looking for a job

Patit Dey

@patitdey

Sr. Data Engineer with 10+ yrs experience in AWS, Python, SQL, PySpark, Snowflake & BI tools, building scalable pipelines & data solutions.

United States

Message

What I'm looking for

I seek senior data engineering roles building cloud-native, scalable data platforms (AWS/Snowflake/Databricks), emphasizing CI/CD, data governance, mentoring teams, and delivering high-quality analytics in collaborative, growth-oriented organizations.

Sr. Data Engineer with 10+ years of IT experience in designing, developing, and maintaining data pipelines and infrastructure for large-scale data processing. Proficient in leveraging cloud platforms, such as AWS. Skilled in Python and SQL programming, utilizing PySpark and Spark SQL for distributed data processing. Experienced in working with various Databases and Data Warehouses, including Snowflake, Oracle, Teradata, SQL Server, PostgreSQL, and Redshift. Good exposure to visualization tools like Power BI, Tableau for data analysis, reports, and Dashboard creation.

Experience

Work history, roles, and key accomplishments

Senior Data Engineer

INNOS

Sep 2024 - Jul 2025 (10 months)

Architected and executed scalable ETL pipelines using Python, Apache Airflow, AWS Glue and Azure Data Factory, improving data processing efficiency by 30%. Implemented CI/CD and testing practices that reduced release cycle times by 40% and improved deployment reliability.

Python Apache Airflow AWS Glue Azure Data Factory Django Flask fastAPI PostgreSQL CI CD

Senior Data Engineer

Coforge

Oct 2019 - Sep 2024 (4 years 11 months)

Optimized Databricks PySpark and Spark SQL pipelines and Snowflake ingestion patterns, improving data quality and query performance for analytics workloads. Led migration of on-premise Hadoop to Snowflake and built Airflow-orchestrated ETL integrating DBT, Kafka, and AWS services to streamline analytics delivery.

Databricks Pyspark Snowflake Apache Airflow DBT Kafka Power BI

Data Engineer

Atos Syntel

Dec 2015 - Oct 2019 (3 years 10 months)

Designed and automated scalable ETL pipelines using Python, Apache NiFi, and Airflow to improve data integration and reduce manual intervention. Led a cross-functional team of 5 engineers and deployed monitoring and reconciliation systems to ensure reliable, timely data deliveries.

Python Apache NiFi Apache Airflow ETL Hadoop Spark SQL Data Integration Monitoring

Software Engineer / Data Engineer

Atos Syntel Private Ltd

May 2013 - Nov 2015 (2 years 6 months)

Engineered scalable data pipelines and ETL workflows using Python, Hadoop, Spark, and Kafka, and developed automated web-scraping solutions to ingest large external datasets. Led cloud migrations to AWS/Azure and employed containerization to streamline deployments and support ML training pipelines.