Looking for a job

jayant sonawane

@jayantsonawane

Data engineering leader at TPConnects who built an AWS lakehouse, cutting infrastructure costs by 80% and P1 incidents by 95%.

United Arab Emirates

Message

At TPConnects, I architected an AI-powered transactional data lakehouse on AWS from scratch, cutting infrastructure costs by 80% and P1 incidents by 95%. I also developed a real-time airline Look-to-Book analytics engine that helped lower operational costs by about 30%.

At Tarabut, I delivered a multi-cloud data platform across four regulated jurisdictions and led MLOps pipelines for a bank transaction enrichment service with over 99% pipeline reliability. Earlier, I built data platforms and pipelines at Rain Financial, CAFU, PropertyFinder, Qualcomm, and Cognizant Technology Solutions.

Experience

Work history, roles, and key accomplishments

Current

Senior Manager, Data Engg & Analytics

Current

TPConnects

Jun 2024 - Present (2 years 4 months)

Defined and executed enterprise data strategy and multi-geo data architecture. Architected an AI-powered transactional Data Lakehouse on AWS, cutting infrastructure costs by 80% and P1 incidents by 95%.

Python SQL Spark Apache Iceberg Airflow AI LLM Terraform Terragrunt AWS Athena S3 Glue Kinesis Bedrock RAG LangGraph Cursor Docker CI CD Superset Power BI Tableau

Data Engineering Manager

Tarabut

May 2022 - May 2024 (2 years)

Delivered a multi-cloud enterprise data platform supporting analytics and data products across 4 regulated jurisdictions. Designed and implemented reusable ETL orchestration framework, improving delivery speed and consistency by over 50%.

Python SQL Kafka MLOps NLP Airflow Apache Iceberg AWS Athena S3 EC2 RDS Glue Lambda Terraform Docker Power BI Superset

Lead Data Engineer

Rain Financial

Jun 2021 - May 2022 (11 months)

Built an AWS Lakehouse from scratch for RAIN, ingesting tick-level and transactional data to power analytics and data science use cases. Designed and built a low-latency crypto pricing ingestion service for real-time analytics.

Python SQL Airflow Apache Arrow Pandas TimeScaleDB AWS Athena Redshift S3 EMR RDS CDK AWS ECS Docker CI CD

Senior Data Engineer

CAFU

Oct 2019 - May 2021 (1 year 7 months)

Architected a data platform on AWS using modern data stack for last-mile logistics, building batch and streaming pipelines processing 100M+ events per month. Delivered ML pipelines with Airflow and SageMaker for churn and ETA prediction.

Python SQL Pandas Parquet AWS Athena Redshift S3 CDK AWS ECS EMR Sagemaker PySpark Airflow Kafka Docker Power BI

Senior Data Engineer

PropertyFinder

Feb 2019 - Oct 2019 (8 months)

Key member for development of data lake architecture on AWS for storing TBs of data. Migrated AWS S3 and Presto based data lake to Snowflake, reducing compute costs by 30%.

Python SQL Airflow AWS Fivetran Snowflake Terraform Docker AWS ECS

Software Engineer

Qualcomm

Jan 2017 - Feb 2019 (2 years 1 month)

Developed scalable data pipelines and ETL workflows using Apache NiFi, Python, PostgreSQL, and AWS. Designed and built high-performance APIs with Python, Pandas, PostgreSQL, and FastAPI.

Apache NiFi Python PostgreSQL AWS S3 EC2 Pandas fastAPI Hadoop Spark Hive MapReduce .NET

Engineer-Summer Intern

Qualcomm

Jun 2016 - Aug 2016 (2 months)

Performed large-scale data analysis using Netezza SQL. Built ETLs using Python and Pandas, and automated JIRA workflows using Python and Flask.

Netezza SQL Python Pandas Flask Jira

Programmer Analyst

Cognizant Technology Solutions

Jan 2014 - Jul 2015 (1 year 6 months)

Partnered with Credit Suisse investment bank to enhance trading platform performance and reliability. Optimized trade capture system in C++, migrated legacy codebase, and automated test suites using Python (Pytest).

C++Python Pytest Trading Systems Production Support