Skip to main content
AG
Looking for a job

Abhishek Gawali

@abhishekgawali

Data Engineer at Community Dreams Foundations building AI-powered knowledge retrieval across 10K+ documents with ~500 ms latency.

United States
Message

At Community Dreams Foundations, I create scalable ETL workflows with PySpark, SQL, and Databricks, moving auto loan data from PostgreSQL into Delta Lake on Amazon S3 for analytics and reporting.

I also developed a Databricks Vector Search and RAG platform for semantic search across 10K+ documents, with retrieval performance of about 500 ms. My work there includes a natural language-to-SQL framework that reduced manual SQL development effort by 40%.

At CMS IT Services, I optimized MapReduce, Hive, and Apache Spark workflows, increasing processing speed by 20%. I also developed Azure real-time analytics solutions processing over 2 million records daily.

At Equifax, I optimized the Talend ETL framework for commercial data, reducing processing time by 40%, and automated more than 200 repetitive database tasks with Bash scripts. My projects have also included Kafka and Spark streaming pipelines, dimensional data models, and LLM-powered analytics using LangGraph.

Experience

Work history, roles, and key accomplishments

CF
Current

Data Engineer

Community Dreams Foundations

Mar 2025 - Present (1 year 7 months)

Create and optimize scalable ETL workflows using PySpark, SQL, and Databricks to ingest auto loan data into Delta Lake on Amazon S3. Develop real-time data ingestion pipelines using Kafka and Databricks Structured Streaming, and design a Databricks-based Medallion Architecture with robust data transformation and quality checks.

Equifax logoEQ

Associate

Jun 2018 - Apr 2019 (10 months)

Optimized the Talend ETL framework, slashing processing time for 500GB of commercial data by 40%. Automated 200+ repetitive database tasks with Bash scripts, delivering weekly time savings of 4 hours.

Education

Degrees, certifications, and relevant coursework

Rochester Institute of Technology logoRT

Rochester Institute of Technology

Master of Science, Computer Science

2022 - 2024

Master of Science in Computer Science from Rochester Institute of Technology, Rochester, NY, from 2022 to 2024.

Sardar Patel Institute of Technology logoST

Sardar Patel Institute of Technology

Bachelor of Engineering, Computer Science

2014 - 2018

Bachelor of Engineering in Computer Science from Sardar Patel Institute of Technology, Mumbai, India, from 2014 to 2018.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan