Skip to main content
Jyoti VarshneyJV
Open to opportunities

Jyoti Varshney

@jyotivarshney

I build production ETL pipelines, data extraction systems, and backend APIs with Python and AWS.

India
Message

At Forage AI, I build and maintain production ETL pipelines for a global asset management firm, resolving recurring failures and reducing incident response time by an estimated 30%.

I've developed FastAPI data-ingestion services with dynamic schema handling, deployed containerized workloads on AWS Lambda, and introduced async extraction processing for large-scale jobs. I also led Scrapy-based financial data extraction and Pandas automation work for client-specific deliverables.

Earlier at ElectrifAi, I built Python scraping and automation solutions for tire distribution and pharmaceutical clients, including JavaScript-heavy extraction using XPath and regular expressions. I also contributed to ETL development, client communication, and an NLP-powered search optimization tool using n-grams, Metaphone, and TF-IDF.

I'm comfortable owning data pipelines from automated extraction through cloud deployment and monitoring, while mentoring teammates and improving framework-level quality. I also build agentic AI workflows with LangChain, LangGraph, prompt engineering, and LCEL.

Experience

Work history, roles, and key accomplishments

FA
Current

Data Engineer

Forage AI

Jul 2025 - Present (1 year 1 month)

Designed and maintained ETL pipelines for a global asset management firm, improving uptime and cutting incident response time by an estimated 30%. Built FastAPI-based data ingestion services with dynamic schema handling, containerized with Docker and deployed on AWS Lambda.

FA

Data Automation Engineer

Forage AI

May 2021 - Jun 2025 (4 years 1 month)

Led development of Scrapy-based financial data extractors and Pandas automation scripts as technical lead for a 3-4 person team. Contributed to Flask-based APIs for a healthcare client to streamline QA workflows and mentored junior team members.

EL

Software Engineer

ElectrifAi

Mar 2020 - Apr 2021 (1 year 1 month)

Developed Python-based scraping and automation solutions for tire distributor and pharmaceutical clients, managing JavaScript-heavy pages with XPath and regex extraction. Contributed to ETL pipeline development and handled direct client communication.

EL

Project Analyst

ElectrifAi

Apr 2019 - Feb 2020 (10 months)

Contributed to an NLP-powered search optimization tool using n-gram modeling, Metaphone phonetic matching, and TF-IDF ranking, improving search result relevance for enterprise clients.

Education

Degrees, certifications, and relevant coursework

Aligarh Muslim University logoAU

Aligarh Muslim University

Master of Computer Applications, Computer Applications

2015 - 2018

Grade: CGPA: 8.25

Pursued Master of Computer Applications with a CGPA of 8.25.

Aligarh Muslim University logoAU

Aligarh Muslim University

Bachelor of Science (Hons.), Mathematics

2012 - 2015

Grade: 65.93%

Completed Bachelor of Science (Hons.) in Mathematics with 65.93%.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan