Looking for a job

Pavani Gupta

@pavanigupta

Message

Databricks Solution Architect and Forward Deployed Engineer specializing in Lakehouse and GenAI.

India

Message

What I'm looking for

I seek roles building and scaling Lakehouse and GenAI platforms where I can lead solution architecture, presales, and delivery to drive measurable business impact and enable governed self-service analytics.

I am a Databricks-certified Solution Architect and Forward Deployed Engineer with 15+ years of experience in data engineering, cloud modernization, and generative AI-driven analytics. I design and deliver Lakehouse architectures, Unity Catalog governance, DLT pipelines, and AI-enabled reporting and conversational interfaces for large enterprises.

I have led presales and solutioning for multimillion-dollar data modernization programs, built GenAI integrations with LLMs, vector search and RAG pipelines, and implemented end-to-end observability and MLOps for production ML systems. My delivery experience spans Azure and AWS, with hands-on expertise in Python, PySpark, Terraform, CI/CD and Databricks platform services.

I combine technical leadership with product-focused presales to drive business impact—reducing reporting cycles, enabling self-service analytics, and establishing governed single sources of truth—while mentoring teams and operationalizing AI solutions at scale.

Experience

Work history, roles, and key accomplishments

Current

Solution Architect

Current

Koantek

Oct 2023 - Present (2 years 1 month)

Architected Unity Catalog upgrades, led Snowflake-to-Databricks migrations and DLT-based lakehouse implementations, and delivered DevOps rollouts including Databricks Asset Bundles.

Unity Catalog Databricks Snowflake Databricks Asset Bundles Terraform DevOps

Cloud Infrastructure Engineer

UBS India

Jun 2019 - Sep 2023 (4 years 3 months)

Built Azure Databricks pipelines with GitLab CI/CD, led AIOps and self-healing infrastructure initiatives, and implemented internal data science learning platforms to improve operational resilience.

Databricks Gitlab CI AI Ops Automation Python Terraform Observability SQL

Data Engineer

Red Hat India

Jun 2017 - Jun 2019 (2 years)

Delivered ETL pipelines for marketing operations, automated data profiling and API integrations, and implemented anomaly detection to improve data quality and reporting timeliness.

Python Shell Scripting ETL Qlik API Integration Data Profiler Anomaly Detection SQL

Technical Lead - BI & Analytics

TechLink Infoware

Mar 2016 - Mar 2017 (1 year)

Built an enterprise data warehouse using Teradata and Hadoop and delivered ELT pipelines with Control-M and AWS storage to support large-scale analytics workloads.

Teradata Hadoop ELT AWS Data Warehousing SQL Data Integration

Data Scientist

Karvy Analytics

Apr 2015 - Mar 2016 (11 months)

Developed a model management platform and delivered predictive models and visualizations for financial services clients to support decisioning and reporting.

R Hive Tableau Data Visualization SQL

ETL Data Specialist

IBM India

Jan 2014 - Mar 2015 (1 year 2 months)

Executed data migration and ETL workload optimization for global finance systems, improving throughput and data quality for JP Morgan Chase's finance division.

ETL Data Migration SQL Data Quality Performance Tuning Hive Teradata

Project Engineer

Wipro Technologies

Apr 2010 - Dec 2013 (3 years 8 months)

Conducted performance testing and AML analysis for Citi Bank projects, built scalable testing utilities and automated data quality validations to enhance system reliability.

Talend SQL Performance Testing AML Data Quality Automation