Looking for a job

Preethi Evelyn Sadanandan

@preethievelynsadanan

Message

Senior Data Engineer at Tredence Inc, who improved Databricks query performance from 3+ minutes to milliseconds.

India

Message

What I'm looking for

I'm seeking to apply my data engineering experience and skills in end-to-end pipeline design, data modeling, and data quality, along with my educational background in Statistics, Mathematics, and Economics.

At Tredence Inc, I led Databricks development and production releases for a Unity Catalog migration. I built a near real-time Kafka and Spark Structured Streaming pipeline, improving Databricks query performance from 3+ minutes to milliseconds.

I also developed 20+ dbt models and 40+ data quality tests for migrations to Azure Databricks and GCP BigQuery. To support data quality monitoring, I designed a Python and Airflow framework that consolidated dbt test results into an Informatica dashboard.

Previously, at Ai Palette, I built batch ELT pipelines to ingest data from 100+ sources and developed a Python data profiler. At Xiaomi Technology, I built a near real-time PySpark sales pipeline and automated online sales tracking and other processes with Python.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Tredence Inc

Dec 2023 - Present (2 years 11 months)

Led Databricks development and production releases for Unity Catalog migration, built near real-time pipelines with Kafka and Spark Structured Streaming, and developed dbt models and data quality tests. Mentored junior engineers and conducted code reviews.

Databricks Unity Catalog Kafka Spark Structured Streaming DBT dbt Expectations Python Airflow BigQuery Azure Databricks Informatica Data Governance Code Review Mentorship

Data Engineer

Ai Palette

Mar 2023 - Nov 2023 (8 months)

Implemented strategies to scale the data platform, built lakehouse medallion architecture and ELT pipelines, developed a Python data profiler, and designed unified data models. Engineered an image generation pipeline using Stable Diffusion on Vertex AI.

Python ELT Lakehouse Medallion Architecture Data Modeling Star Schemas Data Vault Data Profiling Vertex AI Stable Diffusion Prompt Engineering Data contracts

Data Engineer

Xiaomi Technology

Aug 2021 - Mar 2023 (1 year 7 months)

Built near real-time PySpark ETL pipelines for sales data, automated web-scraping applications, and set up self-service analytics processes. Provided insights to senior management for critical business decisions.