Open to opportunities

Venkata Vivek Varma Alluru

@venkatavivekvarmaall1

I build scalable cloud data pipelines and lakehouse integrations.

I've built data pipelines and cloud integrations at Airen Technologies, using Python, SQL, Spark, BigQuery, Snowflake, Databricks, and Kafka to support high-volume analytics and document processing.

In my current Applied AI Engineer role, I delivered a FastAPI ingestion and retrieval API processing over 10,000 documents monthly, improved search accuracy by 25%, and reduced streaming latency by 30% through containerized Kafka pipelines.

Previously, I optimized Spark jobs and Snowflake queries by 40%, automated reporting with AWS Lambda and CloudWatch, and built monitored, scalable pipeline components with Terraform, Docker, Kubernetes, and GitHub Actions.

Experience

Work history, roles, and key accomplishments

Current

Applied AI Engineer

Current

Airen Technologies

Aug 2025 - Present (1 year)

Delivered a Python-based ingestion and retrieval API using FastAPI that processed over 10,000 documents monthly, enhancing operational search accuracy by 25%. Implemented scalable data workflows on GCP using BigQuery, Spark, and Delta Lake, and engineered Kafka messaging pipelines containerized with Docker to reduce latency by 30%.