Open to opportunities

Vivek Ramaswamy

@vivekramaswamy

Message

Innovative Data Engineer building large-scale, low-latency data systems.

Canada

Message

What I'm looking for

I seek senior data engineering roles building cloud-native, streaming-first platforms with strong data governance, CI/CD, and ML integrations in collaborative teams.

I am an innovative Data Engineer with 17+ years delivering large-scale, low-latency, and highly reliable data systems across fintech, telecom, and retail. I design streaming data pipelines, cloud-native architectures, and metadata-driven frameworks that improve governance, reduce integration time, and enable real-time ML-driven insights.

I have led platform and engineering initiatives at startups and global financial institutions, implemented data observability, CI/CD, and Databricks/Cloud integrations, and worked extensively with Spark, Kafka, Snowflake, and Neo4J. I am passionate about solving complex data challenges at scale, improving developer productivity, and enabling data-driven decision-making.

Experience

Work history, roles, and key accomplishments

Current

Staff Data Engineer

Current

Stealth Startup

Dec 2024 - Present (1 year 2 months)

Designed scalable Databricks pipelines with Unity Catalog and PySpark, reduced partner integration time from four months to two weeks and cut deployments by 40% via CI/CD automation.

Databricks Pyspark Unity Catalog GitHub Actions Neo4j Data Governance CI CD

Vice President, App Development Lead

Citibank

Jul 2021 - Dec 2024 (3 years 5 months)

Designed and built Spark/Scala data pipelines ingesting file and streaming sources into HBase, HDFS, GemFire and Snowflake, and implemented data observability patterns across pipelines.

Spark Scala HBase HDFS Snowflake Observability Gemfire Streaming Data Modeling

Lead Software Engineer

OANDA

Sep 2020 - Jul 2021 (10 months)

Built Google Dataflow streaming jobs from Kafka to BigQuery, automated data validation with Airflow, and developed secure reporting services on Google App Engine.

Dataflow Kafka BigQuery Apache Airflow Spring Boot Google App Engine MuleSoft Protobuf

Associate Director, Big Data Engineer

Aon Centre for Innovation and Analytics

Sep 2019 - Sep 2020 (1 year)

Designed StreamSets ingestion pipelines and built an AWS-backed data lake to facilitate analytics across business lines and supported legacy-to-modern transitions using Hive/Impala.

Streamset AWS Data Lake Hive Impala Data Ingestion Analytics Enablement System Integration

Senior Big Data Engineer

Crédit Agricole CIB

Apr 2018 - Jul 2019 (1 year 3 months)

Implemented a data lake for FRTB compliance using Spark batch and streaming to ingest from Kafka and persist ORC outputs, and established observability via Kafka/Appender and ELK stack.

Spark Kafka ORC Hive ELK Data Lake Observability Junit

Senior Associate

J.P. Morgan Chase & Co

Jun 2013 - Apr 2018 (4 years 10 months)

Built a near-real-time data lake replacing legacy ETL using Scala, Akka Streams and Spark Streaming to stream transformed data to Kafka and parquet storage, and integrated IBM CDC for change capture.

Scala Akka Kafka Parquet Hive Jenkins

IT Analyst

Tata Consultancy Services

May 2010 - Feb 2013 (2 years 9 months)

Led Dynamics CRM 2011 migrations and upgrades, coordinated onsite client engagements and production releases, and implemented IBM MQ integrations for legacy VB6 systems.

VB6 Release Management Functional To Technical Mapping