Kalaiyarasan Venkatesan

I’m a Principal AI & Data Platform Architect with 15+ years of experience designing and scaling cloud-native distributed systems, intelligent data platforms, and enterprise AI/LLM applications across AWS and Azure.

At Cloud Software Group, I architected Enterprise AI & LLM Platforms—leading NetScaler AI Gateway with secure OpenAI integrations via LangChain workflows, supporting 5K+ users with 99.9% secure API throughput. I also drove LLM-powered Copilot capabilities, improving support resolution accuracy by 35%, while establishing Responsible AI governance, model monitoring, and enterprise-grade deployment practices.

I’ve built high-throughput, globally distributed data foundations using Kafka-based load balancing (100K+ messages/sec with SSL and dynamic broker discovery) and delivered ML-driven bot detection that reduced false positives by 20%. I mentor across the org—directly guiding 6+ engineers and enabling 50+ engineers through architectural standards for cloud-native deployments with Docker, Kubernetes, and CI/CD automation.

Earlier at Adobe, I architected Spark/PySpark pipelines on Databricks for real-time personalization serving 25M+ users, and productionized ML workflows with Kinesis, SageMaker, Docker, Jenkins CI/CD, AWS ECS, and CloudWatch for 99.95% uptime. Across my early career spanning Hadoop ecosystems (Hive, HBase, Spark), I’ve focused on performance, reliability, and pragmatic modernization—turning complex data and ML needs into systems teams can run confidently.