Looking for a job

shubham sharma

@shubhamsharma12

Message

Leader & Architect specializing in AI/ML platforms, Data Engineering, & High Scale systems

India

Message

What I'm looking for

I seek opportunities to lead innovative projects, focusing on enhancing system performance and reliability.

I am a results-driven Engineering Leader and Architect with extensive experience in high-scale distributed systems, AI/ML platforms, and data engineering. My expertise lies in designing fault-tolerant, high-performance architectures that power mission-critical applications. I leverage deep knowledge in cloud computing, real-time data processing, and AI-driven automation to drive technical innovation and optimize performance.

Throughout my career, I have led cross-functional teams to deliver scalable, efficient, and resilient solutions. At Fanatics, I spearheaded the design of a scalable machine learning platform and developed an AI-driven reporting platform that enhanced data accessibility and insights. My previous roles at Twitter and Goldman Sachs involved architecting high-performance services and implementing real-time data pipelines, significantly improving operational efficiency and system reliability.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer

Current

Fanatics

Jan 2023 - Present (2 years 5 months)

Led the design and architecture of a scalable machine learning platform, integrating Airflow, SageMaker, and MLflow to streamline AI model lifecycle management. Re-architected data pipelines using Apache Iceberg, optimizing processing for over 1 billion events, and led the adoption of StarRocks for high-performance querying of 100+TB real-time datasets. Optimized data backfilling and Spark ingesti

ML Engineering Airflow Sagemaker Apache Iceberg StarRocks Data Pipelines Spark System Design

Software Engineer II

Twitter

Apr 2020 - Dec 2022 (2 years 8 months)

Led the technical design and development of a self-service portal for Okta application provisioning, streamlining identity management and reducing manual effort by 80%. Architected a high-performance service handling over 15,000 queries per second, automating provisioning for a high-risk global module. Migrated over 10,000 applications to a strategic authentication platform with zero downtime, enh

Okta Identity Management Authentication Authorization System Design Security Compliance

Technology Analyst

Goldman Sachs

Jun 2017 - Mar 2020 (2 years 9 months)

Designed and implemented a global inventory recommendation engine using graph data structures, which eliminated settlement failures and improved efficiency by 40%. Built a real-time Change Data Capture pipeline from PostgreSQL to Elasticsearch using Kafka Connect, enhancing search performance fivefold. Ensured high system reliability and data accuracy through extensive testing, reducing production