Rohit Mishra

Cloud Solutions Architect, Google Cloud

October 28-30, 2026Oakland University, Rochester, MI

About Rohit

I work as a Cloud Solutions Architect and Engineer for Google Cloud. Over the years I have helped some of the top brands in retail, logistics, food and restaurant industry to transform their digital presence through cloud adoption. I have driven and led successful migrations, transformation and modernization projects of strategic significance. A builder at heart, I have been deeply enaged with developers and architects on either side of the fence (Google & it's customers) to explore the art of possible with cloud native systems powered by open source and community powered software. Lately I have expanded my fields into AI platforms and infrastructure and have been helping Google customers with AI adoption, running large scale AI workloads, AI security and threat prevention, inferencing at scale.

Links

linkedin company website

Conference Sessions

Conference SessionIntermediate60 min

A Practical Guide to Running LLMs on Kubernetes

Serving an LLM on Kubernetes has sharp edges. Includes a live demo deploying an open-weight LLM on Kubernetes and serving inference traffic with real-time GPU metrics. That is the entry point for "A Practical Guide to Running LLMs on Kubernetes", where Rohit Mishra shows how to handle GPU scheduling, model weights, health checks, autoscaling, and live inference in practice.

Topic: Artificial Intelligence and Machine Learning
Time: Oct 29, 2026, 11:15 AM
Room: Room A

Conference SessionIntermediate60 min

Building an AI Inference Gateway on Kubernetes: Model Routing, Rate Limiting & Cost Control

Running many AI models without a gateway creates duplicated auth, weak rate limits, and hidden costs. We cover model routing with A/B traffic splitting, token-based rate limiting per team, fallback chains, and per-team cost attribution. "Building an AI Inference Gateway on Kubernetes: Model Routing, Rate Limiting & Cost Control" turns that scenario into a session where Rohit Mishra walks through gateway patterns for routing and control.

Topic: Artificial Intelligence and Machine Learning
Time: Oct 29, 2026, 2:30 PM
Room: Room A