跳到正文
X·科技公司· NVIDIA AI (@NVIDIAAI)·· 11 小时前AI 评分7

Already running a model endpoint? What does it take to scale it on Kubernetes?

Already running a model endpoint? What does it take to scale it on Kubernetes?

AI 导读

Already running a model endpoint? What does it take to scale it on Kubernetes? In five minutes, we walk through how NVIDIA Dynamo handles deployment with scalable workers and an OpenAI-compatible endpoint. Watch below: https://t.co/S8uc5ljUIW

来源:X·科技公司 · x.com