Link list: Deploy ML Models with KServe and Kubernetes

The list of tools I mention in my talk "KServe and Kubernetes: Model Serving at Scale":

Serving tools

• KServe

Kubernetes

• Kubernetes
• Kubernetes GPU configuration
• Kubernetes CRD
• Docker
• Istio
• KNative

Programming Languages (and YAML)

• Python
• Kotlin
• Yaml

Frameworks

• PyTorch
• Tensorflow
• Ktor
• FastAPI
• XGBoost

Serving tools

• KServe