Public preview: Kubernetes AI Toolchain Operator (KAITO) add-on for AKS

You can now choose from preset LLMs with images hosted by AKS and split inferencing across multiple lower-GPU count VMs

Read more at Microsoft