llmd deploy_llm_inference_service

Deploys an LLM InferenceService from a YAML file

Parameters

name

  • Name of the inference service to deploy

namespace

  • Namespace to deploy the inference service in

yaml_file

  • Path to the YAML file containing the LLMInferenceService