Skip to main content
This guide shows you how to enable deployment management on your self-hosted LangSmith instance. This adds a control plane and data plane that let you deploy, scale, and manage agents and applications directly through the LangSmith UI.
Important
Self-hosting LangSmith with deployment requires an Enterprise plan.
This setup page is for adding deployment capabilities to an existing LangSmith instance.Review the self-hosted options to understand:

Overview

This guide builds on top of the Kubernetes installation guide. You must complete that guide first before continuing. This page covers the additional setup steps required to enable deployment functionality:
  • Installing the LangGraph operator
  • Configuring your ingress
  • Connecting to the control plane

Prerequisites

  1. You are using Kubernetes.
  2. You have an instance of self-hosted LangSmith running.
  3. KEDA is installed on your cluster.
  helm repo add kedacore https://kedacore.github.io/charts
  helm install keda kedacore/keda --namespace keda --create-namespace
  1. Ingress Configuration
    1. You must set up an ingress, gateway, or use Istio for your LangSmith instance. All agents will be deployed as Kubernetes services behind this ingress. Use this guide to set up an ingress for your instance.
  2. You must have slack space in your cluster for multiple deployments. Cluster-Autoscaler is recommended to automatically provision new nodes.
  3. A valid Dynamic PV provisioner or PVs available on your cluster. You can verify this by running:
  kubectl get storageclass
  1. Egress to https://beacon.langchain.com from your network. This is required for license verification and usage reporting if not running in air-gapped mode. See the Egress documentation for more details.

Setup

  1. As part of configuring your self-hosted LangSmith instance, you enable the deployment option. This will provision a few key resources.
    1. listener: This is a service that listens to the control plane for changes to your deployments and creates/updates downstream CRDs.
    2. LangGraphPlatform CRD: A CRD for LangSmith Deployment. This contains the spec for managing an instance of a LangSmith deployment.
    3. operator: This operator handles changes to your LangSmith CRDs.
    4. host-backend: This is the control plane.
As of v0.12.0, the langgraphPlatform option is deprecated. Use config.deployment for any version after v0.12.0.
  1. Two additional images will be used by the chart. Use the images that are specified in the latest release.
  hostBackendImage:
    repository: "docker.io/langchain/hosted-langserve-backend"
    pullPolicy: IfNotPresent
  operatorImage:
    repository: "docker.io/langchain/langgraph-operator"
    pullPolicy: IfNotPresent
  1. In your config file for langsmith (usually langsmith_config.yaml), enable the deployment option. Note that you must also have a valid ingress setup:
  config:
    deployment:
      enabled: true
    # As of v0.12.0, this section is deprecated. Use config.deployment for any version after v0.12.0.
    langgraphPlatform:
      enabled: true
      langgraphPlatformLicenseKey: "YOUR_LANGGRAPH_PLATFORM_LICENSE_KEY"
  1. In your values.yaml file, configure the hostBackendImage and operatorImage options (if you need to mirror images)
  2. You can also configure base templates for your agents by overriding the base templates here.

Next steps

Once your infrastructure is set up, you’re ready to deploy applications. See the deployment guides in the Deployment tab for instructions on building and deploying your applications.
Connect these docs programmatically to Claude, VSCode, and more via MCP for real-time answers.