Important
Self-hosting LangSmith with deployment requires an Enterprise plan.
Self-hosting LangSmith with deployment requires an Enterprise plan.
This setup page is for adding deployment capabilities to an existing LangSmith instance.Review the self-hosted options to understand:
- LangSmith (observability): What you should install first.
- LangSmith with deployment: What this guide enables.
- Standalone Server: Lightweight alternative without the UI.
Overview
This guide builds on top of the Kubernetes installation guide. You must complete that guide first before continuing. This page covers the additional setup steps required to enable deployment functionality:- Installing the LangGraph operator
- Configuring your ingress
- Connecting to the control plane
Prerequisites
- You are using Kubernetes.
- You have an instance of self-hosted LangSmith running.
KEDAis installed on your cluster.
- Ingress Configuration
- You must set up an ingress, gateway, or use Istio for your LangSmith instance. All agents will be deployed as Kubernetes services behind this ingress. Use this guide to set up an ingress for your instance.
- You must have slack space in your cluster for multiple deployments.
Cluster-Autoscaleris recommended to automatically provision new nodes. - A valid Dynamic PV provisioner or PVs available on your cluster. You can verify this by running:
- Egress to
https://beacon.langchain.comfrom your network. This is required for license verification and usage reporting if not running in air-gapped mode. See the Egress documentation for more details.
Setup
- As part of configuring your self-hosted LangSmith instance, you enable the
deploymentoption. This will provision a few key resources.listener: This is a service that listens to the control plane for changes to your deployments and creates/updates downstream CRDs.LangGraphPlatform CRD: A CRD for LangSmith Deployment. This contains the spec for managing an instance of a LangSmith deployment.operator: This operator handles changes to your LangSmith CRDs.host-backend: This is the control plane.
As of v0.12.0, the
langgraphPlatform option is deprecated. Use config.deployment for any version after v0.12.0.- Two additional images will be used by the chart. Use the images that are specified in the latest release.
- In your config file for langsmith (usually
langsmith_config.yaml), enable thedeploymentoption. Note that you must also have a valid ingress setup:
- In your
values.yamlfile, configure thehostBackendImageandoperatorImageoptions (if you need to mirror images) - You can also configure base templates for your agents by overriding the base templates here.
Next steps
Once your infrastructure is set up, you’re ready to deploy applications. See the deployment guides in the Deployment tab for instructions on building and deploying your applications.Connect these docs programmatically to Claude, VSCode, and more via MCP for real-time answers.