LangSmith

Imports traces or examples from LangSmith. Use it to evaluate real production interactions captured by LangSmith observability.

Authentication

api_key falls back to the LANGSMITH_API_KEY environment variable and api_url to LANGSMITH_ENDPOINT. Provide either a project (to import traces) or a dataset (to import examples), and narrow the import with the time, tags, filter and limit options.

Examples

Example: Import a LangSmith project. Imports up to 10 traces from a project, reading credentials from environment variables.

LangSmith Dataset Source

# ...
source:
  type: langsmith
  project: $LANGSMITH_PROJECT
  api_key: $LANGSMITH_API_KEY
  api_url: $LANGSMITH_ENDPOINT_URL
  limit: 10

Configuration

Properties

---

type Literal “langsmith” required

LangSmith trace source.

---

project string

LangSmith project name to import traces from.

Default: None

---

dataset string

LangSmith dataset name to import examples from.

Default: None

---

api_key string

LangSmith API key. Falls back to LANGSMITH_API_KEY env var.

Default: None

---

api_url string

LangSmith API URL. Falls back to LANGSMITH_ENDPOINT env var.

Default: None

---

from_time string

Start time filter for traces.

Default: None

---

to_time string

End time filter for traces.

Default: None

---

tags array[string]

Filter traces by tags.

Default: None

---

filter string

LangSmith filter string for traces.

Default: None

---

limit integer

Maximum number of traces to import.

Default: None