lf run

Create one or more evaluations from a run config file along with their dependencies and run them as an evaluation run or Assessment.

Usage
lf run [OPTIONS] [COMMAND] [ARGS]...
Options
Name Type Description Default
--file, -f path Path to a single run config.
-v, --validate boolean Whether to only validate the config file without creating or updating any entities. False
--wait, -w boolean Block until the evaluation run finishes, printing progress every 10 seconds. False
--no-update boolean Whether to force skip updating the existing entities. False
Subcommands
eval Run an existing evaluation by key with a given config file.
assessment-plan Run an assessment plan.

lf run eval

Run an existing evaluation by key with a given config file.

Usage
lf run eval [OPTIONS]
Options
Name Type Description Default
--key, -k text Key of the evaluation to run.
--config, -c path Path to a YAML config file.
--wait, -w boolean Block until the evaluation run finishes, printing progress every 10 seconds. False

lf run assessment-plan

Run an assessment plan.

Usage
lf run assessment-plan [OPTIONS]
Options
Name Type Description Default
--key, -k text Key of the assessment plan to be run.
--spec-keys, -sk text List of evaluation specification keys to include in the run. They must be part of the assessment plan. If not provided, all evaluation specifications in the assessment plan will be run.
--file, -f path Path to a single assessment plan config.
--no-update boolean Whether to force skip updating the existing entities. False