v3.15.0

Two major updates that help accelerate your workflow: executing evaluation plans that span multiple evaluations, and guided custom framework creation in the UI.

What’s new

  • Guided framework creation: Start a new framework by selecting an existing framework as a base, whether from the LatticeFlow AI Atlas or an imported xlsx or csv file.

    first step to creating a framework in the AI Platform UI

  • Evaluation plans: Group evaluation configurations into reusable evaluation plans, run all or selected evaluations, and rerun snapshots from the CLI.

Improvements

  • Model provider listings now retry transient timeouts and distinguish unreachable providers from providers that are not configured or have invalid credentials.

Breaking changes

  • Evaluation plan and evaluation plan run entities and CLI commands were redesigned with limited backward compatibility. Update integrations that use the previous evaluation-plan API or CLI commands.