v3.11.1

Custom inference snippets can now receive the dataset sample in run_inference, giving your inference code access to the full sample and enabling evaluation reuse across models.

What’s new

  • Custom inference snippets can now receive the dataset sample: run_inference accepts an optional sample argument alongside body and environment, giving your inference code access to the full sample and making it easier to reuse an evaluation across different models. Example Model available here.

Improvements