Skip to main content

​
BaseFormatter

A Formatter takes an LLM Callable and wraps the method into an abstract callable. Used to perform manipulations of the input or the output, like JSON constrained- decoding.

​
JsonFormatter

A formatter that uses Jsonformer to ensure the shape of structured data for Hugging Face models.