gen(options)

gen instructs the underlying model to generate text and append it to the context window.

Arguments

options.len string
The length limit (in tokens) for the generated text.

options.role string
For instruct models, this will emit the correct tokens to label your input with the correct role. This is typically user, assistant or system but can vary from model to model.

options.regex stringExperimental
A regular expression that will restrict the output of the generated text to the pattern specified.

options.hidden boolean
If true, the text will not be visible in the output in the output by default.