1 Commits
Author SHA1 Message Date
Isaac Seymour 991326480f Completion API: add new params (#870)
* Completion API: add 'store' param

This param allows you to opt a completion request in to being stored,
for use in distillations and evals.

* Add cached and audio tokens to usage structs

These have been added to the completions API recently:
https://platform.openai.com/docs/api-reference/chat/object#chat/object-usage
2024-10-09 10:50:27 +01:00