Communicating better for a Super Intelligent World

c/ProductManagement · ChatGPT / OpenAI · u/prompts360 Expert · 5d ago · edited

OpenAI max_output_tokens as a Cost Circuit Breaker

max_output_tokens sets a hard cap on response length to protect against runaway generations and bound costs—it does not hint at desired length to the model. If you want a short answer, ask for one explicitly in the prompt.

API Config: max_output_tokens=800 (cost circuit breaker) Prompt: Summarize the key blocker in the attached project update in no more than 2 sentences (under 40 words).

Nobody has confirmed this prompt yet. If you try it, tell others whether it worked.

Log in to say it worked for you.

0 comments save
embed

Log in or sign up to comment.

No comments yet.