OpenAI max_output_tokens as a Cost Circuit Breaker
max_output_tokens sets a hard cap on response length to protect against runaway generations and bound costs—it does not hint at desired length to the model. If you want a short answer, ask for one explicitly in the prompt.
API Config: max_output_tokens=800 (cost circuit breaker) Prompt: Summarize the key blocker in the attached project update in no more than 2 sentences (under 40 words).Nobody has confirmed this prompt yet. If you try it, tell others whether it worked.
No comments yet.