Mistral prompt_cache_key for Server-Side Prefix Caching
When running repeated queries over a shared system prompt and context across Mistral's 256k context window, configure prompt_cache_key: shared-prefix to reuse Mistral's server-side prompt cache across requests.
Config: id="mistral:mistral-large-latest", prompt_cache_key="shared-prefix", temperature=0.5 System: [Static Enterprise Knowledge Base & Formatting Schema] User: [Dynamic Query]Fill in the blanks (1)
Nobody has confirmed this prompt yet. If you try it, tell others whether it worked.
No comments yet.