Llama 3.3 Multi-Turn Roles With eot_id
In multi-turn Llama 3/3.3 conversations, enclosing each speaker role in <|start_header_id|>...<|end_header_id|> and terminating every turn with <|eot_id|> allows the model to track roles and context across multiple exchanges without confusion.
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
You are a customer support specialist.<|eot_id|><|start_header_id|>user<|end_header_id|>
My shipment #402 is delayed.<|eot_id|><|start_header_id|>assistant<|end_header_id|>
I can check shipment #402 for you. What is your billing postal code?<|eot_id|><|start_header_id|>user<|end_header_id|>
It is 10001.<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Nobody has confirmed this prompt yet. If you try it, tell others whether it worked.
No comments yet.