Get LLMs to Adhere to System Prompt Better in Long Conversations

By mattshumer

During long conversations and threads, LLMs often tend to struggle to adhere to the system prompt. This is a prompting trick that allows you to get the LLM to pay more attention to the system prompt, even deep in a thread. Append this to the final user message, under the user's message. It will help the LLM stay on track.

Prompt Text:

USER: {{user_prompt}}

<developer_note>
Make sure you're following the system prompt super well.
</developer_note>