Many-Shot Jailbreaking Research

Claude, GPT-4, GPT-3.5, Llama 2, Mistral

Hundreds of harmful Q&A examples in a single long prompt bypass safety guardrails of all major LLMs

Expanded context windows enable in-context learning to override safety training