System Prompt Architecture: Design, Layering, and Conflict Policy

Production system prompts are architectures, not instructions; the layering determines whether the model behaves consistently across the use cases you actually serve.

What AI does well here

• Layer system prompts: identity → capabilities → constraints → output format → safety
• Use few-shot examples for behaviors hard to describe but easy to demonstrate
• Document each constraint's reason so future maintainers know what to preserve
• Version control system prompts and review changes the same way as code

What AI cannot do

• Substitute for evaluation against representative real traffic
• Make every behavior controllable through prompting alone (some require code)
• Replace ongoing testing as model versions change

A system prompt should say what happens when instructions collide: safety rules beat user requests, private data rules beat convenience, and the assistant should ask a clarifying question when two allowed instructions conflict.