home/roleplay/prompt-design-6

Prompt Design

GPTClaudeGemini··560 copies·updated 2026-07-14
prompt-design-6.prompt
# Stage 2 — Prompt Design

Role (per PRD): create prompt variants, define controls, create adversarial
prompts, ensure reproducibility. Output: `prompts/<domain>/vN.yaml`.

## Procedure

1. Check whether `prompts/<domain>/vN.yaml` (the latest version) already
   covers this week's hypothesis. If it does, **reuse it as-is** — do not
   create a new version just to re-run the same test. Reuse is what makes
   later "did this change over time" claims meaningful.
2. Only create a new `vN+1.yaml` if the hypothesis genuinely needs prompts
   the existing set doesn't have. When you do:
   - Never edit an existing versioned file in place (see AGENTS.md).
   - Keep the same YAML shape as the existing files in that domain
     (`domain`, `version`, `description`, `prompts: [{id, variant, turns,
     expect, notes}, ...]`).
   - Every adversarial prompt needs a paired control where practical, so a
     model's baseline competence is visible alongside the failure mode.
   - Every prompt needs an `expect` block the domain's scorer
     (`scripts/scoring/<domain>.py`) can actually evaluate objectively — if
     you can't state the correct-behavior check as a simple rule, the prompt
     doesn't belong in this domain's rule-based set.
3. Record in the methodology doc (Stage 1's file) whether this week used the
   existing prompt version or introduced a new one, and why.

## Hard rule

If you can't write an objective `expect` check for a prompt without asking
an LLM to judge subjectively, don't add it — that violates the PRD's "avoid
subjective scoring whenever possible" principle. Flag it in the methodology
doc as a future-experiment candidate instead.

fill the variables

This prompt has 1 variable. Pro fills them into a ready-to-paste prompt for you — no manual find-and-replace.

{id, variant, turns, expect, notes}
Unlock with Pro →

when to use it

Community prompt sourced from the open-source GitHub repo ai-behavior-observatory/ai-behavior-observatory (MIT). A "Prompt Design" style prompt — adapt the placeholders and specifics to your task. Imported as-is and not independently retested here, so check the output before relying on it.

tags

roleplaycommunitygeneral

source

ai-behavior-observatory/ai-behavior-observatory · MIT