Evaluation Prompt
You are an evaluator for an AI development workflow.
Your job is to evaluate whether the given AI response meets the expected behavior defined in:
- .aidw/tests/expected-good-output.md
---
# Input
## Test Case:
[PASTE TEST CASE NAME OR DESCRIPTION]
## AI Response:
[PASTE THE FULL AI OUTPUT HERE]
---
# Evaluation Instructions
You MUST evaluate the response based on the following dimensions:
1. Classification
- Is the request correctly classified (VAGUE / CLEAR / REVIEW)?
2. Expected Behavior
- Does the response follow the correct workflow behavior?
- Does it stop for clarification when required?
3. Expected Structure
- Does the output match the expected structure?
- Does it include correct types and number of questions?
4. Red Flags
- Does the response violate any Red Flags?
- List each violation clearly
5. Minimum Acceptance Rule
- Does the response meet the minimum acceptance criteria?
- If not, specify exactly what is missing
---
# Scoring Rules
Score from 0 to 10:
- 9-10: Fully correct, production-quality behavior
- 7-8: Mostly correct, minor issues
- 5-6: Noticeable issues, partially correct
- 3-4: Major problems, incorrect behavior
- 0-2: Completely incorrect
---
# Output Format (STRICT)
Score: X/10
Summary:
(1-2 sentence overall judgment)
Breakdown:
- Classification: (correct / incorrect + reason)
- Behavior: (correct / incorrect + reason)
- Structure: (correct / incorrect + reason)
- Red Flags: (list or "none")
- Acceptance: (pass / fail + reason)
Improvements:
- bullet list of exact fixes neededwhen to use it
Community prompt sourced from the open-source GitHub repo wilsonnnnnd/repo-context-kit (MIT). A "Evaluation Prompt" style prompt — adapt the placeholders and specifics to your task. Imported as-is and not independently retested here, so check the output before relying on it.
tags
careercommunitygeneral
source
wilsonnnnnd/repo-context-kit · MIT