home/roleplay/eval-history-monthly

Eval History Monthly

GPTClaudeGemini··1,307 copies·updated 2026-07-14
eval-history-monthly.prompt
# User-invoked prompt · eval-history-monthly summary (v1.8.2 · Obsidian-style)

> v1.8.0 pivot: this used to fire from launchd cron monthly 1st at 07:00.
> Cron is gone. v1.8.1 also dropped the `tools/stats.py` middleware —
> ROUTER now reads this prompt and does the aggregation 100% via LLM
> tools (Read/Glob/Grep/Write).
>
> **v1.8.2 HARD RULE #11**: Output renders in Obsidian. Apply
> `references/obsidian-style.md` — `> [!info]` callout for "At a glance",
> `> [!warning]` for anomalies, `[[wikilinks]]` for entry/session refs,
> nested tags (e.g. `eval-history/monthly`).

## Trigger keywords

- `统计这个月` / `monthly summary` / `月度统计`
- `eval history` / `系统表现总结`
- retrospective Mode 0 Conscious Patrol reports `eval-history-monthly Nd` overdue and user says "跑一下"

## Context

`meta/eval-history/` accumulates per-session evaluation data: AUDITOR
scores, REVIEWER decisions, archiver completions, etc. This prompt
aggregates them into a one-file monthly view, doing all the counting
inline via Glob + Read + simple text scan.

## Required actions (100% LLM, no python)

1. Determine the target month: `YYYY-MM` of the previous calendar month
   (or current month if user explicitly says "这个月").
2. `Glob` `meta/eval-history/**/*.md` and `meta/journal/**/*.md`
   filtering to the target month by mtime (use `Bash` with `find ...
   -newermt "$YYYY-MM-01" ! -newermt "$YYYY-MM+1-01"` to get the
   filtered file list — this is the ONLY shell call needed).
3. For each file, `Read` the frontmatter and key sections; tally:
   - `outcome_score` values (sum + count for average)
   - `archiver_phase_4_completed: true|false` (completion rate)
   - `auditor_violations:` count by class (A/B/C/D/E)
   - REVIEWER veto count (search "veto" / "封驳" in journal)
   - decision count by domain (frontmatter `domain:`)
4. Also `Glob` `compliance/violations.md` (single file) and `Read`
   it; tally violation rows that fall within the target month.
5. Aggregate into the report below; write directly to output path.

## Aggregations to compute

### Sessions
- Total sessions / Average length / Adjourn completion rate / Average outcome_score

### Decisions
- Total decisions / By domain / Express vs full deliberation / Regret rate

### Knowledge growth
- Wiki entries new/deleted / SOUL dimensions changed / Methods created / Concepts new / Hebbian edge updates

### System health
- Cron jobs total runs / successes / failures
- Archiver Phase completion rate
- Cortex audit trail completion rate
- Hook fire counts / Approval guard intercepts
- Compliance index trend

### Costs (if telemetry available)
- Total tokens / By subagent / By cron job

## Output

Write `meta/eval-history/monthly-summary-{YYYY-MM}.md` with sections: At a glance / Sessions / Decisions / Knowledge growth / System health / Costs / Notable events / Audit trail.

## Notification

Notify only if anomaly detected (X% drop in compliance, archiver fail rate > 20%, etc.):

- Append to `meta/queue/notifications.md`: `[{ISO8601}] 📅 Monthly summary ready: {key insight or anomaly} · see meta/eval-history/monthly-summary-{date}.md`

Otherwise silent (file-only).

## HARD RULES

- **Pure aggregation**. No subjective interpretation; that's ADVISOR's job (advisor-monthly already ran at 06:00).
- **Read-only on session and journal data**.
- **Audit trail**: `meta/runtime/{sid}/eval-history-monthly.md` (R13 markdown trail per `references/audit-trail-spec.md`)
- **Git push** summary at end

## v1.8.0 R-1.8.0-013 · Review Queue Append (HARD RULE)

Append review-queue items ONLY when monthly summary surfaces ANOMALIES (not regular metrics). Spec: `references/review-queue-spec.md`.

Anomaly thresholds:
- Compliance index drop > 20% MoM → P0
- Archiver fail rate > 20% → P1
- Session count drop > 50% MoM → P1
- Decision count zero (user not deciding anything) → P2

Use Edit tool (NOT Write). Pattern per anomaly:

fill the variables

This prompt has 5 variables. Pro fills them into a ready-to-paste prompt for you — no manual find-and-replace.

{YYYY-MM}{ISO8601}{key insight or anomaly}{date}{sid}
Unlock with Pro →

when to use it

Community prompt sourced from the open-source GitHub repo jasonhnd/life_OS (NOASSERTION). A "Eval History Monthly" style prompt — adapt the placeholders and specifics to your task. Imported as-is and not independently retested here, so check the output before relying on it.

tags

roleplaycommunitygeneral

source

jasonhnd/life_OS · NOASSERTION