Eval History Monthly
# User-invoked prompt · eval-history-monthly summary (v1.8.2 · Obsidian-style) > v1.8.0 pivot: this used to fire from launchd cron monthly 1st at 07:00. > Cron is gone. v1.8.1 also dropped the `tools/stats.py` middleware — > ROUTER now reads this prompt and does the aggregation 100% via LLM > tools (Read/Glob/Grep/Write). > > **v1.8.2 HARD RULE #11**: Output renders in Obsidian. Apply > `references/obsidian-style.md` — `> [!info]` callout for "At a glance", > `> [!warning]` for anomalies, `[[wikilinks]]` for entry/session refs, > nested tags (e.g. `eval-history/monthly`). ## Trigger keywords - `统计这个月` / `monthly summary` / `月度统计` - `eval history` / `系统表现总结` - retrospective Mode 0 Conscious Patrol reports `eval-history-monthly Nd` overdue and user says "跑一下" ## Context `meta/eval-history/` accumulates per-session evaluation data: AUDITOR scores, REVIEWER decisions, archiver completions, etc. This prompt aggregates them into a one-file monthly view, doing all the counting inline via Glob + Read + simple text scan. ## Required actions (100% LLM, no python) 1. Determine the target month: `YYYY-MM` of the previous calendar month (or current month if user explicitly says "这个月"). 2. `Glob` `meta/eval-history/**/*.md` and `meta/journal/**/*.md` filtering to the target month by mtime (use `Bash` with `find ... -newermt "$YYYY-MM-01" ! -newermt "$YYYY-MM+1-01"` to get the filtered file list — this is the ONLY shell call needed). 3. For each file, `Read` the frontmatter and key sections; tally: - `outcome_score` values (sum + count for average) - `archiver_phase_4_completed: true|false` (completion rate) - `auditor_violations:` count by class (A/B/C/D/E) - REVIEWER veto count (search "veto" / "封驳" in journal) - decision count by domain (frontmatter `domain:`) 4. Also `Glob` `compliance/violations.md` (single file) and `Read` it; tally violation rows that fall within the target month. 5. Aggregate into the report below; write directly to output path. ## Aggregations to compute ### Sessions - Total sessions / Average length / Adjourn completion rate / Average outcome_score ### Decisions - Total decisions / By domain / Express vs full deliberation / Regret rate ### Knowledge growth - Wiki entries new/deleted / SOUL dimensions changed / Methods created / Concepts new / Hebbian edge updates ### System health - Cron jobs total runs / successes / failures - Archiver Phase completion rate - Cortex audit trail completion rate - Hook fire counts / Approval guard intercepts - Compliance index trend ### Costs (if telemetry available) - Total tokens / By subagent / By cron job ## Output Write `meta/eval-history/monthly-summary-{YYYY-MM}.md` with sections: At a glance / Sessions / Decisions / Knowledge growth / System health / Costs / Notable events / Audit trail. ## Notification Notify only if anomaly detected (X% drop in compliance, archiver fail rate > 20%, etc.): - Append to `meta/queue/notifications.md`: `[{ISO8601}] 📅 Monthly summary ready: {key insight or anomaly} · see meta/eval-history/monthly-summary-{date}.md` Otherwise silent (file-only). ## HARD RULES - **Pure aggregation**. No subjective interpretation; that's ADVISOR's job (advisor-monthly already ran at 06:00). - **Read-only on session and journal data**. - **Audit trail**: `meta/runtime/{sid}/eval-history-monthly.md` (R13 markdown trail per `references/audit-trail-spec.md`) - **Git push** summary at end ## v1.8.0 R-1.8.0-013 · Review Queue Append (HARD RULE) Append review-queue items ONLY when monthly summary surfaces ANOMALIES (not regular metrics). Spec: `references/review-queue-spec.md`. Anomaly thresholds: - Compliance index drop > 20% MoM → P0 - Archiver fail rate > 20% → P1 - Session count drop > 50% MoM → P1 - Decision count zero (user not deciding anything) → P2 Use Edit tool (NOT Write). Pattern per anomaly:
fill the variables
This prompt has 5 variables. Pro fills them into a ready-to-paste prompt for you — no manual find-and-replace.
{YYYY-MM}{ISO8601}{key insight or anomaly}{date}{sid}
Unlock with Pro →when to use it
Community prompt sourced from the open-source GitHub repo jasonhnd/life_OS (NOASSERTION). A "Eval History Monthly" style prompt — adapt the placeholders and specifics to your task. Imported as-is and not independently retested here, so check the output before relying on it.
tags
roleplaycommunitygeneral
source
jasonhnd/life_OS · NOASSERTION