{ "notes": "Episode 7. GOAL_ID 6fbd014c-a8f8-4b39-93ab-a37f88b7ec44. Round 4 is in and score.py done wrote the final order: FINISH. Nothing spawned or running. Notes of episodes 1 to 6 hold.\n\nSOURCES re-fetched from BASE=https://gist.githubusercontent.com/gtmcknight/594c47336546c8763e641b46cf9af4ec/raw: all five files keep episode 6's sha256. No plan change after change 6.\n\nSTATE: 23 batches settled, every item accepted, none failed, held or refused. final-a..c: 12 of 12 accepted, but final-c/final-12 is empty (ranking [], status incomplete: its machine could not reach gist.githubusercontent.com for field.json; it says it invented nothing). 11 seats ranked all 20; the plan needs 10 of 12. final-12 was accepted, not failed, so itemsFrom cannot rerun it, and the plan allows no seat added after results are seen: I added none. 256 of 266 seats used.\n\nRAN python3 score.py done GOAL_ID (exit 0). stderr verbatim:\nskipped final-12: it did not rank all 20 finalists\nstdout verbatim (the result; 11 rankings counted):\n| Place | Plugin | Pull request | Mean rank (11 seats) | Ranked first by | Best to worst rank | Round 3 score (of 30) |\n| --- | --- | --- | --- | --- | --- | --- |\n| 1 | housemate | https://github.com/NousResearch/hermes-agent/pull/152458 | 3 | 5 | 1 to 9 | 27.45 |\n| 2 | hermes-canvas | https://github.com/NousResearch/hermes-agent/pull/150644 | 6.55 | 1 | 1 to 16 | 28.7 |\n| 3 | hermes-ark | https://github.com/NousResearch/hermes-agent/pull/149640 | 6.73 | 3 | 1 to 16 | 27.76 |\n| 4 | tenure | https://github.com/NousResearch/hermes-agent/pull/153714 | 6.82 | 1 | 1 to 20 | 28.89 |\n| 5 | hermes-ui-cards | https://github.com/NousResearch/hermes-agent/pull/150556 | 7.45 | 1 | 1 to 15 | 27.0 |\n| runner-up | kata | https://github.com/NousResearch/hermes-agent/pull/150840 | 8.09 | 0 | 2 to 15 | 27.97 |\n| runner-up | ariadne | https://github.com/NousResearch/hermes-agent/pull/150596 | 8.18 | 0 | 4 to 19 | 28.26 |\n| runner-up | fine-print | https://github.com/NousResearch/hermes-agent/pull/153844 | 9.36 | 0 | 3 to 20 | 28.68 |\n| runner-up | grimoire | https://github.com/NousResearch/hermes-agent/pull/152691 | 10.45 | 0 | 5 to 15 | 28.17 |\n| runner-up | shadow | https://github.com/NousResearch/hermes-agent/pull/153955 | 10.82 | 0 | 3 to 18 | 29.41 |\n| finalist | cmi | https://github.com/NousResearch/hermes-agent/pull/151887 | 11 | 0 | 5 to 18 | 28.34 |\n| finalist | hypnos | https://github.com/NousResearch/hermes-agent/pull/150800 | 11 | 0 | 6 to 17 | 27.37 |\n| finalist | trust-ladder | https://github.com/NousResearch/hermes-agent/pull/149738 | 11.73 | 0 | 3 to 20 | 27.99 |\n| finalist | foreman | https://github.com/NousResearch/hermes-agent/pull/153851 | 11.73 | 0 | 4 to 17 | 26.86 |\n| finalist | fluent | https://github.com/NousResearch/hermes-agent/pull/150353 | 11.73 | 0 | 2 to 19 | 27.09 |\n| finalist | gemini-live | https://github.com/NousResearch/hermes-agent/pull/150251 | 12.64 | 0 | 3 to 19 | 27.89 |\n| finalist | contract-necromancer | https://github.com/NousResearch/hermes-agent/pull/152908 | 14.64 | 0 | 3 to 20 | 27.27 |\n| finalist | breadcrumbs | https://github.com/NousResearch/hermes-agent/pull/153020 | 15.36 | 0 | 3 to 20 | 28.61 |\n| finalist | living-spaces | https://github.com/NousResearch/hermes-agent/pull/153809 | 15.91 | 0 | 10 to 20 | 27.4 |\n| finalist | workroom | https://github.com/NousResearch/hermes-agent/pull/152651 | 16.82 | 0 | 6 to 20 | 28.34 |\n\nMY CHECKS: final-01..11 each rank the same 20 finalists once, 1 to 20, no ties; I recomputed every mean rank and all match. Mean-rank ties are ordered by round 3 standing; none is in the top ten.\n\nHOW FIRM: place 1 is clear (housemate 3.00, first for 5 of 11 seats, never below 9). Places 2 to 4 are NOT separable: 6.55, 6.73, 6.82; one more seat could reorder them. Places 5 to 7 are close too. Runner-up cut is thin: shadow 10.82 against cmi and hypnos 11.00. Seats disagree widely (tenure 1 to 20, hermes-ark and hermes-canvas 1 to 16). Final and round 3 orders differ: breadcrumbs was 1st in round 3, now 18th; shadow 2nd, now 10th; cmi 3rd, now 11th; housemate was 9th, hermes-ark 13th, hermes-ui-cards 15th. Say all this.\n\nWHAT FINAL SEATS SAID (their words, not rechecked by me):\n1 housemate (github.com/RaYYeR220/housemate): a real gateway platform adapter and TTS provider turning old phones and laptops into wake-word room speakers; spoken approvals through Hermes's approval card, Desktop page, about 453 tests, CI on real Hermes; Nous's own-hardware theme. Against: heavy setup, open LAN server, no speaker identification, live audio run by no seat; one failing TLS test (deep-x-06).\n2 hermes-canvas (0xbyt4/hermes-canvas): Desktop plan canvas whose boxes change from real writes and check exit codes, mid-turn user edits, pre_verify gate; 206 to 306 tests passed; final-07 and final-11 saw real Hermes refuse a forged done. Against: 'cannot fake' overclaims (the model writes the check commands), heuristic shell-write detection, Desktop coding only.\n3 hermes-ark (medomohamed22/hermes-ark): encrypted, deduplicated backups of the Hermes home, pre-write snapshots, item-level restore, keys from Hermes's secret store, Desktop page; four seats ranked it 1st or 2nd as what most users keep. Against: a familiar idea (four seats ranked it 11 to 16), regex self-defense, undeclared cryptography import (deep-x-03), live S3 untested.\n4 tenure (otsoa-dubief/tenure): per-action earned, revocable trust through Hermes's approval gate, undo, signed ledger, Desktop and dashboard, the largest test suite. Against: final-06 and final-07 each gave Reliable 1 (ranks 20 and 19), reporting catastrophic regex backtracking in its HERMES_VAR terminal matcher on a short input (final-07: reproduced), which can stall the hook; the other nine ranked it 1 to 9. Also a 5,200-line heuristic shell classifier and private core imports. State this dispute plainly.\n5 hermes-ui-cards (robbyczgw-cla/hermes-ui-cards): 17 schema-checked interactive answer cards in Desktop and Webapp, text fallback, 330 to 463 tests. Against: a known UI pattern, a presentation layer (three seats ranked it 13 to 15), empty demo-video slot.\nRunners-up: 6 kata (opeblow/kata) turns the agent's repeated tool sequences into approved deterministic tools; 7 ariadne (miracle352/hermes-ariadne) records and replays sessions to show what a Hermes upgrade changed; 8 fine-print (Joko-F/hermes-fine-print) observes and explains Hermes's own limits; 9 grimoire (bettersandeep/grimoire) traces numbers in answers to queries, by a regex footer, not enforcement (deep-x-03); 10 shadow (akinduroifedayo/shadow) trials a candidate model on the user's own turns and switches with undo; 40-plus private imports.\nOther: no final seat reports a plugin trying to steer an AI judge (final-09 says none; I scanned every why). Final seats' Hermes use varies: final-09 ran validate, enable and doctor on all 20 (all passed); others ran some or read only; none reports real devices, paid providers or a live Desktop GUI. Source rechecks flag 6 of 12 final results (01, 03, 05, 07, 10, 11): a limit, not a failure.\n\nREADS ASKED: the 12 final results; every round 3 seat of places 1 to 5; deep-49; deep-x-01.\n\nWRITE-UP: name places 1 to 5 and runners-up 6 to 10 exactly as the table gives them, with links and mean ranks as written; do not reorder or rescore. Say it is AI seats' prediction of Nous's judging, not Nous's result. Give the method (147 first reads, 24 second reads, 69 hands-on round 3 seats, 12 final seats of which 11 counted), the plan's six changes and straggler rule, and the limits: 11 of 12 final rankings; near-ties at 2 to 4 and 10 to 11; the tenure dispute; the cut at 20 finalists (0.896 against 0.890); ten entries unreadable at their pins and patient-research with one read (episode 6 lists them), so 1,454 of 1,464 judged; round 3 execution counts and rank defects (episode 6); source-recheck flags; findings are the seats' own.", "spawn": [], "read": [ "final-a/final-01", "final-a/final-02", "final-a/final-03", "final-a/final-04", "final-b/final-05", "final-b/final-06", "final-b/final-07", "final-b/final-08", "final-c/final-09", "final-c/final-10", "final-c/final-11", "final-c/final-12", "deep-c/deep-15", "deep-f/deep-33", "deep-i/deep-52", "deep-y/deep-x-06", "deep-b/deep-09", "deep-c/deep-18", "deep-h/deep-46", "deep-x/deep-x-02", "deep-x/deep-x-03", "deep-x/deep-x-04", "deep-a/deep-03", "deep-e/deep-30", "deep-f/deep-35", "deep-c/deep-14", "deep-h/deep-44", "deep-j/deep-59", "deep-i/deep-49", "deep-x/deep-x-01" ], "cancel": [], "finish": true }