About research records
What belongs in this directory, and the rules a record follows. Parent: Vision and roadmap.
Why research is a separate tier
Section titled “Why research is a separate tier”Product shards describe the system as it works now, and a claim that stops being true is corrected in place. A research record is the opposite: it describes what was observed at a moment, and correcting it in place would destroy the observation. Both rules are right, and they cannot apply to the same file.
Keeping them in one tier forces a choice between two failures. Either the current-docs rule is enforced and evidence gets overwritten, or the rule is relaxed and stale product prose hides behind the same exemption. The second is what happens in practice, and it is the accumulation Enforceable rules argues against.
Separating the tiers resolves it. Product shards carry no exemption. Records are dated by construction, and their datedness is the point rather than a lapse.
What belongs here
Section titled “What belongs here”| Belongs | Does not belong |
|---|---|
| Field reports and corpus measurements | Normative text of the standard |
| Defect-injection and detection matrices | Current behavior of the CLI or the compiler |
| Survey and questionnaire responses | Roadmaps and planned work |
| Evidence that a design constraint cites | The design constraint itself |
A record that no longer holds is superseded by a new record rather than edited, and the new one links back. The policy for turning any of this into public copy is Benefit claims and evidence, which stays in the product tier because it is a rule rather than an observation.
Rules a record follows
Section titled “Rules a record follows”- State the method. Every figure names how it was produced, in enough detail to re-run. A record whose numbers cannot be reproduced is an anecdote.
- Tag confidence. Distinguish what a script measured, what was read without a metric, and what was looked for and not found. A recorded gap is a finding.
- Caveat before the numbers. Corpus size, age, authorship, and what the sample cannot speak to go above the first table, not in a footnote.
- Describe sources structurally, never by name. Repository, organization, domain, and client identity stay out. Counts and mechanisms generalize; identity does not, and naming a contributed corpus is the contributor’s decision rather than the author’s.
- Separate observation from recommendation. A record ends by naming which durable position it feeds and links to it. It does not itself become the rule. The durable position links back to the record, and a reader can follow the claim to its evidence.
- Date it and leave it. A superseding record is a new file. The one change a record takes is repointing a link whose target moved, which leaves the observation as written.
These rules are advisory (Enforceable rules): whoever changes a record applies them, and the change’s review is the evidence. merlon check gates one part of them. It fails on a link in a record that doesn’t resolve, such as a link to a missing data file.
Records
Section titled “Records”Newest first, with the date each record gives:
- Skill eval round: harm check after aligning the skill with its docs (2026-10-11)
- Context sizes: this repository’s guides against one shard (2026-10-05)
- Skill eval round: measured changes to the mdcp skill (2026-10-03)
- Field report: a fully automated repository (2026-09)
- Field report: the edge of the validated surface (2026-09)
- Benchmark: this repository’s docs before and after single-pass compile (2026-06-18 and 2026-06-19)
- Field report: a first external evaluator (2026-06)
Related
Section titled “Related”- Enforceable rules — the position most records here feed
- Benefit claims and evidence — what may be said publicly from a record
- Extensions and archetypes — the archetype that packages this layout