Artifact index¶
Part of Inverse Innovation with the Encyclopedia of Abstractions · Artifact index · Last revised August 2026
This index is the audit map for the public report. It emphasizes canonical design, execution, analysis, and raw-evidence locations instead of listing every generated file. Candidate-specific proposal and evaluation links appear in the dossier appendix and candidate index.
Experimental artifacts are authoritative. Public-report files are later harmonizations or editorial explanations.
Program-level materials¶
| Artifact | Purpose |
|---|---|
| Inverse-innovation experiment directory | Program landing page and experiment map. |
| Program roadmap, 2026-08-03 | Decisions and planned work preserved before the literature review and later experiments. |
| Literature review | Search strategy, related work, primary-source synthesis, and contribution boundary. |
| Nearest-systems matrix | Feature-by-feature comparison with close systems and research traditions. |
| Report design | Approved scope, dossier policy, interpretation rules, and release gates. |
| Candidate index | Harmonized 59-row machine-readable evidence record. |
| Report fact table | Cross-experiment counts and canonical analysis pointers. |
| Report validation result | Latest automated invariant, dossier-length, artifact, and local-link audit. |
| Publication QA register | Status and evidence for the eleven approved release gates. |
| Prior-art sentinel audit | Ten-case historical, trade, non-English, and full-composition sensitivity audit. |
| Post-hoc yield decomposition | Archetype and domain concentration diagnostics across compatible Experiment 3–6 strata. |
| Prospective archetype-breadth probe | Probability-sampled generated-archetype productivity under a three-domain light screen. |
| Post-hoc proposal-type analysis | Blinded intervention-substrate and evidence-dependency coding for 422 evaluated proposals. |
| Prospective external context comparison | Uniform external scrutiny of Experiment 2's relevant, archetype-only, and irrelevant-mechanism terminal proposals. |
| Prospective substrate-denial test | Matched intervention on the E9 random stratum, with blinded quality/substrate measurement, public-web screening, and a triggered Max-effort follow-up. |
| Prospective second-slot policy test | New 60-cell comparison of ordinary-diverse and alternative-substrate P2s, with duplicate blinded measurement, opaque public-web screening, and a frozen portfolio decision rule. |
| Prospective Applicability Graph test | Stratified 40-archetype, 120-case benchmark separating candidate retrieval from blinded literal-by-literal DNF route verification. |
Experiment 1 — calibration¶
Purpose: initial sniff test of mechanism context across 60 cells and three conditions.
| Layer | Canonical artifacts |
|---|---|
| Orientation | README · experiment specification · rubric |
| Prompts and schemas | generation prompt · review prompt · cell schema · review schema |
| Cell declarations | calibration cells · full matrix |
| Results | experiment findings · calibration report · summary JSON |
| Audits | protocol QA · prior-art sniff |
| Code | analyze_inverse_innovation.py · validate_inverse_innovation_results.py |
Experiment 2 — relevant mechanisms and iterative revision¶
Purpose: compare relevant mechanisms with archetype-only and equal-length irrelevant-mechanism conditions in 20 paired cells; allow up to five revisions after the original proposal.
| Layer | Canonical artifacts |
|---|---|
| Pilot | pilot README · pilot protocol · completion manifest |
| Frozen design | protocol · analysis plan · design freeze · execution freeze |
| Core prompts | generator · reviser · tester · quality judge · gap classifier |
| Schemas | candidate · test · quality judgment · controller |
| Blinding and keys | quality commitment · revealed arm key · revealed quality key |
| Results | results narrative · results JSON · completion manifest |
| Post-hoc opportunity screen | method · report · ranked results · sources |
| Code | run_inverse_innovation_exp02_controller.py · analyze_inverse_innovation_exp02_main20.py · analyze_inverse_innovation_exp02_opportunities.py · validate_inverse_innovation_exp02_main20.py |
Experiment 3 — 320-cell full matrix and external verification¶
Purpose: cross five archetypes with 64 domains, run the closed-book pipeline, assess opportunities, and externally scrutinize a selected set.
| Layer | Canonical artifacts |
|---|---|
| Frozen design | protocol · analysis plan · design freeze |
| Closed-book prompts and schemas | generator · reviser · tester · candidate schema · test schema |
| Opportunity stage | method · design freeze · evaluator prompt · report |
| External research | method · design freeze · selection manifest · research prompt · assessment schema |
| Results | final report · integrated results · external report · external results · completion manifest |
| Raw candidate evidence | external inputs · external assessments |
| Code | run_inverse_innovation_exp03_full_matrix.py · run_inverse_innovation_exp03_external_research.py · analyze_inverse_innovation_exp03_integrated.py · validate_inverse_innovation_exp03_full_matrix.py |
Experiment 4 — proposal-first versus retrieval-first¶
Purpose: compare a complete-proposal-first workflow with broad retrieval and hypothesis screening in 20 paired cells.
| Layer | Canonical artifacts |
|---|---|
| Design | README · method · design freeze · selection manifest |
| Proposal-first prompts | control generator · evaluator · reviser |
| Retrieval-first prompts | self-scout · treatment ideator · prior-art critic · selector · proposal drafter |
| Schemas | proposal · evaluation · hypothesis pool · prior-art critique |
| Results | report · result JSON · resource accounting · completion manifest |
| Raw evidence | scientific records · run manifest |
| Code | build_inverse_innovation_exp04.py · run_inverse_innovation_exp04_v2.py · analyze_inverse_innovation_exp04.py · validate_inverse_innovation_exp04_complete.py |
Experiment 5 — five-proposal portfolio pilot¶
Purpose: generate and fully evaluate five diverse complete proposals in each of 20 cells, then examine marginal yield by proposal position.
| Layer | Canonical artifacts |
|---|---|
| Design | README · method · design freeze · selection manifest |
| Prompts | proposal 1 generator · portfolio continuation · diversity auditor · opportunity evaluator · reviser |
| Schemas | proposal · evaluation · diversity · controller |
| Results | report · result JSON · proposal-level results · resource accounting · completion manifest |
| Raw evidence | scientific records · run manifest |
| Code | build_inverse_innovation_exp05.py · run_inverse_innovation_exp05.py · analyze_inverse_innovation_exp05.py · validate_inverse_innovation_exp05.py |
Experiment 6 — four-proposal 60-cell generalization¶
Purpose: test the four-proposal rescue rule on five new archetypes and 12 domains; add a calibrated empirical-partner lane.
| Layer | Canonical artifacts |
|---|---|
| Design | README · method · design freeze · selection manifest |
| Prompts | proposal 1 generator · portfolio continuation · diversity auditor · opportunity evaluator · empirical-partner adjudicator |
| Schemas | proposal · evaluation · empirical partner · controller |
| Partner calibration | cases · calibration result |
| Results | report · result JSON · cell-level results · proposal-level results · resource accounting · completion manifest |
| Raw evidence | scientific records · partner adjudications · run manifest |
| Code | build_inverse_innovation_exp06.py · run_inverse_innovation_exp06.py · analyze_inverse_innovation_exp06.py · validate_inverse_innovation_exp06.py |
Experiment 7 — retrospective proposal-only selector¶
Purpose: test whether blinded proposal-only ranking could prefilter Experiment 6 candidates while retaining strict and empirical-partner yield.
| Layer | Canonical artifacts |
|---|---|
| Design | README · method · design freeze · input manifest · blind map |
| Selector | prompt · schema · frozen consensus · policy selections |
| Results | report · result JSON · policy metrics · false negatives · resource accounting · completion manifest |
| Raw evidence | selector outputs · run manifest |
| Code | build_inverse_innovation_exp07.py · run_inverse_innovation_exp07.py · analyze_inverse_innovation_exp07.py · validate_inverse_innovation_exp07.py |
Report-hardening prior-art sentinel¶
Purpose: test whether explicitly searching historical, trade, non-English, and full-composition lanes exposes closer precedents for a hash-selected ten-case sentinel.
| Layer | Canonical artifacts |
|---|---|
| Frozen design | method · design freeze · hash-selected sample |
| Search and cases | query log · case results |
| Result | audit report |
| Code | build_inverse_innovation_prior_art_sentinel.py |
Experiment 8 — post-hoc yield decomposition¶
Purpose: describe how observed outcomes are distributed by tested archetype and domain without pooling unlike protocols.
| Layer | Canonical artifacts |
|---|---|
| Frozen design | method · design freeze |
| Results | report · results JSON · archetype rows · domain rows |
| Code | analyze_inverse_innovation_exp08.py |
Experiment 9 — prospective archetype-breadth probe¶
Purpose: test whether light-screen productivity extends beyond the archetypes selected in earlier experiments, including a probability sample from the previously untested generated-archetype corpus.
| Layer | Canonical artifacts |
|---|---|
| Frozen design | method · design freeze · documented design correction · selection manifest · cell manifest |
| Prompts and schemas | generator · light screen · proposal schema · screen schema |
| Corpus and inputs | archetype source snapshot · 150 cell inputs |
| Results | report · result JSON · archetype rows · cell rows · completion manifest |
| Raw evidence | proposal and screen records · run manifest |
| Code | build_inverse_innovation_exp09.py · seal_inverse_innovation_exp09_design.py · run_inverse_innovation_exp09.py · analyze_inverse_innovation_exp09.py · validate_inverse_innovation_exp09.py |
Experiment 10 — post-hoc proposal type × disposition¶
Purpose: classify all 422 primary externally evaluated proposals on intervention substrate and decisive evidence dependency, with outcome labels withheld from two fresh passes and a third blinded adjudication.
| Layer | Canonical artifacts |
|---|---|
| Frozen design | method · design freeze |
| Blinded record | blinded inputs · withheld outcomes · pass 1 · pass 2 · disagreements · adjudications |
| Results | report · results JSON · joined rows |
| Code | prepare_inverse_innovation_exp10.py · run_inverse_innovation_exp10_classifiers.py · run_inverse_innovation_exp10_adjudicator.py · analyze_inverse_innovation_exp10.py |
Post-hoc archetype substrate analyses¶
Purpose: correct the experimental archetype-score summary, test whether structural/framed character shifts proposal substrate, and distinguish source modulation from a broader governance/computational pipeline constraint.
| Layer | Canonical artifacts |
|---|---|
| Combined synthesis | report · corrected internal note · validation result |
| E10B existing-data join | method · design freeze · report · results · archetype rows |
| E9 blinded follow-up | method · design freeze · classification seal · report · results |
| E9 classification record | blinded inputs · pass 1 · pass 2 · disagreements · adjudications · joined rows |
| Code | analyze_inverse_innovation_e10b.py · prepare_inverse_innovation_e9_substrate_followup.py · run_inverse_innovation_e9_substrate_classifiers.py · run_inverse_innovation_e9_substrate_adjudicator.py · analyze_inverse_innovation_e9_substrate_followup.py · validate_inverse_innovation_substrate_analysis.py |
Experiment 11 — external mechanism-context comparison¶
Purpose: test whether Experiment 2's relevant-mechanism advantage persists when all preserved terminal proposals receive the same external research and blinded comparative judgment.
| Layer | Canonical artifacts |
|---|---|
| Frozen design | protocol · analysis plan · design freeze · input manifest |
| Amendments | transport/schema amendment · its freeze · interrupted-attempt recovery · its freeze |
| Prompts and schemas | external scrutinizer · blinded comparative judge · external-evaluation schema · paired-judgment schema |
| Blinding and adjudication | sealed adjudication record · tiebreak manifest · revealed arm key |
| Results | report · result JSON · completion manifest |
| Raw evidence | external evaluations and comparative judgments · run manifest |
| Code | build_inverse_innovation_exp11.py · seal_inverse_innovation_exp11_design.py · run_inverse_innovation_exp11.py · recover_inverse_innovation_exp11_interrupted.py · analyze_inverse_innovation_exp11.py · validate_inverse_innovation_exp11.py |
Experiment 12 — paired substrate-denial intervention¶
Purpose: test whether the governance/computational concentration observed in E9 is an instruction-sensitive default, measure the quality and light-screen cost of leaving those substrates, and run a frozen Max-effort follow-up only if the High-effort cost trigger fires.
| Layer | Canonical artifacts |
|---|---|
| Frozen design | method · design seal · input manifest · Max subset · README status-file audit correction |
| Prompts and schemas | prompts · schemas |
| Blinding and joins | primary blinded inputs · primary measurement seals · primary revealed joins · Max blinded record |
| Results | complete report · primary result JSON · cell rows · Max result JSON · resource summary · validation result |
| Raw evidence | proposal, screen, judgment, and telemetry records · Max scientific measurement records |
| Code | build_inverse_innovation_exp12.py · run_inverse_innovation_exp12.py · run_inverse_innovation_exp12_screens.py · analyze_inverse_innovation_exp12.py · analyze_inverse_innovation_exp12_max.py · summarize_inverse_innovation_exp12_runtime.py · validate_inverse_innovation_exp12.py |
Experiment 13 — second-slot portfolio policy¶
Purpose: determine prospectively whether one additional proposal should use ordinary conceptual diversity or deliberately seek a non-governance, non-computational causal substrate.
| Layer | Canonical artifacts |
|---|---|
| Frozen design and sample | method · design seal · selection manifest · cell manifest · source snapshot |
| Prompts and schemas | prompts · schemas · batch manifest |
| Blinding and measurement | opaque inputs and pair records · measurement input seal · measurement output seal · adjudication manifest |
| Results | completion status · complete report · result JSON · cell rows · incremental survivors · validation result |
| Raw evidence | 180 proposals, blinded passes, adjudications, screens, and telemetry · scientific run manifest · measurement manifest · adjudication manifest |
| Code | build_inverse_innovation_exp13.py · seal_inverse_innovation_exp13_design.py · run_inverse_innovation_exp13.py · prepare_inverse_innovation_exp13_blinding.py · run_inverse_innovation_exp13_measurement.py · run_inverse_innovation_exp13_adjudication.py · analyze_inverse_innovation_exp13.py · validate_inverse_innovation_exp13.py |
Experiment 14 — Applicability Graph retrieval and DNF verification¶
Purpose: test prospectively whether the new diagnostic Applicability Graph improves problem-to-archetype retrieval over the existing solution-oriented index and whether explicit DNF routes reject one-literal near misses.
| Layer | Canonical artifacts |
|---|---|
| Frozen design and sample | method · design seal · selection manifest · sampling seed |
| Prompts and schemas | prompts · schemas |
| Blinding and measurement | opaque audit and verifier inputs · eligible-case manifest · measurement input seal · verification input seal · audit recovery amendment |
| Results | completion status · complete report · result JSON · case rows · validation result · completion manifest |
| Raw evidence | case bundles, duplicate audits, adjudications, retrieval records, verifier outputs, and telemetry · scientific run manifest · private join keys |
| Code | build_inverse_innovation_exp14.py · seal_inverse_innovation_exp14_design.py · run_inverse_innovation_exp14.py · recover_inverse_innovation_exp14_audit_batch.py · analyze_inverse_innovation_exp14.py · validate_inverse_innovation_exp14.py |
Experiment 15 — route-aware Applicability Graph retrieval¶
Purpose: test prospectively, on a disjoint 40-archetype sample, whether five frozen condition-level DNF aggregators improve problem-to-archetype candidate retrieval over the solution-index and diagnostic maximum-hit baselines.
| Layer | Canonical artifacts |
|---|---|
| Frozen design and sample | method · design seal · selection manifest · sampling seed |
| Prompts and schemas | case writer · case auditor · case adjudicator · schemas |
| Blinding and measurement | opaque audit inputs · eligible-case manifest · measurement input seal · private join keys |
| Results | completion status · complete report · post-hoc failure localization · result JSON · post-hoc diagnostic JSON · case rows · validation result · completion manifest |
| Raw evidence | case bundles, duplicate audits, adjudications, retrieval records, and telemetry · scientific run manifest and approval record · 40 applicability packets |
| Code | build_inverse_innovation_exp15.py · seal_inverse_innovation_exp15_design.py · run_inverse_innovation_exp15.py · inverse_innovation_route_retrieval.py · analyze_inverse_innovation_exp15.py · analyze_inverse_innovation_exp15_diagnostics.py · validate_inverse_innovation_exp15.py |
Public-report derivation¶
| Artifact | Role |
|---|---|
build_inverse_innovation_public_report_data.py |
Extracts and validates the 59 canonical candidate records, report facts, cost bands, and post-hoc sensitivity ordering. |
draft_inverse_innovation_public_report_dossiers.py |
Produces preserved editorial plain-language drafts from the frozen candidate records without web access. These are not experimental outputs. |
build_inverse_innovation_public_report.py |
Deterministically compiles candidate data, editorial drafts, sources, and artifact links into the dossier appendix. |
validate_inverse_innovation_public_report.py |
Audits counts, endpoints, required fields, links, anchors, and headline quantitative claims. |
| Dossier drafting manifest | Records editorial model, settings, batch count, source, and completion status. |
| Dossier drafts | Structured editorial derivatives used by the Markdown compiler. |
Reading provenance correctly¶
- A proposal file records what the generator ultimately proposed.
- An evaluation file records the bounded external evidence and the evaluator's judgment at that time.
- An analysis file aggregates frozen rules across proposals or cells.
- A dossier translates those records for readers and may introduce a short alias; it does not replace them.
- A later expert review should be appended as new evidence, not written into an experimental record.