{"schema_version":1,"research_id":"eoa_inverse_innovation_exp06_external_evaluation_20260803","source_assessment_id":"ritualized_meaning_and_commitment_enactment__futurism_foresight:P3:v0","cell_id":"ritualized_meaning_and_commitment_enactment__futurism_foresight","search_queries":["site:oecd.org strategic foresight scenarios monitor update assumptions signposts review","site:gov.uk Futures Toolkit scenarios review monitor assumptions update","scenario planning postmortem superseded scenarios archive version control dissent foresight","scenario planning ritual retirement scenario wake organizational ritual","site:sciencedirect.com scenario planning organizational memory scenarios assumptions implementation study","site:researchgate.net scenario planning hindsight bias scenario organizational learning empirical","site:shell.com scenarios signposts monitor assumptions update scenario planning guide","records management superseded documents obsolete versions authoritative status official guidance","strategic foresight evaluation learning follow up scenarios monitoring official guide scenario indicators signposts","Association Professional Futurists code ethics transparency assumptions foresight","scenario planning learning limitations organizational defensive routines identity empirical study","ritual organizational change commitment empirical study collective ritual workplace","organization project funeral ritual failed project lessons learned","scenario funeral foresight workshop superseded scenario","organizational funeral obsolete strategy ritual closure","learning review ritual project closure postmortem psychological safety","\"A Cycle of Commitment\" \"organizational consequences\" PDF ritual commitment"],"sources":[{"source_id":"S1","title":"The Futures Toolkit HTML","publisher":"UK Government Office for Science","url":"https://www.gov.uk/government/publications/futures-toolkit-for-policy-makers-and-analysts/the-futures-toolkit-html","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"2024-08-29","accessed_at":"2026-08-03","claims_supported":["Official foresight practice should sit within monitoring, evaluation, and feedback cycles.","Scenario work is participatory, assumption-focused, and intended to affect strategic decisions rather than predict one future.","Scenario workshops commonly require multiple participants, facilitation, preparation, and written outputs."]},{"source_id":"S2","title":"UNDP's Foresight for Strategic Planning Toolkit","publisher":"United Nations Development Programme","url":"https://www.undp.org/future-development/publications/undps-foresight-strategic-planning-toolkit","source_class":"OFFICIAL_ORGANIZATION_DATA","publication_date":"2026-06-17","accessed_at":"2026-08-03","claims_supported":["UNDP identifies its colleagues, governments, partners, and policymakers as users of institutional foresight.","UNDP expressly calls for monitoring weak signals, stress-testing and adjusting plans, managing risk, and revising strategies as context changes."]},{"source_id":"S3","title":"Challenges in Navigating Scenario Planning","publisher":"California Management Review / SAGE Publications","url":"https://journals.sagepub.com/doi/10.1177/00081256251414972","source_class":"PRIMARY_RESEARCH","publication_date":"2026-04-30","accessed_at":"2026-08-03","claims_supported":["A retrospective autoethnographic NASA case found that leadership bias, strategic persistence, organizational politics, and power dynamics affected scenario acceptance and use.","Scenario ideas retained influence over time through language, parallel initiatives, coalitions, and investments even without straightforward formal incorporation.","The study reconstructed scenario history using archived presentations, emails, reports, journal entries, meeting notes, and external records, illustrating the relevance of preserved provenance while also carrying insider-research limitations."]},{"source_id":"S4","title":"Implementing Schedules","publisher":"U.S. National Archives and Records Administration","url":"https://www.archives.gov/records-mgmt/scheduling/implementation","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"2026-03-18","accessed_at":"2026-08-03","claims_supported":["Established records-management practice already requires identifying superseded or obsolete authorities, updating applications and manuals, disseminating changes, notifying custodians, and training staff.","Records disposition can be event-triggered, and access restrictions, custody, retention, and destruction remain governed by formal authority.","Status changes must not substitute for legally authorized retention and disposition."]},{"source_id":"S5","title":"Saved scenario history","publisher":"Energy Transition Model / Quintel","url":"https://docs.energytransitionmodel.com/main/user_manual/managing-scenarios/scenario-history/","source_class":"OFFICIAL_PRODUCT_DOCUMENTATION","publication_date":"2026","accessed_at":"2026-08-03","claims_supported":["A deployed scenario platform already preserves dated scenario versions, saving users, descriptions of changes, and the ability to open past states.","Scenario-version history and underlying model-version history are distinguished.","Viewer, collaborator, and owner roles already provide differentiated authority over scenario history."]},{"source_id":"S6","title":"Code of Ethics","publisher":"Association of Professional Futurists","url":"https://www.profuturists.org/association/apf-initiatives/code-of-ethics-initiative","source_class":"OFFICIAL_ORGANIZATION_DATA","publication_date":"2025-10-01","accessed_at":"2026-08-03","claims_supported":["A professional foresight association expresses a need for credibility, responsible practice, accountability, and prevention of misuse.","The published code is explicitly living and culturally plural but had not yet been formally adopted by the association board, limiting its authority as a standard."]},{"source_id":"S7","title":"The art and science of post project reviews","publisher":"Project Management Institute","url":"https://www.pmi.org/learning/library/post-project-reviews-closing-processes-1425","source_class":"AUTHORITATIVE_SECONDARY","publication_date":"2014-05-05","accessed_at":"2026-08-03","claims_supported":["A very close established practice treats a post-project review as a distinct ritual after administrative closure.","It uses an independent facilitator, safety rules, multiple perspectives, artifacts, timelines, index cards, documentation, recommendations, and orderly closure.","The practice explicitly aims to prevent blame and transfer learning rather than replace ordinary project records and lessons-learned controls."]},{"source_id":"S8","title":"A Cycle of Commitment: The Organizational Consequences of Rituals","publisher":"University of California, Berkeley eScholarship","url":"https://escholarship.org/uc/item/64q1d8r7","source_class":"PRIMARY_RESEARCH","publication_date":"2022","accessed_at":"2026-08-03","claims_supported":["Eight experimental and observational studies examined organizational rituals and commitment.","The dissertation reports that ritual engagement increased existing-member commitment and that more committed members were more likely to punish attempts to alter rituals.","Its hypothesized outsider and underrepresented-member exclusion effects were not robustly supported, so those particular harms should not be asserted as established effects."]}],"problem_evidence":{"support":"WEAK","rationale":"The exact stated failure—superseded scenarios continuing to circulate as active guidance while their histories are rewritten—was not directly measured in a consortium or prevalence study. The NASA case demonstrates adjacent phenomena: long-lived scenario influence, leadership resistance, politics, and the value of archived contemporaneous records. NARA's detailed supersession and dissemination requirements show that stale or ambiguous authority is operationally important enough to govern, but they do not establish that foresight scenarios commonly evade those controls. The problem is plausible and consequential, but its frequency and causal attribution to social reluctance rather than deficient records management remain unverified.","source_ids":["S3","S4"]},"stakeholder_evidence":{"support":"MODERATE","rationale":"Identifiable institutional users and potential authorizers exist: the UK Government Office for Science, UNDP's Strategy and Futures team, government records officers, and professional futurists. UNDP expressly calls for monitoring, stress-testing, adjustment, and revision as contexts change, while APF expresses demand for accountability and responsible practice. No source requests a scenario wake, reports willingness to fund one, or identifies a specific cross-agency consortium prepared to authorize it, so pull supports the outcome but not this intervention.","source_ids":["S1","S2","S4","S6"]},"prior_art":{"proximity":"SUBSTANTIAL_COLLISION","closest_analogues":[{"name":"Ritualized post-project review","similarity":"PMI already describes a distinct post-closure ritual with independent facilitation, safe-haven rules, plural recollection, project artifacts, timelines, index cards, documented learning, recommendations, and orderly closure. This substantially overlaps the wake's expressive, safety, memory, and learning sequence.","remaining_difference":"It is project-generic and does not itself execute authoritative scenario-status changes, preserve dated uncertainty and dissent, identify a replacement scenario, or notify downstream scenario users.","source_ids":["S7"]},{"name":"Formal records-supersession workflow","similarity":"NARA already requires identification of superseded or obsolete authorities, application and manual updates, dissemination, custodian notification, training, retention controls, and authorized disposition.","remaining_difference":"It manages documentary and legal authority but does not test whether an artifact retains informal symbolic authority or conduct a witnessed, consent-aware learning event.","source_ids":["S4"]},{"name":"Scenario version history in the Energy Transition Model","similarity":"The product preserves dated scenario versions, change descriptions, model-version distinctions, historical reopening, and role-based authority.","remaining_difference":"It does not provide an active/superseded/retired social transition, dissent provenance, dependency transfer, downstream notice, or a blame-sensitive review.","source_ids":["S5"]},{"name":"Continuous foresight review and strategy revision","similarity":"UK and UNDP guidance embeds foresight in monitoring, evaluation, feedback, stress-testing, and revision cycles with participatory facilitation.","remaining_difference":"The guidance focuses on updating analysis and strategy, not on formally discharging the residual social authority of a superseded scenario.","source_ids":["S1","S2"]}],"distinctive_claim_remaining":"Conditional on complete versioning, authoritative status labeling, replacement references, dependency mapping, downstream notice, and an ordinary blame-aware postmortem already being performed, adding a consent-aware witnessed symbolic discharge will produce a larger 30- and 90-day reduction in active citation of the retired scenario and better unaided separation of contemporaneous knowledge from hindsight, without increasing perceived blame, retaliation, false closure, or confidential disclosure. If administrative controls and the comparator postmortem achieve the same results, the wake has no incremental warrant.","confidence":"HIGH"},"implementation_evidence":{"support":"MODERATE","rationale":"The components are technically ordinary: repository metadata, immutable versions, role-based permissions, dependency lists, notices, facilitated review, artifacts, cards, and debriefs. NARA supplies a credible authority and retention model; the Energy Transition Model demonstrates scenario version history; and PMI demonstrates the close workshop workflow. Legal and safety feasibility is conditional: records must remain under applicable retention and access rules; retirement cannot cancel policy, contracts, budgets, regulatory duties, or external copies; confidential dissent requires controlled attribution; participation data must not enter performance evaluation; and an independent chair needs stop authority. Ritual research supports a real commitment mechanism but also warns that committed members may police ritual adherence, making opt-out, nonretaliation, and retirement of the wake material safeguards. No integrated deployment or live safety evidence was found.","source_ids":["S4","S5","S7","S8"]},"scores":{"meaningful_impact":{"score":3,"rationale":"Continued use of obsolete assumptions could affect consequential infrastructure decisions, but prevalence, attributable decision loss, and realized impact are unmeasured.","source_ids":["S2","S3","S4"]},"stakeholder_pull":{"score":2,"rationale":"Institutional foresight users expressly need monitoring and revision, but no consortium, funder, or authorizer has requested or committed to the wake.","source_ids":["S1","S2","S6"]},"incremental_advantage":{"score":2,"rationale":"The practical package substantially collides with records supersession, scenario version history, and ritualized post-project review; advantage survives only for residual informal authority after those controls work.","source_ids":["S4","S5","S7"]},"distinctiveness_plausibility":{"score":2,"rationale":"Scenario-specific witnessed discharge tied to executable status and dependencies is contrastive, but it is a narrow recombination of established practices and has no field evidence.","source_ids":["S4","S5","S7"]},"technical_implementability":{"score":4,"rationale":"Required repository, provenance, notification, permission, facilitation, and archival functions are conventional and independently demonstrated.","source_ids":["S4","S5","S7"]},"adoption_authority_feasibility":{"score":3,"rationale":"Governance committees and records stewards could authorize a bounded internal pilot, but their separate powers over records, strategy, confidentiality, and downstream artifacts require a written authority map.","source_ids":["S2","S4","S6"]},"evidence_readiness":{"score":2,"rationale":"Observable outcomes and comparators are available, but the exact problem and incremental intervention effect require proprietary repository audits and live organizational testing.","source_ids":["S3","S4","S7"]},"safety_net_benefit":{"score":3,"rationale":"Independent facilitation, preservation of originals, status rollback, opt-outs, and downstream notices could reduce blame and zombie use, although ritual commitment can itself harden conformity.","source_ids":["S4","S7","S8"]},"scalability":{"score":3,"rationale":"Templates and repository controls are reusable, but each event requires local authority, provenance reconstruction, dependency mapping, confidentiality review, and facilitation; scaling across agencies is therefore organizational rather than technical.","source_ids":["S1","S4","S5","S7"]}},"score_confidence":"MODERATE","costs":{"first_evidence":{"band_2026_usd":"UNDER_10K","scope":"Read-only audit of one already-superseded low-stakes scenario across consortium-controlled repositories, memoranda, replacement links, known dependencies, notices, and a small set of staff comprehension interviews; no wake.","confidence":"MODERATE","assumptions":["Approximately 40-80 loaded staff hours.","Existing search and audit logs are accessible.","Resource-equivalent labor is valued at approximately $100-$200 per hour.","No legal discovery, external repository remediation, or new software is included."],"source_ids":["S4","S5"]},"initial_deployment_startup":{"band_2026_usd":"10K_TO_50K","scope":"One-time governance and design work: authority matrix, trigger criteria, retention/privacy review, consent and stop protocol, repository fields, templates, notification lists, facilitator preparation, and pre-registration.","confidence":"LOW","assumptions":["Approximately 150-350 loaded hours across foresight, records, legal/privacy, safety, and facilitation roles.","Existing repository supports metadata and role-based permissions without custom platform development.","Procurement, union consultation, or cross-border data review could move the cost upward."],"source_ids":["S1","S4","S5","S7"]},"operational_launch":{"band_2026_usd":"10K_TO_50K","scope":"Matched-pair pilot covering two low-stakes superseded scenarios: enhanced administrative retirement for both, an ordinary structured postmortem for the comparator, the candidate wake for the treatment, independent observation, debriefs, and 30/90-day measurement.","confidence":"LOW","assumptions":["Approximately 200-450 loaded hours.","Eight to twelve participants per event plus preparation, facilitation, records work, and downstream checks.","No public communications campaign, travel-intensive meeting, material remediation, or policy cancellation is included."],"source_ids":["S1","S4","S7"]},"annual_recurring":{"band_2026_usd":"50K_TO_250K","scope":"Four to eight retirements per year, quarterly zombie-use audit, repository and notification maintenance, independent facilitation/safety review, debrief analysis, and annual review or retirement of the practice.","confidence":"LOW","assumptions":["Roughly 0.4-1.2 FTE-equivalent distributed across records, foresight, facilitation, governance, and evaluation.","Most events remain internal and low intensity.","High-dispute scenarios, public engagement, records remediation, litigation holds, or multi-agency travel are excluded."],"source_ids":["S4","S7"]}},"verified_pipeline_gates":{"externally_supported_problem":{"status":"UNCERTAIN","reason":"Adjacent evidence shows scenario politics, persistence, and formal supersession needs, but no source directly demonstrates the complete stated zombie-scenario pattern or its prevalence.","source_ids":["S3","S4"]},"externally_credible_adopter_or_authorizer":{"status":"UNCERTAIN","reason":"UNDP, government foresight units, records officers, and professional futurists are credible classes of user or authorizer with expressed needs for revision and accountability, but no named consortium has requested, funded, or authorized this wake.","source_ids":["S1","S2","S4","S6"]},"distinct_testable_incremental_claim":{"status":"YES","reason":"The residual claim is explicitly conditional on strong administrative controls and can be compared against an equal-effort structured postmortem using citation, comprehension, dependency, and harm outcomes.","source_ids":["S4","S5","S7"]},"bounded_next_evidence_step":{"status":"YES","reason":"A matched-pair, low-stakes, preregistered pilot can preserve all essential records controls for both cases while varying only the wake layer and measuring 30/90-day outcomes.","source_ids":["S4","S5","S7"]},"no_unresolved_safety_or_authority_stop":{"status":"UNCERTAIN","reason":"The design has plausible safeguards, but written authority over retirement status, confidential dissent, participant data, and downstream notices has not been secured from a real partner. Ritual adherence pressure is a material live-testing risk.","source_ids":["S4","S8"]},"credible_cost_scope_and_range":{"status":"UNCERTAIN","reason":"Scope-based resource bands are bounded using documented workshop and records workflows, but no local repository inventory, event volume, loaded labor rates, procurement quotes, or legal-review estimate is available.","source_ids":["S1","S4","S7"]}},"next_evidence_step":"Partner with one identifiable consortium and select two already-superseded, nonregulatory scenarios matched on age, reach, and repository footprint. First audit both to test the problem falsifier. If either is still ambiguously active, give both the same essential administrative package: frozen provenance, authoritative retired status, replacement reference, dependency register, retention/access controls, and downstream notices. Randomly assign one to an equal-time ordinary PMI-style post-project review and the other to the candidate's consent-aware witnessed wake. Pre-register primary outcomes: active citations in controlled systems at 30 and 90 days; unaided downstream-user identification of active versus retired guidance; correct separation of contemporaneous evidence from hindsight; dependency ownership and closure. Pre-register safety outcomes: perceived blame, professional pressure to attend or speak, unauthorized attribution, false belief that policy or material obligations ended, and confidential-data exposure. Stop and do not repeat if administrative controls eliminate the problem before events, the wake does not outperform the comparator on either primary outcome, any safety outcome materially worsens, or the purported historical record cannot be independently verified.","blocking_evidence":["No bounded prevalence audit showing that superseded scenarios remain actively cited after adequate status labeling and downstream notice.","No named consortium, governance committee, records officer, or funder has expressed willingness to authorize and resource the intervention.","No evidence that residual use is caused by social or symbolic authority rather than contractual, regulatory, technical, search, or records-management dependencies.","No head-to-head field evidence against an equal-effort administrative supersession plus structured post-project review.","No validated measures or acceptable thresholds for informal scenario authority, hindsight reconstruction, blame pressure, or false closure in this setting.","No partner-specific legal and authority map covering records retention, privacy, confidential dissent, labor protections, public communications, and downstream control.","No local inventory, event frequency, loaded labor rate, or procurement data sufficient to narrow cost estimates."],"research_disposition":"PARTNERED_RESEARCH_PROGRAM","world_novelty_boundary":"This evaluation measured neither world novelty nor patentability, freedom to operate, market size, realized impact, or effect size. Bounded searches found substantial collision with formal records supersession, product-level scenario version history, continuous foresight revision, and ritualized post-project review. The only remaining research boundary is the scenario-specific incremental effect of witnessed symbolic discharge after those established controls are already complete.","arm":"COMPLETE_PROPOSAL_PORTFOLIO","candidate_version":0,"controller_recommendation":{"action":"STOP_EMPIRICAL_RESEARCH_NEEDED","repairable":false,"material_progress_observed":true,"progress_targets":["Complete a preregistered audit of superseded scenarios to estimate the exact problem's frequency after adequate administrative controls.","Secure a named partner's written authority, privacy/records determination, nonretaliation commitment, and independent stop authority.","Run the matched comparator pilot with equal administrative controls and equal facilitation time.","Demonstrate improvement in at least one preregistered primary outcome at both 30 and 90 days without worsening any safety threshold.","Obtain partner-specific cost and workload observations sufficient to replace the current low-confidence resource assumptions."],"reason":"Web research established credible adjacent need, implementability, identifiable authorizer classes, and substantial prior-art collision. It cannot determine whether adequately superseded scenarios retain residual social authority or whether the wake adds value beyond records controls and an established ritualized post-project review. Those questions require proprietary repository data, staff evidence, partner authorization, and live comparative testing."},"proposal_index":3}