{"schema_version":1,"research_id":"eoa_inverse_innovation_exp06_external_evaluation_20260803","source_assessment_id":"bounded_rivalry_governance__nanotechnology:P4:v0","cell_id":"bounded_rivalry_governance__nanotechnology","search_queries":["site:nist.gov nanoparticle size distribution interlaboratory comparison dynamic light scattering complex media","site:iso.org ISO TC 229 nanoparticle size distribution standards measurement","site:oecd.org nanomaterial particle size distribution test guideline 125","nanoparticle size measurement interlaboratory comparison complex matrices methods reproducibility","VAMAS guide interlaboratory study test method development official PDF nanoparticle","NanoDefine methods interlaboratory comparison particle size official European Commission","ISO 5725 interlaboratory precision standard official reproducibility","nanoparticle size methods measurand method dependent complex matrix reference method standardization review"],"sources":[{"source_id":"S1","title":"Test No. 125: Nanomaterial Particle Size and Size Distribution of Nanomaterials","publisher":"OECD","url":"https://www.oecd.org/en/publications/test-no-125-nanomaterial-particle-size-and-size-distribution-of-nanomaterials_af5f9bda-en.html","source_class":"OFFICIAL_GUIDANCE","publication_date":"2023-07-04","accessed_at":"2026-08-03","claims_supported":["Nanomaterial size and size-distribution measurement is important enough to have an OECD testing guideline.","Applicable techniques include AFM, CLS/AUC, DLS, DMAS, PTA/NTA, SAXS, SEM and TEM rather than one universal method.","Technique applicability depends on the particle characteristic being measured."]},{"source_id":"S2","title":"ISO/TC 229 — Nanotechnologies","publisher":"International Organization for Standardization","url":"https://www.iso.org/committee/381983.html","source_class":"OFFICIAL_ORGANIZATION_DATA","publication_date":"UNKNOWN","accessed_at":"2026-08-03","claims_supported":["ISO/TC 229 is an identifiable standards authorizer for nanotechnology metrology, instrumentation, reference materials and test methodologies.","ISO/TC 229 has a measurement-and-characterization working group and formal links with OECD and VAMAS.","The committee has an established standards portfolio and governance structure."]},{"source_id":"S3","title":"ISO 5725-2:2025 — Accuracy (trueness and precision) of measurement methods and results — Part 2","publisher":"International Organization for Standardization","url":"https://www.iso.org/standard/90054.html","source_class":"STANDARD","publication_date":"2025-12-18","accessed_at":"2026-08-03","claims_supported":["Balanced collaborative interlaboratory experiments are established practice for estimating repeatability and reproducibility.","The standard assumes laboratories analyze the same levels of test sample.","The approach can provide preliminary precision estimates for methods not yet standardized."]},{"source_id":"S4","title":"Nanotechnology","publisher":"European Commission Joint Research Centre","url":"https://joint-research-centre.ec.europa.eu/projects-and-activities/nanotechnology_en","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"UNKNOWN","accessed_at":"2026-08-03","claims_supported":["Industry and enforcement laboratories need fit-for-purpose particle-size methods to implement the European Commission nanomaterial definition.","Detection and quantification in complex matrices require specialized pretreatment and may use methods singly or in combination.","Reported particle-size measurements can affect regulatory classification, ingredient labeling and biological-impact research."]},{"source_id":"S5","title":"Interlaboratory comparison of nanoparticle size measurements between NMIJ and NIST using two different types of dynamic light scattering instruments","publisher":"National Institute of Standards and Technology","url":"https://www.nist.gov/publications/interlaboratory-comparison-nanoparticle-size-measurements-between-nmij-and-nist-using","source_class":"PRIMARY_RESEARCH","publication_date":"2019-08-06","accessed_at":"2026-08-03","claims_supported":["DLS results depend materially on scattering angle and particle concentration.","Two laboratories' results agreed after compensating for those methodological differences.","Preparation and configuration rules can change apparent interlaboratory comparability."]},{"source_id":"S6","title":"Interlaboratory Reproducibility of Size and Surface Charge Measurements on Nanoparticles prior to Biological Impact Assessment","publisher":"National Institute of Standards and Technology","url":"https://www.nist.gov/publications/interlaboratory-reproducibility-size-and-surface-charge-measurements-nanoparticles","source_class":"PRIMARY_RESEARCH","publication_date":"2011-06-03","accessed_at":"2026-08-03","claims_supported":["Detailed shipping, testing and reporting protocols enabled reproducible size measurements for monodisperse suspensions.","That conclusion did not extend to more polydisperse aggregated suspensions.","Ultrasonication increased variability in some cases, demonstrating preparation-dependent results and limits to transferability."]},{"source_id":"S7","title":"Versailles Project on Advanced Materials and Standards Interlaboratory Study on Measuring the Number Concentration of Colloidal Gold Nanoparticles","publisher":"National Institute of Standards and Technology","url":"https://www.nist.gov/publications/versailles-project-advanced-materials-and-standards-vamas-interlaboratory-study","source_class":"PRIMARY_RESEARCH","publication_date":"2022-03-09","accessed_at":"2026-08-03","claims_supported":["A 54-laboratory VAMAS study compared five nanoparticle measurement approaches using common protocols.","Observed reproducibility varied substantially by method, including 1.4–7 percent for several ensemble methods and much higher variability for particle-by-particle methods.","The study was explicitly intended to support method validation, documentary standards and reference materials.","Not all methods are suitable for every material or size range."]},{"source_id":"S8","title":"VAMAS Guidelines for the Design and Operation of Interlaboratory Comparisons","publisher":"Versailles Project on Advanced Materials and Standards","url":"https://www.vamas.org/documents/publications/2017_vamas_report_50_ILC_guidelines.pdf","source_class":"OFFICIAL_GUIDANCE","publication_date":"2017-05","accessed_at":"2026-08-03","claims_supported":["Predetermined interlaboratory comparisons for method-performance assessment are established pre-standardization practice.","VAMAS recommends defining one ILC objective in advance, using real-life stable materials, including nonexpert laboratories and imposing an unambiguous draft-standard-like protocol.","Different methods are preferable when necessary to reduce method-specific bias in an assigned reference value.","VAMAS recommends a small initial exercise, at least six to eight participants, independence checks, data-review rights and safety/IP agreements.","Its cooperative model expects less than one person-week of work from each participant but does not quantify organizer, material or instrument costs."]}],"problem_evidence":{"support":"STRONG","rationale":"Official regulatory and standards sources establish a consequential need for fit-for-purpose nanoparticle size measurements, particularly in complex matrices. Primary studies show that concentration, instrument geometry, preparation, polydispersity, operator transfer and method choice can materially affect comparability. Evidence supports the measurement problem, though it does not establish capture, collusion or systematic standards manipulation.","source_ids":["S1","S4","S5","S6","S7"]},"stakeholder_evidence":{"support":"MODERATE","rationale":"ISO/TC 229 is an identifiable authorizer with responsibility for nanotechnology measurement standards, while the European Commission JRC explicitly states that industry and enforcement laboratories need fit-for-purpose particle-size methods. No direct source requests a competitive, time-limited method league, held-out leaderboard or challenger-window governance package.","source_ids":["S1","S2","S4"]},"prior_art":{"proximity":"SUBSTANTIAL_COLLISION","closest_analogues":[{"name":"ISO 5725 balanced collaborative interlaboratory experiment","similarity":"Already specifies balanced interlaboratory designs using common sample levels to estimate repeatability and reproducibility.","remaining_difference":"It evaluates measurement precision; it does not create a scarce fixed-term designation, interoperability floor, held-out leaderboard, appeal process or challenger window.","source_ids":["S3"]},{"name":"VAMAS method-performance interlaboratory comparison","similarity":"Predetermines the objective and protocol, uses real-life stable materials, includes multiple qualified and nonexpert laboratories, checks independence and routes results toward standards organizations.","remaining_difference":"The proposed league adds rival scoring, provisional default status, non-compensable floors, proprietary-lock-in review and periodic recompetition.","source_ids":["S8"]},{"name":"VAMAS nanoparticle-population multi-method study","similarity":"Compared several nanoparticle measurement methods across 54 laboratories and generated reproducibility evidence intended to inform standards and reference materials.","remaining_difference":"It produced comparative validation evidence rather than awarding a default method or governing the winner's future power.","source_ids":["S7"]},{"name":"OECD Test Guideline 125","similarity":"Provides an official multi-method framework for nanoparticle size and size-distribution measurement.","remaining_difference":"It recognizes multiple techniques and applicability conditions rather than selecting one league winner for a narrowly defined regime.","source_ids":["S1"]}],"distinctive_claim_remaining":"For a narrowly frozen measurand and matrix regime, adding blinded independent execution, held-out auditing, non-compensable uncertainty/safety/portability floors, fixed-term status, lock-in review and a credible challenger window to an ordinary interlaboratory method comparison will produce a more transferable and contestable default than either committee selection or conventional ILC evidence alone. This incremental effect is falsifiable but unverified.","confidence":"HIGH"},"implementation_evidence":{"support":"MODERATE","rationale":"Balanced ILCs, common protocols, repeatability/reproducibility analysis, multi-method comparisons, small pilots and standards-development handoffs are established and technically feasible. Feasibility falls when methods operationalize different measurands, materials transform during preparation, archived data lack balanced candidate-by-laboratory observations, or composite ranking confounds method, operator and material effects. The governance additions and their incremental benefit have not been demonstrated.","source_ids":["S1","S3","S5","S6","S7","S8"]},"scores":{"meaningful_impact":{"score":4,"rationale":"Comparable particle-size results affect regulatory classification, labeling and nano-risk research; method-dependent results can therefore have meaningful downstream consequences.","source_ids":["S4","S5","S6"]},"stakeholder_pull":{"score":3,"rationale":"ISO/TC 229 and the JRC demonstrate institutional responsibility and demand for fit-for-purpose methods, but no adopter has expressed demand for this league design.","source_ids":["S2","S4"]},"incremental_advantage":{"score":2,"rationale":"Most experimental machinery is already present in ISO/VAMAS ILC practice. The claimed advantage comes from untested governance additions rather than a demonstrated measurement improvement.","source_ids":["S3","S7","S8"]},"distinctiveness_plausibility":{"score":2,"rationale":"The exact bundle is distinguishable, but its technical core substantially collides with established interlaboratory method validation and multi-method standardization practice.","source_ids":["S3","S7","S8"]},"technical_implementability":{"score":3,"rationale":"A prospective, narrowly scoped league is implementable with established ILC methods, but the proposed archived-data shadow analysis may lack the balanced design needed to separate method, laboratory and material effects.","source_ids":["S3","S7","S8"]},"adoption_authority_feasibility":{"score":3,"rationale":"ISO/TC 229 has relevant standard-setting authority and links to VAMAS, OECD and the European Commission, but no authorization for this specific process or access to required records is evidenced.","source_ids":["S2"]},"evidence_readiness":{"score":2,"rationale":"The candidate supplies a bounded shadow-study concept, but no named dataset, participating laboratories, candidate methods, data permissions or preregistered thresholds are available.","source_ids":["S3","S8"]},"safety_net_benefit":{"score":4,"rationale":"A non-designating archival shadow study, non-compensable floors, existing laboratory authority and rollback of provisional rankings substantially limit first-step harm; confidentiality and authority permissions remain unresolved.","source_ids":["S2","S8"]},"scalability":{"score":2,"rationale":"ILCs can span many laboratories, but reference panels, method-specific instruments, matrix preparation and governance must be rebuilt for each measurand regime, limiting cheap replication.","source_ids":["S1","S7","S8"]}},"score_confidence":"MODERATE","costs":{"first_evidence":{"band_2026_usd":"50K_TO_250K","scope":"Preregister and execute one non-designating archival shadow analysis with conflict screening, data normalization, statistical sensitivity analysis, simulated appeal and confidential reporting.","confidence":"LOW","assumptions":["Existing coded raw data and protocols are made available without purchase.","Three to six reviewers and one statistician contribute part-time for three to six months.","No new samples, instrument runs or standards changes occur.","Legal and secure-data work is limited."],"source_ids":["S3","S8"]},"initial_deployment_startup":{"band_2026_usd":"250K_TO_1M","scope":"Develop the formal rulebook, governance panels, data system, contracts, reference-panel plan, interoperability schema, conflict process and laboratory recruitment for a prospective league.","confidence":"LOW","assumptions":["Existing consortium administration and participating laboratory infrastructure are reused.","Instrument acquisition is excluded.","Reference-material development is limited to a bounded regime.","Costs include metrology, statistics, legal/IP, safety and project-management effort."],"source_ids":["S2","S7","S8"]},"operational_launch":{"band_2026_usd":"1M_TO_5M","scope":"Run one prospective multi-method league across approximately 8–15 independent laboratories and multiple matrices, including reference materials, shipping, instrument time, held-out audits and appeals.","confidence":"LOW","assumptions":["Laboratories already own the relevant instruments.","At least six to eight independent participants are required.","Complex-matrix preparation, calibration and sample custody are material cost drivers.","The range is a resource-equivalent estimate, not a vendor quote."],"source_ids":["S7","S8"]},"annual_recurring":{"band_2026_usd":"250K_TO_1M","scope":"Maintain governance, reporting schema, calibration-access monitoring, confidentiality controls, operational evidence review and challenger intake between periodic full leagues.","confidence":"LOW","assumptions":["A full prospective league is periodic rather than annual.","Existing consortium infrastructure hosts records and committees.","Major new reference-material development and instrument purchases are excluded."],"source_ids":["S2","S8"]}},"verified_pipeline_gates":{"externally_supported_problem":{"status":"YES","reason":"Official and primary evidence confirms a consequential need for comparable nanoparticle size measurements and documents material interlaboratory and method-dependent variability.","source_ids":["S1","S4","S5","S6","S7"]},"externally_credible_adopter_or_authorizer":{"status":"YES","reason":"ISO/TC 229 is a credible authorizer for nanotechnology metrology and test-method standards, and the JRC expresses a policy-facing need for fit-for-purpose methods. Adoption interest in this particular league remains unverified.","source_ids":["S2","S4"]},"distinct_testable_incremental_claim":{"status":"YES","reason":"The proposal can test whether its added audit, floor, transferability and contestability controls improve held-out qualification and decision stability relative to committee selection and an ordinary ISO/VAMAS-style ILC.","source_ids":["S3","S8"]},"bounded_next_evidence_step":{"status":"YES","reason":"A preregistered, non-designating analysis of one defined archived dataset can be bounded by method count, laboratory count, matrices, comparators, thresholds and rollback conditions.","source_ids":["S3","S8"]},"no_unresolved_safety_or_authority_stop":{"status":"UNCERTAIN","reason":"The archival step avoids nanoparticle handling, but the existence of lawful access to proprietary protocols, raw data, licensing terms and conflict records—and authorization by an actual consortium—has not been verified.","source_ids":["S2","S8"]},"credible_cost_scope_and_range":{"status":"UNCERTAIN","reason":"The bands have explicit scopes and resource assumptions, but sources provide design and participation guidance rather than contemporary organizer, material, instrument-time or legal cost data.","source_ids":["S7","S8"]}},"next_evidence_step":"With one named consortium and data owner, preregister a non-designating shadow study limited to at least three executable candidate methods, at least six independent laboratories and two prespecified complex matrices from existing coded records. Freeze the measurand, missing-data rules, safety/portability floors, score, audit subset and sensitivity grid before revealing identities. Compare (A) the proposed league score, (B) a conventional ISO 5725/VAMAS repeatability-and-reproducibility analysis without governance scoring, and (C) the existing committee designation. Progress only if the same qualifying leader survives the held-out audit and at least 80% of prespecified reasonable weight/panel analyses, sponsor-to-independent transfer does not materially worsen its uncertainty-adjusted performance, and a simulated appeal is resolvable from the record. Falsify interpretability if methods do not share a measurand, fewer than six independent laboratory datasets remain, method/laboratory/material effects cannot be separated, more than 20% of reasonable specifications reverse the winner, uncertainty intervals fail to account for material disagreements, or portability and licensing floors cannot be evaluated. This step requires proprietary data access and partner participation and authorizes no designation.","blocking_evidence":["No consortium has expressed demand for or authorized the proposed league.","No named archived dataset has been shown to contain balanced method-by-laboratory-by-matrix observations.","No evidence establishes that candidate techniques share one decision-relevant measurand rather than intentionally different size constructs.","No live comparison demonstrates incremental benefit over an ordinary ISO 5725/VAMAS interlaboratory comparison.","Data-access, confidentiality, licensing and conflict-record permissions are unverified.","Cost bands lack contemporary laboratory, reference-material, secure-data, legal and organizer quotations."],"research_disposition":"PARTNERED_RESEARCH_PROGRAM","world_novelty_boundary":"World novelty, patentability, freedom to operate, market size and realized impact were not measured. The search establishes substantial collision with known interlaboratory method-validation practice but cannot determine whether the exact governance bundle has ever been implemented worldwide.","arm":"COMPLETE_PROPOSAL_PORTFOLIO","candidate_version":0,"controller_recommendation":{"action":"STOP_EMPIRICAL_RESEARCH_NEEDED","repairable":false,"material_progress_observed":true,"progress_targets":["Secure written authorization from one named standards consortium and lawful access from the relevant data owners.","Inventory a dataset meeting the minimum method, laboratory, matrix, calibration, uncertainty and operator-deviation requirements.","Preregister the league, conventional-ILC and current-designation comparators with numerical progression and falsification thresholds.","Complete independent metrology review confirming that all candidates address one decision-relevant measurand.","Obtain bottom-up 2026 quotations or documented resource commitments for statistical work, secure data handling, laboratory time, reference materials, legal/IP review and governance.","Run the bounded shadow study and report all rank reversals, floor failures, missingness, transfer effects and appeal outcomes."],"reason":"Bounded web research verifies the measurement problem, a credible standards authority and strong prior-art overlap. It cannot determine whether the proposed governance additions improve selection because that requires proprietary archived records, partner authorization and a comparative shadow or prospective trial. Under the required controller rule, that field and proprietary-data dependency requires an empirical-research stop."},"proposal_index":4}