{"schema_version":1,"experiment_id":"eoa_inverse_innovation_exp12_substrate_denial72_20260805","research_id":"eoa_inverse_innovation_exp12_light_screen_20260805","cell_id":"incentive_compatible_rule_design__chemistry_materials","search_lanes":{"direct_problem_and_intervention":{"queries":["materials science reproducibility cherry picking best sample batch variability selective reporting","materials qualification precommitted batches random specimen selection distribution score","materials science reporting best device champion device statistics reproducibility perovskite"],"source_ids":["SRC1","SRC4"],"no_result_note":null},"synonyms_and_historical_terms":{"queries":["materials selective reporting best sample batch-to-batch variability reproducibility","materials science survivorship bias hero sample reproducibility round robin","materials champion device reproducibility reporting distribution"],"source_ids":["SRC1","SRC2"],"no_result_note":null},"products_practices_and_standards":{"queries":["ASTM materials lot acceptance random sampling specimens quality conformance standard","NIST materials reproducibility batch variability reporting guidance","materials development stage gate independent verification readiness level","DOE technology readiness materials qualification independent testing batches"],"source_ids":["SRC2","SRC4"],"no_result_note":null},"component_combination":{"queries":["pre-registration materials science synthesis independent replication sample selection","acceptance sampling random samples lot variability qualification testing materials","registered reports results-blind publication incentive selective reporting official","materials qualification independent random specimen selection batch reproducibility"],"source_ids":["SRC1","SRC2","SRC3","SRC4"],"no_result_note":null}},"sources":[{"source_id":"SRC1","title":"Toward Reliable and Reproducible Research in Organic Photocatalysis by Carbon Nitride","publisher":"American Chemical Society","url":"https://iris.cnr.it/bitstream/20.500.14243/554376/1/grando-et-al-2025-toward-reliable-and-reproducible-research-in-organic-photocatalysis-by-carbon-nitride.pdf","source_type":"SECONDARY_RESEARCH","claims_supported":["Materials synthesis is affected by reproducibility problems and selective reporting.","The article identifies cherry-picking of small characterized portions as a materials-specific risk and recommends sampling multiple locations from a synthesized lot.","It recommends at least three independent syntheses, reporting dissimilarities and yields, and notes that repeatability information is rarely reported.","It distinguishes legitimate instrument, environment, procedural and material variability from reporting-related causes."]},{"source_id":"SRC2","title":"6.2.1. What is Acceptance Sampling?","publisher":"National Institute of Standards and Technology","url":"https://www.itl.nist.gov/div898/handbook/pmc/section2/pmc21.htm","source_type":"OFFICIAL_GUIDANCE","claims_supported":["Lot acceptance sampling draws a random sample and uses its results to accept or reject a lot.","Acceptance plans may use attributes or variables and are appropriate when complete inspection is destructive, costly or slow.","NIST distinguishes one-shot lot disposition from longer-run process quality control and process acceptability."]},{"source_id":"SRC3","title":"Registered Reports","publisher":"Nature Portfolio","url":"https://www.nature.com/collections/edjfhbfahf","source_type":"FIRST_PARTY_PRODUCT","claims_supported":["Registered Reports evaluate the research question and detailed study plan before data collection.","In-principle acceptance is based on the protocol, and compliant completed work is published regardless of the results.","This separates exploratory work from a precommitted confirmatory track and reduces outcome-contingent publication incentives."]},{"source_id":"SRC4","title":"Qualification for Additive Manufacturing Materials, Processes, and Parts","publisher":"National Institute of Standards and Technology","url":"https://www.nist.gov/programs-projects/qualification-additive-manufacturing-materials-processes-and-parts","source_type":"OFFICIAL_GUIDANCE","claims_supported":["Materials and processes for critical applications require sufficient data showing that they function as expected.","Statistical qualification based on empirical testing is an established path, alongside equivalence- and model-based qualification.","NIST promotes neutral test protocols, reference data and round-robin testing while leaving actual qualification decisions to the relevant regulators.","Qualification burden can be substantial, supporting attention to cost and participation constraints."]}],"problem_evidence":{"status":"PARTLY_SUPPORTED","finding":"The general problem is visible: materials researchers have documented synthesis irreproducibility, sparse reporting of independent repeats, cherry-picking of small portions, and the need to characterize distributions rather than isolated observations. Random lot sampling and statistical material qualification are established responses in quality practice. However, the retained sources do not empirically establish the proposal's narrower institutional diagnosis that materials R&D teams commonly exploit a funding or scale-up gate by privately observing sibling batches and submitting a post-result maximum. That incentive pathway remains a testable local hypothesis rather than a demonstrated prevalence claim.","source_ids":["SRC1","SRC2","SRC4"]},"closest_prior_art":[{"name":"Materials-synthesis replication and within-lot sampling recommendations","source_ids":["SRC1"],"overlap":"Calls out selective data reporting, recommends multiple independent syntheses, reporting batch dissimilarities and yields, and repeated measurements from sampling schemes across a synthesized lot.","remaining_difference":"It is reporting and experimental-practice guidance, not an incentive-compatible readiness rule with precommitted batch plans, independent coded selection, outcome-neutral completion support, bounded audits and appeal."},{"name":"Random lot acceptance sampling","source_ids":["SRC2"],"overlap":"Randomly selects units from a defined lot and bases an accept-or-reject decision on the sample instead of a producer-selected best unit.","remaining_difference":"It ordinarily presumes a defined production lot and sampling plan; it does not address undeclared research runs, exploratory-versus-qualification tracks, pre-result process-window commitments, completion reimbursement, or governance of omission disputes."},{"name":"Registered Reports","source_ids":["SRC3"],"overlap":"Precommits a protocol before results and makes the institutional reward less dependent on whether results are favorable while preserving room for exploratory work.","remaining_difference":"It governs publication rather than materials readiness and does not independently select coded specimens across batches, score a property distribution, reconcile batch records, or qualify a fabrication process."},{"name":"Statistical qualification of additive-manufacturing materials and processes","source_ids":["SRC4"],"overlap":"Uses extensive empirical data, protocols, neutral measurement infrastructure and round-robin testing to demonstrate that a material or process performs as expected.","remaining_difference":"The source does not specify a mechanism aimed at a privately informed originating team's strategic specimen selection, including outcome-neutral run reimbursement, concealed randomization, omission audits and independent appeal."}],"prior_art_disposition":"ADJACENT_PRIOR_ART","contrastive_claim_remaining":"In a materials program where post-result team control of specimen inclusion and a maximum-based reward materially causes selector-dependent advancement, the integrated package of a separate precommitted qualification track, independent concealed random selection across declared batches, distribution-based readiness scoring, and fixed valid-run reimbursement will reduce selector dependence and better predict independent resynthesis than extra team-selected replicates, metrology improvement, random sampling alone, or audit-only enforcement. The individual components are established or adjacent; the retained sources did not show this full incentive-and-governance combination as an established materials-R&D readiness practice.","contrastive_claim_falsifier":"The claim is falsified if, after controlling for instrument, operator, aging and legitimate process changes, team-selected and independently drawn specimens yield comparable gate distributions; complete batch capture already prevents advantageous omission; the selected maximum predicts downstream resynthesis at least as well as the proposed distribution score; or a non-decisional pilot shows no reduction in selector-dependent outcomes and instead increases undeclared runs, relabeling, invalid exclusions, legitimate-team withdrawal or unresolved measurement disputes.","gates":{"adequate_source_search":{"status":"PASS","rationale":"The bounded search covered direct formulations, older and synonymous concepts, established sampling and qualification practices, and combinations involving preregistration, outcome-neutral rewards, random selection and statistical qualification. Four opened sources from three publishers were retained, including official and first-party material. Exact-phrase misses were not treated as novelty evidence.","source_ids":["SRC1","SRC2","SRC3","SRC4"]},"supported_problem":{"status":"PASS","rationale":"The materials-specific reproducibility and selective-sampling problem is directly visible, while the narrower stage-gate incentive diagnosis is only partly supported and appropriately left for local testing. PARTLY_SUPPORTED satisfies this screen's problem-evidence condition.","source_ids":["SRC1","SRC2","SRC4"]},"distinct_testable_claim":{"status":"PASS","rationale":"Although replication, random acceptance sampling, preregistration and statistical qualification are established adjacent practices, the proposal retains a distinct falsifiable comparison: whether their integrated incentive design reduces selector-dependent readiness decisions and improves correspondence with independent resynthesis relative to named rivals.","source_ids":["SRC1","SRC2","SRC3","SRC4"]},"bounded_next_test":{"status":"PASS","rationale":"The proposed shadow analysis is limited to one material family, at most 12 completed gates and existing authorized records; it predefines reconstruction and scoring, changes no decisions, measures missingness, selector dependence, downstream correspondence and burden, and has explicit stopping criteria.","source_ids":["SRC2","SRC4"]},"no_obvious_safety_or_authority_stop":{"status":"PASS","rationale":"The authorized first step requires no new synthesis, destructive testing or altered qualification decision. It is confined to de-identified, already-authorized records with data-steward control and stopping rules. NIST also distinguishes development of measurement protocols from actual qualification authority, supporting the proposal's reservation of decisions to designated owners and regulators.","source_ids":["SRC4"]}},"screen_survival":true,"world_novelty_boundary":"This bounded public-web screen found adjacent prior art but cannot establish world novelty, patentability, freedom to operate, market size, expert acceptance, prevalence of the proposed incentive failure, realized value, or effectiveness in any specific materials program."}