{"schema_version":1,"research_id":"eoa_inverse_innovation_exp06_external_evaluation_20260803","source_assessment_id":"catalytic_pathway_enablement__criminology_forensic:P4:v0","cell_id":"catalytic_pathway_enablement__criminology_forensic","search_queries":["site:ojp.gov evidence room disposition retention property disposal audit backlog official","site:nist.gov forensic evidence retention disposition standard property room","site:legislature.ca.gov Penal Code biological evidence retention post conviction disposition","evidence management software disposition workflow property room first party","2025 2026 law enforcement evidence management system contract award cost physical property room software","site:gov evidence management system RFP budget property evidence software","site:bls.gov police evidence technician records specialist wage 2025","ANSI ASB standard evidence management disposition forensic property","\"property room evidence management system\" \"$772,481.21\" Dallas","site:dallascityhall.com \"property room evidence management system\" Omnigo 772481","site:gov \"evidence disposition\" \"property room\" workflow software approval requests"],"sources":[{"source_id":"S1","title":"Evidence Management Steering Committee Report: Opportunities to Strengthen Evidence Management Processes (NIST SP 1500-33A)","publisher":"National Institute of Standards and Technology / National Institute of Justice Evidence Management Steering Committee","url":"https://doi.org/10.6028/NIST.SP.1500-33A","source_class":"OFFICIAL_GUIDANCE","publication_date":"2025-09","accessed_at":"2026-08-03","claims_supported":["Disposition is an ongoing review of retention status based on case status, statutes, and organizational policy.","Organizations need systematic, proactive disposition review, and interoperable electronic systems can simplify requests and authorizations.","Electronic systems can automate authorization prompts, documentation, chain-of-custody updates, and audit reports.","Blanket disposition creates erroneous-release or destruction risk; investigative personnel and governing law must remain authoritative."]},{"source_id":"S2","title":"Evidence Management Steering Committee Report: Results of the 2021 National Evidence Handlers Survey (NIST SP 1500-33B)","publisher":"National Institute of Standards and Technology / National Institute of Justice Evidence Management Steering Committee","url":"https://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.1500-33B.pdf","source_class":"PRIMARY_RESEARCH","publication_date":"2025-09","accessed_at":"2026-08-03","claims_supported":["Among 1,093 respondents, disposition or retention commonly depended on statutes or regulations (69%), court orders (67%), organizational policy (61%), investigator authorization (59%), and offense type (55%).","Among 1,090 respondents, disposition was triggered by court order (54%), statutory requirements (49%), organizational policy (49%), need for space (39%), and electronic tracking (34%).","Twenty-two percent reported initiating disposition when the organization had time, and 8% did not know what triggered it.","The report identifies variable practices and uncertainty as contributors to disposition backlogs."]},{"source_id":"S3","title":"The Biological Evidence Preservation Handbook: Best Practices for Evidence Handlers (NISTIR 7928)","publisher":"National Institute of Standards and Technology and National Institute of Justice","url":"https://nvlpubs.nist.gov/nistpubs/ir/2013/NIST.IR.7928.pdf","source_class":"OFFICIAL_GUIDANCE","publication_date":"2013-04","accessed_at":"2026-08-03","claims_supported":["Holding agencies must confirm case status and local retention-law requirements before disposition.","Some agencies retrieve status electronically while others manually investigate across courts, prosecutors, investigators, and owners.","The handbook supplies a disposition-review form, recommends annual eligibility review, designated sign-off authority, documentation, and evidence-management-system updates.","Timely lawful disposition matters because otherwise property rooms become overcrowded."]},{"source_id":"S4","title":"California Penal Code Section 1417.9 — Disposition of Evidence in Criminal Cases","publisher":"California Legislative Information","url":"https://leginfo.legislature.ca.gov/faces/codes_displaySection.xhtml?lawCode=PEN&sectionNum=1417.9.","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"2019-01-01","accessed_at":"2026-08-03","claims_supported":["Biological material generally must be retained while a person remains incarcerated in connection with the case.","Early disposition requires notice to specified parties, a 180-day response period, absence of enumerated post-conviction claims, and confirmation that no other law requires retention.","The statutory right to notice is absolute and cannot be waived.","A clearance workflow must be jurisdiction-specific and cannot infer clearance from silence before applicable notice and waiting requirements are satisfied."]},{"source_id":"S5","title":"Ohio Property and Evidence Room Best Practices Manual","publisher":"Ohio Attorney General","url":"https://ohioattorneygeneral.gov/Files/Publications-Files/Publications-for-Law-Enforcement/Propery-Evidence-Room-Manual_WEB","source_class":"OFFICIAL_GUIDANCE","publication_date":"2022","accessed_at":"2026-08-03","claims_supported":["Agencies should preserve evidence under law, court requirements, and retention schedules while maintaining inventory and chain-of-custody documentation.","Policies must be tailored to agency needs and governing law with legal-counsel review.","Disposition requires checks and balances, trained staff, retention schedules, special-item instructions, defined authorizers, and completed records.","Evidence-room systems may range from databases to manual logs, and agencies must measure items received and purged because persistent net inflow exhausts storage."]},{"source_id":"S6","title":"City of Dallas Legislation Details With Text, File 24-2422","publisher":"City of Dallas","url":"https://cityofdallas.legistar.com/ViewReport.ashx?Extra=WithText&GID=713&GUID=5CB98FB8-51D4-410C-86E7-C93E189414C4&ID=6829482&M=R&N=Master&Title=Legislation+Details+%28With+Text%29","source_class":"OFFICIAL_ORGANIZATION_DATA","publication_date":"2024-09-11","accessed_at":"2026-08-03","claims_supported":["Dallas approved a five-year property-room evidence-management-system contract with two optional renewal years, not to exceed $772,481.21.","The system tracks receipt, storage, transfer, and disposal and automatically sends disposal-approval requests.","Dallas identified time savings over its previous process and included barcode and signature hardware.","The property unit processes about 100,000 incoming items annually, demonstrating an identifiable adopter and high-volume operating context."]},{"source_id":"S7","title":"Addendum No. 1: Audit/Inventory Services — Police Evidence RFP","publisher":"City of Methuen, Massachusetts","url":"https://www.methuen.gov/DocumentCenter/View/2608","source_class":"OFFICIAL_ORGANIZATION_DATA","publication_date":"2024-02-28","accessed_at":"2026-08-03","claims_supported":["Methuen sought an external audit of approximately 6,000 evidence items with an expected cost below $120,000.","Records were divided between two RMS products, and evidence was also held at laboratories, court, and the district attorney's office.","The city was still trying to confirm the accuracy of information about evidence outside the department.","The procurement demonstrates demand for evidence reconciliation and provides a one-time evidence-work cost analogue."]},{"source_id":"S8","title":"Physical Evidence Management System","publisher":"Omnigo Software","url":"https://www.omnigo.com/solution/evidence-management-software/physical?hsCtaAttrib=169003108453","source_class":"COMMERCIAL_FIRST_PARTY","publication_date":"undated","accessed_at":"2026-08-03","claims_supported":["A marketed evidence-management product already provides guided workflows, authorization tracking, dashboards, audits, and statistical reporting.","Its disposition features set dates from incident and legal-timeline information, initiate retention or disposal review, email authorization requests, and add approvals to an audit trail.","The product is direct prior art for much of the proposed workflow, dashboard, authorization, and audit functionality.","Vendor capability claims are first-party and do not independently establish accuracy or comparative benefit."]}],"problem_evidence":{"support":"STRONG","rationale":"National survey data shows that disposition depends on multiple authorities and heterogeneous rules, with material uncertainty and time-dependent initiation. NIST guidance describes recurring case-status reconstruction, manual investigation, overcrowding, and a need for proactive review. Dallas and Methuen demonstrate substantial real inventories and active spending on tracking, reconciliation, approval, and audit capabilities.","source_ids":["S1","S2","S3","S5","S6","S7"]},"stakeholder_evidence":{"support":"STRONG","rationale":"Law-enforcement executives, evidence custodians, investigators, prosecutors, courts, and legal counsel are explicitly identified as stakeholders or authorizers. Dallas is a named adopter that approved a $772,481.21 system contract, while Methuen funded an evidence audit and reconciliation procurement. NIST/NIJ guidance expressly calls for adoption of improved evidence-management processes.","source_ids":["S1","S2","S3","S5","S6","S7"]},"prior_art":{"proximity":"ESTABLISHED_PRACTICE","closest_analogues":[{"name":"NIST/NIJ Phase E disposition process","similarity":"Defines ongoing status review using case systems, court records, criminal-justice databases, legal rules, documented authorization, audits, and potentially automated interoperable systems.","remaining_difference":"The candidate packages these elements as a fail-closed cleared/blocked/indeterminate certificate service with explicit per-cycle state and credential reset; NIST does not validate that exact implementation or performance claim.","source_ids":["S1"]},{"name":"NISTIR 7928 biological-evidence disposition workflow","similarity":"Already prescribes status confirmation, named authorities, a disposition-review form, periodic review, final sign-off, notification, and record updates.","remaining_difference":"The candidate adds versioned multi-source orchestration, explicit indeterminate output, connector monitoring, and a turnover/selectivity assay.","source_ids":["S3"]},{"name":"Omnigo physical evidence-management system","similarity":"Commercially provides disposition dates, guided review, automated authorization requests, dashboards, audit trails, and evidence-lifecycle reporting.","remaining_difference":"Public documentation does not establish the candidate's exhaustive jurisdiction-specific dependency checks, fail-closed handling of silence/conflicts, per-cycle credential reset, or comparative accuracy.","source_ids":["S8"]},{"name":"Dallas property-room evidence-management deployment","similarity":"An operational purchaser selected a hosted system for tracking evidence through disposal, automatically requesting approvals, supporting signatures, and reducing process time.","remaining_difference":"The public contract description does not disclose item-level logic, post-conviction checks, indeterminate routing, credential regeneration, error rates, or workload externalization.","source_ids":["S6"]},{"name":"Ohio evidence-room policies and controls","similarity":"Uses written procedures, retention schedules, defined authorizers, checks and balances, evidence-management software, audits, and documented disposition evaluation.","remaining_difference":"It is policy-level guidance rather than a tested multi-authority certificate assembler.","source_ids":["S5"]}],"distinctive_claim_remaining":"Relative to ordinary manual review and an existing evidence-management-system disposition workflow under identical legal rules and final authority, a jurisdiction-configured, fail-closed multi-source certificate lane will reduce median hands-on review time by at least 30% without any false clearance, missed hold or notice, increased false-blocking beyond a preregistered margin, material workload transfer to prosecutors/courts/laboratories, or failure to clear temporary data and credentials after each cycle.","confidence":"HIGH"},"implementation_evidence":{"support":"MODERATE","rationale":"The component technologies and workflow practices—case-system queries, rule templates, notifications, signatures, role controls, audit trails, dashboards, and disposition tracking—are established and commercially deployed. Feasibility remains conditional on jurisdiction-specific legal mapping, authoritative-source access, identity reconciliation, current responses, security controls, and custodian independence. No direct evidence verifies the complete proposed certificate logic, per-cycle reset, or safety performance.","source_ids":["S1","S3","S4","S5","S6","S8"]},"scores":{"meaningful_impact":{"score":4,"rationale":"Evidence inventories are large, storage is finite, property returns can be delayed, and erroneous destruction can impair rights and justice. The intervention addresses an important operational and safety-sensitive lifecycle stage.","source_ids":["S1","S2","S3","S5","S6"]},"stakeholder_pull":{"score":5,"rationale":"Official guidance calls for systematic improvement, and Dallas and Methuen document funded procurements for closely related systems and services.","source_ids":["S1","S6","S7"]},"incremental_advantage":{"score":2,"rationale":"Most workflow, authorization, dashboard, audit, and disposition functions are already recommended or sold. Incremental advantage is confined to fail-closed multi-source certification, explicit indeterminate routing, regeneration checks, and a rigorous comparative assay.","source_ids":["S1","S3","S6","S8"]},"distinctiveness_plausibility":{"score":2,"rationale":"The narrow remaining configuration may differ from publicly documented systems, but public materials are insufficient to exclude equivalent configurable workflows in existing products or agencies.","source_ids":["S1","S3","S8"]},"technical_implementability":{"score":4,"rationale":"The underlying workflow and software capabilities are established. Harder elements are data interoperability, authoritative identity matching, connector reliability, access control, and rule-version governance rather than basic technical possibility.","source_ids":["S1","S6","S8"]},"adoption_authority_feasibility":{"score":3,"rationale":"Police leadership and evidence custodians can authorize a shadow trial, but operational certificates depend on investigators, prosecutors, courts, laboratories, counsel, statutes, and potentially defense or post-conviction notice rights.","source_ids":["S1","S2","S3","S4","S5"]},"evidence_readiness":{"score":3,"rationale":"Problem prevalence, workflow feasibility, adopters, and prior art are well supported. Comparative accuracy, burden reduction, reset reliability, legal completeness, and workload displacement remain unmeasured.","source_ids":["S1","S2","S3","S6","S7","S8"]},"safety_net_benefit":{"score":4,"rationale":"Fail-closed outputs, independent custodian authority, shadow testing, auditability, and manual rerouting could materially reduce premature disposition risk. Benefit is prospective because these controls have not been tested as a combined system.","source_ids":["S1","S3","S4","S5"]},"scalability":{"score":3,"rationale":"Reusable software and templates can scale within a jurisdiction, but each jurisdiction, evidence class, source system, retention rule, and authorizer set requires validation and ongoing refresh.","source_ids":["S1","S2","S4","S6","S8"]}},"score_confidence":"MODERATE","costs":{"first_evidence":{"band_2026_usd":"10K_TO_50K","scope":"Preregister, configure, and execute a nonoperational 40-record shadow study using 20 synthetic and 20 previously resolved records, blinded dual review, security controls, legal review, and analysis; no live connectors or physical disposition.","confidence":"MODERATE","assumptions":["Agency staff and counsel contribute limited in-kind time.","Historical records can be approved and de-identified without major discovery or litigation expense.","The Methuen sub-$120,000 budget for auditing roughly 6,000 items bounds a much smaller record-level study but is not a direct quote.","Estimate is a 2026-USD resource equivalent, not a vendor price."],"source_ids":["S3","S7"]},"initial_deployment_startup":{"band_2026_usd":"50K_TO_250K","scope":"One-agency legal/rule mapping, workflow configuration, role and credential design, limited connectors or structured imports, threat/privacy review, training, acceptance testing, and rollback preparation.","confidence":"LOW","assumptions":["One jurisdiction and a narrow initial evidence class.","Existing RMS, identity, and audit infrastructure can be reused.","No major court or prosecutor system replacement is included.","Dallas's larger contract and Omnigo's demonstrated feature set are analogues, not scoped quotations."],"source_ids":["S1","S5","S6","S8"]},"operational_launch":{"band_2026_usd":"250K_TO_1M","scope":"Production hardening for a medium-to-large agency, multiple authoritative integrations, migration/configuration, security and availability controls, hardware where needed, staff training, independent validation, incident response, and initial operating support.","confidence":"MODERATE","assumptions":["Launch includes integration and implementation labor in addition to licensing.","Scale is materially below a statewide platform but may approach Dallas's 100,000-item-per-year environment.","The Dallas not-to-exceed $772,481.21 five-year contract is the principal public cost anchor.","Physical storage expansion and disposition labor are excluded."],"source_ids":["S1","S6","S8"]},"annual_recurring":{"band_2026_usd":"50K_TO_250K","scope":"Hosting or licensing, connector and rule maintenance, security monitoring, help desk, training refresh, audits, legal updates, and part-time quality stewardship for one agency.","confidence":"MODERATE","assumptions":["Dallas's five-year ceiling averages about $154,000 annually before optional renewals, although its payment schedule and scope are not itemized.","Existing agency custodians retain final authority and ordinary disposition duties.","Material redesign after statutory change, litigation, or security incident is excluded.","Estimate is a 2026-USD resource-equivalent band, not an inflation-adjusted contract quote."],"source_ids":["S1","S5","S6","S8"]}},"verified_pipeline_gates":{"externally_supported_problem":{"status":"YES","reason":"Primary survey data, official guidance, and agency procurements independently show multi-authority disposition complexity, inconsistent processes, storage pressure, and reconciliation work.","source_ids":["S1","S2","S3","S5","S6","S7"]},"externally_credible_adopter_or_authorizer":{"status":"YES","reason":"Dallas Police Department is an identified adopter with an approved evidence-management contract; evidence custodians, investigators, prosecutors, courts, counsel, and agency executives are identifiable authorizers or stakeholders.","source_ids":["S1","S3","S5","S6","S7"]},"distinct_testable_incremental_claim":{"status":"YES","reason":"The remaining claim is narrowly testable against manual review and an existing disposition module on time, false clearance, false blocking, missed dependencies, externalized workload, audit completeness, and state reset. Distinctiveness from proprietary configurations remains uncertain.","source_ids":["S1","S3","S6","S8"]},"bounded_next_evidence_step":{"status":"YES","reason":"A 40-record, no-physical-action shadow comparison with preregistered comparators, metrics, and stop criteria is bounded and reversible.","source_ids":["S1","S3","S4","S5"]},"no_unresolved_safety_or_authority_stop":{"status":"YES","reason":"The proposed next step can use synthetic and previously resolved records, produce no operational authorization, and leave physical evidence untouched. Operational deployment would still require jurisdiction-specific legal approval and independent custodian authority.","source_ids":["S1","S3","S4","S5"]},"credible_cost_scope_and_range":{"status":"YES","reason":"Official Methuen and Dallas procurements bound one-time evidence work and multi-year evidence-management deployment, supporting broad bands despite low confidence in allocation among software, integration, and labor.","source_ids":["S6","S7"]}},"next_evidence_step":"With written approval from an evidence custodian, agency counsel, privacy/security officer, and participating record authorities, preregister a shadow study on 20 synthetic records spanning clear, active hold, notice-pending, identifier conflict, ownership dispute, stale response, exceptional retention, and downstream-capacity conditions plus 20 separately approved previously resolved records. Have blinded reviewers process every record through (A) ordinary review and (B) the proposed lane; where available, add (C) the agency's existing commercial disposition workflow. Use an independent legal/custodial reference panel as ground truth. Measure false clearance, false blocking, correct indeterminate routing, missed dependencies, staff touches, hands-on and elapsed time, source freshness, workload transferred to each external office, audit completeness, and successful temporary-data/credential reset. Pass only with zero false clearances and missed mandatory holds/notices, 100% correct block or indeterminate classification for every uncertainty case, at least 30% lower median hands-on time than both applicable comparators, no more than 10% added external-office labor, and complete audit and reset evidence for all 40 cycles. Falsify the incremental claim upon any false clearance, authority inference from silence, missed mandatory dependency, unresolved identifier cross-link, reset failure, material externalized workload, or failure to meet the time threshold.","blocking_evidence":["No field measurement establishes that repeated dossier reconstruction, rather than active holds, mandatory retention, missing authoritative records, ownership disputes, unavailable recipients, or downstream capacity, is the dominant local bottleneck.","No public feature-level comparison excludes equivalent fail-closed, multi-authority certificate workflows in configurable commercial products.","No live or shadow test establishes false-clearance, false-blocking, indeterminate-routing, audit, or reset performance.","No jurisdiction-specific legal and authority matrix has been independently approved for an adopting agency.","No source-access agreements, security assessment, privacy analysis, or connector-reliability evidence has been produced.","No scoped implementation quote separates software, integration, legal review, staff time, and annual maintenance.","Realized impact, market size, world novelty, patentability, and freedom to operate remain unmeasured."],"research_disposition":"PARTNERED_RESEARCH_PROGRAM","world_novelty_boundary":"Bounded web research establishes that systematic evidence-disposition review, electronic authorization, audit trails, status checks, dashboards, and commercial disposition workflows are established practice. It does not establish whether the exact fail-closed multi-source certificate architecture with per-cycle credential/data regeneration has been implemented elsewhere. World novelty, patentability, freedom to operate, market size, and realized impact were not measured.","arm":"COMPLETE_PROPOSAL_PORTFOLIO","candidate_version":0,"controller_recommendation":{"action":"STOP_EMPIRICAL_RESEARCH_NEEDED","repairable":false,"material_progress_observed":true,"progress_targets":["Secure written shadow-study authorization from a custodian, agency counsel, privacy/security lead, and required record authorities.","Preregister the three-arm or two-arm protocol, ground-truth procedure, thresholds, workload-accounting method, and immediate stop rules.","Complete the 40-record shadow comparison with zero physical disposition and preserve case-level audit evidence.","Demonstrate zero false clearances and missed mandatory holds or notices, correct uncertainty routing, at least 30% lower median hands-on time, no material workload displacement, and successful reset on every cycle.","Produce an approved jurisdiction-specific authority and retention matrix plus source-access, security, privacy, and rollback documentation.","Obtain a scoped vendor or internal implementation estimate and differentiate the proposed lane from the adopting agency's existing evidence-management features."],"reason":"Web evidence strongly verifies the problem, adopters, authority structure, technical components, and extensive established prior art. It cannot determine whether the narrow incremental workflow improves speed without false clearance, burden shifting, or reset failure. Those questions require protected records, agency participation, and live or shadow testing, so further bounded web research cannot close the decisive evidence gap."},"proposal_index":4}