{"schema_version":1,"research_id":"eoa_inverse_innovation_exp06_external_evaluation_20260803","source_assessment_id":"predictive_residual_processing__environmental_climate:P3:v0","cell_id":"predictive_residual_processing__environmental_climate","search_queries":["site:epa.gov OIG Title V permit renewal backlog outdated permits workload review applications","site:epa.gov Title V permit application renewal complete application requirements 40 CFR Part 70","environmental permitting document comparison prior permit application changes renewal software regulator","site:gov.uk environmental permit variation application highlight changes previous permit regulator guidance","site:epa.gov title V permit renewal timely issuance backlog 2024 OIG","site:gao.gov air permit renewal backlog Title V permits expired backlog","EPA 2026 guidance streamlining Title V operating permit renewals changes prior application incorporation by reference","software compare environmental permit applications renewal changes regulator digital permitting","eCFR 40 CFR 70.5 permit applications complete renewal responsible official certification emissions monitoring requirements","site:epa.gov CROMERR electronic reporting records integrity authenticity permit applications requirements","site:epa.gov title V program evaluation backlog permits expired 2025 PDF","semantic document comparison prior art regulatory applications change detection permit review research","official document comparison software semantic changes tables PDF Word compare product documentation redline","site:litera.com Litera Compare document comparison detect changes PDF Word official","site:draftable.com document comparison official PDF Word changes","site:opengov.com permitting software application review workflows environmental permits","site:govinfo.gov/content/pkg/CFR-2025-title40-vol17/pdf CFR 70.5 permit applications PDF","site:govinfo.gov 40 CFR 70.5 permit applications current 2025","site:law.cornell.edu/cfr/text/40/70.5 permit applications","government digital environmental permit application forms copy previous application reduce duplication structured review renewals","site:gov.uk digital environmental permitting service application renewal structured forms regulator","site:epa.gov electronic permit application system title V permit renewal state online","site:ontario.ca environmental permissions online application renewal digital service changes"],"sources":[{"source_id":"S1","title":"Guidance on Streamlining Clean Air Act Title V Operating Permit Renewals","publisher":"U.S. Environmental Protection Agency","url":"https://www.epa.gov/system/files/documents/2026-04/guidance-on-streamlining-clean-air-act-title-v-operating-permit-renewals.pdf","source_class":"OFFICIAL_GUIDANCE","publication_date":"2026-04-17","accessed_at":"2026-08-03","claims_supported":["EPA expressly encourages renewal streamlining around new or different requirements.","Unchanged material may be cross-referenced or incorporated from previous applications while remaining available for public review.","Permitting authorities retain discretion to request supplemental information, and renewal procedural requirements remain applicable."]},{"source_id":"S2","title":"2024 EPA Air Program Title V Program Evaluation for Rhode Island","publisher":"U.S. Environmental Protection Agency, Region 1","url":"https://www.epa.gov/system/files/documents/2024-11/title-v-program-evaluation-2024-ri.pdf","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"2024","accessed_at":"2026-08-03","claims_supported":["RI DEM reported 11 expired permits among 24 Title V sources, including eight more than 24 months old.","The program identified insufficient staff as its largest internal resource roadblock.","One full-time permit writer expected to complete only three to four permits per year, visibly establishing capacity pressure."]},{"source_id":"S3","title":"40 CFR Part 70—State Operating Permit Programs, including §70.5 Permit Applications","publisher":"U.S. Government Publishing Office","url":"https://www.govinfo.gov/content/pkg/CFR-2025-title40-vol17/pdf/CFR-2025-title40-vol17-part70.pdf","source_class":"STANDARD","publication_date":"2025-07-01","accessed_at":"2026-08-03","claims_supported":["Title V sources must submit timely and complete applications; renewal applications generally precede expiration by at least six months.","Applications must contain information sufficient to evaluate the source and determine applicable requirements.","Permit revisions need supply information related to the proposed change, but responsible-official certification and authority to request additional information remain."]},{"source_id":"S4","title":"Overview for CROMERR","publisher":"U.S. Environmental Protection Agency","url":"https://www.epa.gov/cromerr/overview-cromerr","source_class":"OFFICIAL_GUIDANCE","publication_date":"2005-10-13; updated 2026-03-19","accessed_at":"2026-08-03","claims_supported":["Covered state, local and tribal electronic-report receiving systems require EPA approval before production.","CROMERR criteria address copy of record, document integrity, repudiation opportunity, signatures and signer identity.","Custom systems can face lengthy review and significant changes, whereas shared or off-the-shelf approaches reduce compliance burden."]},{"source_id":"S5","title":"Title V Renewal Application Review: Packaging Corporation of America, TV-583567","publisher":"Georgia Environmental Protection Division, hosted by U.S. Environmental Protection Agency","url":"https://www.epa.gov/system/files/documents/2025-01/pdf-vn-583567.pdf","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"2025-01-15","accessed_at":"2026-08-03","claims_supported":["An actual regulatory renewal review already performs comparative review against permit files and intervening amendments and off-permit changes.","The review uses condition-by-condition crosswalks identifying unchanged, deleted, modified or added conditions and explains their provenance.","This is close domain-specific prior art for baseline-relative review, although it does not show consequence-weighted automated triage or independent audits of omitted sections."]},{"source_id":"S6","title":"Environmental permits: when and how you are charged","publisher":"UK Environment Agency and Department for Environment, Food & Rural Affairs","url":"https://www.gov.uk/government/publications/environmental-permitting-charges-guidance/environmental-permitting-charges-guidance","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"2026-04","accessed_at":"2026-08-03","claims_supported":["Environmental-permit changes are already tiered as administrative, minor, normal or substantial according to assessment effort and environmental or health risk.","Time-and-materials rates include technical work, support and overhead, providing a rough labor-cost anchor.","The official workflow distinguishes changes requiring little or no technical assessment from changes requiring significant assessment and consultation."]},{"source_id":"S7","title":"Litera Compare Product Overview","publisher":"Litera","url":"https://www.litera.com/store/litera-compare","source_class":"COMMERCIAL_FIRST_PARTY","publication_date":"undated","accessed_at":"2026-08-03","claims_supported":["Commercial software already compares whole documents or snippets across text, images, tables, charts and comments.","It produces structured change summaries by type and quantity and preserves redline outputs.","Generic comparison technology is technically available, but the vendor page does not validate emissions-domain semantics, completeness or rare-event recall."]},{"source_id":"S8","title":"Title V Petitions","publisher":"U.S. Environmental Protection Agency","url":"https://www.epa.gov/title-v-operating-permits/title-v-petitions","source_class":"OFFICIAL_GUIDANCE","publication_date":"2026","accessed_at":"2026-08-03","claims_supported":["Members of the public may petition EPA to object to a new, modified or renewed Title V permit after raising concerns during notice and comment.","A granted petition requires the permitting authority to correct or rectify the permit issue.","Public challenge and EPA review make retention of the authoritative filing, traceable reasoning and human decision authority material safeguards."]}],"problem_evidence":{"support":"STRONG","rationale":"The problem is visible in both policy and operational data. EPA's 2026 guidance expressly seeks to concentrate effort on new or changing requirements, while the Rhode Island evaluation documents an 11-permit backlog among only 24 sources, eight cases older than 24 months, and insufficient staff. The evidence strongly supports constrained permit-review capacity and repeated unchanged material, although it does not establish prevalence or magnitude across all emissions programs.","source_ids":["S1","S2","S3"]},"stakeholder_evidence":{"support":"STRONG","rationale":"EPA identifies state, local and tribal permitting authorities as the implementers and explicitly urges renewal streamlining so their resources focus on substantive changes. RI DEM is an identifiable potential adopter with a documented backlog and dedicated permit writer. This is strong pull for the broad objective, but no source commits an authority to the candidate's exact automated, consequence-weighted and audited design.","source_ids":["S1","S2"]},"prior_art":{"proximity":"SUBSTANTIAL_COLLISION","closest_analogues":[{"name":"EPA Title V renewal streamlining guidance","similarity":"Uses the prior application as reusable baseline material and directs attention toward requirements that are new or different while preserving public availability and supplemental-information authority.","remaining_difference":"It does not prescribe regulator-generated field residuals, consequence weighting, cumulative-error budgets, reconstruction tests or independent random full-section audits.","source_ids":["S1","S3"]},{"name":"Georgia EPD Title V Renewal Application Review crosswalk","similarity":"A real renewal review compares application and permit files, inventories amendments and off-permit changes, and classifies conditions as unchanged, deleted, modified or added with explanations.","remaining_difference":"The public dossier does not establish automated comparison, attention-suppression rules, uncertainty weighting, cumulative residual triggers or randomized auditing of sections omitted from reviewer attention.","source_ids":["S5"]},{"name":"UK Environment Agency variation classification","similarity":"Routes permit changes into administrative, minor, normal and substantial paths according to technical-assessment effort and environmental or health risk.","remaining_difference":"It classifies applicant-declared variations rather than generating regulator-owned residuals across a complete renewal dossier and auditing what the triage omitted.","source_ids":["S6"]},{"name":"Litera Compare","similarity":"Compares heterogeneous document elements and supplies structured change summaries and redlines, demonstrating generic document-difference tooling.","remaining_difference":"It is not an emissions-permit decision system and supplies no verified regulatory baseline, consequence model, cumulative-change logic, protected bypass or independent completeness audit.","source_ids":["S7"]}],"distinctive_claim_remaining":"Against both ordinary full-dossier review and the existing manual permit-condition crosswalk, a regulator-owned structured residual workflow with protected bypasses, cumulative-change rules and independent random full-section audits can reduce specialist review time while remaining non-inferior for consequential-change detection and reconstruction. This is contrastive and falsifiable, but neither world novelty nor practical advantage has been demonstrated.","confidence":"HIGH"},"implementation_evidence":{"support":"MODERATE","rationale":"Required records, comparison targets and regulatory authority exist; a real regulator already constructs detailed permit-condition crosswalks, commercial tools compare heterogeneous documents, and CROMERR provides an approval path for record integrity. However, semantic comparison of changing schemas and narratives, consequence calibration, applicant gaming resistance, cumulative-change detection, confidentiality handling, workflow integration and audit sampling remain unvalidated. CROMERR review may materially extend implementation for a custom production system.","source_ids":["S3","S4","S5","S7","S8"]},"scores":{"meaningful_impact":{"score":4,"rationale":"Reducing review burden could matter where expired-permit backlogs and staffing constraints are large, but evidence is jurisdiction-specific and realized environmental benefit is unmeasured.","source_ids":["S1","S2"]},"stakeholder_pull":{"score":5,"rationale":"EPA has recently and explicitly asked permitting partners to focus resources on new and changing requirements, and an identifiable state authority reports severe backlog pressure.","source_ids":["S1","S2"]},"incremental_advantage":{"score":2,"rationale":"EPA policy and a Georgia renewal crosswalk already implement much of the baseline-relative attention concept; no comparative evidence shows that the added automation and audit architecture beats this practice.","source_ids":["S1","S5","S7"]},"distinctiveness_plausibility":{"score":3,"rationale":"Protected bypasses, cumulative residual budgets and independent raw-section audits form a plausible remaining distinction, but the available sources do not establish that this bundle is absent everywhere or operationally superior.","source_ids":["S1","S5","S6"]},"technical_implementability":{"score":4,"rationale":"Structured regulatory fields, comparative review and commercial document-difference technology exist. The main uncertainty is reliable semantic and consequence interpretation rather than basic computation.","source_ids":["S3","S5","S7"]},"adoption_authority_feasibility":{"score":3,"rationale":"Permitting authorities have application-form discretion and may request additional information, but a production electronic-reporting system may require CROMERR approval and cannot displace public, certification, petition or final-decision safeguards.","source_ids":["S1","S3","S4","S8"]},"evidence_readiness":{"score":4,"rationale":"A preregistered retrospective shadow study can use a closed renewal, a frozen prior baseline and scripted defects without affecting a permit. Reviewer time and detection outcomes are observable.","source_ids":["S3","S5"]},"safety_net_benefit":{"score":4,"rationale":"Preserving the full certified filing, public review, petitions, audit sampling and automatic fallback could bound harm from erroneous suppression, but the audit rate and bypass performance are not empirically established.","source_ids":["S1","S3","S8"]},"scalability":{"score":3,"rationale":"Repeated Title V schemas and existing comparative practices support replication, but facility-specific narratives, jurisdictional variation, model maintenance and CROMERR approval constrain scale.","source_ids":["S3","S4","S5","S7"]}},"score_confidence":"MODERATE","costs":{"first_evidence":{"band_2026_usd":"50K_TO_250K","scope":"One preregistered retrospective paired study on a closed renewal, including baseline reconstruction, a lightweight comparison prototype, scripted defects, two independent review paths, adjudication and analysis.","confidence":"MODERATE","assumptions":["Uses existing closed records and does not alter a live permit.","Approximately 400 to 1,200 combined analyst, software and specialist-review hours.","No custom CROMERR production approval is required for an offline shadow study.","Resource-equivalent estimate includes overhead and independent adjudication."],"source_ids":["S5","S6","S7"]},"initial_deployment_startup":{"band_2026_usd":"250K_TO_1M","scope":"Configure one permitting program's schemas, baseline store, comparators, protected classes, audit sampling, access controls and reviewer interface in a non-production environment.","confidence":"LOW","assumptions":["One permit family and one authority are in scope.","Existing records are substantially digitized.","Generic comparison components can be reused.","Excludes production electronic-submission acceptance and large historical-data remediation."],"source_ids":["S3","S4","S5","S7"]},"operational_launch":{"band_2026_usd":"1M_TO_5M","scope":"Production launch for one permitting authority, including integration with authoritative records and intake, security and CROMERR work, migration, validation, training, change management, monitoring and contingency capacity.","confidence":"LOW","assumptions":["A custom or materially modified government workflow requires formal assurance and possibly CROMERR approval.","Public-record, signature, copy-of-record and petition traceability must be preserved.","Launch retains ordinary full review as fallback and runs parallel during calibration.","No nationwide rollout is included."],"source_ids":["S3","S4","S8"]},"annual_recurring":{"band_2026_usd":"250K_TO_1M","scope":"Annual operation for one program: software support, model and rule updates, specialist threshold governance, random audits, quality adjudication, security, records support and retraining.","confidence":"LOW","assumptions":["Several technical and regulatory staff contribute fractions of an FTE.","Audit and fallback workload are material and cannot be eliminated.","Cost excludes underlying statutory review work common to both candidate and baseline.","Hourly regulatory labor and overhead are broadly consistent with official time-and-materials practice."],"source_ids":["S4","S6"]}},"verified_pipeline_gates":{"externally_supported_problem":{"status":"YES","reason":"Current EPA policy identifies unnecessary unchanged renewal work, and an EPA program evaluation documents a substantial expired-permit backlog and staffing constraint.","source_ids":["S1","S2"]},"externally_credible_adopter_or_authorizer":{"status":"YES","reason":"State, local and tribal Title V permitting authorities are explicit implementers; RI DEM is identifiable, and EPA has directly encouraged these authorities to streamline unchanged renewals.","source_ids":["S1","S2","S3"]},"distinct_testable_incremental_claim":{"status":"YES","reason":"The candidate can be compared against ordinary complete review and the existing manual crosswalk on consequential-change recall, reconstruction, audit-only discoveries, fallback behavior, reviewer time and total resource use.","source_ids":["S5"]},"bounded_next_evidence_step":{"status":"YES","reason":"A single closed-renewal shadow replay with frozen artifacts, two comparators and scripted failure cases is bounded and cannot change a permit.","source_ids":["S3","S5"]},"no_unresolved_safety_or_authority_stop":{"status":"YES","reason":"For the proposed retrospective shadow study, the historical disposition remains fixed, no live regulatory action is automated, and the full authoritative record is retained. Production authority and CROMERR questions remain later-stage constraints rather than a stop on this evidence step.","source_ids":["S3","S4","S8"]},"credible_cost_scope_and_range":{"status":"UNCERTAIN","reason":"The scopes and broad bands are explicit and anchored to regulatory labor and CROMERR complexity, but no directly comparable procurement, implementation budget or jurisdiction-specific integration estimate was found.","source_ids":["S4","S6","S7"]}},"next_evidence_step":"With one permitting authority, preregister and run an offline shadow replay of one closed, sufficiently complex Title V renewal. Freeze the prior approved application and permit, all intervening amendments, the applicable 2026-independent reporting schema, comparator rules, protected fields, cumulative-change rules, audit sample and adjudication protocol. Randomly assign qualified reviewers to (A) ordinary complete-dossier review, (B) the authority's existing manual condition crosswalk if available, and (C) the candidate residual interface; keep all reviewers blind to the historical disposition. Inject version mismatch, deleted mandatory data, changed calculation method, increased uncertainty, semantically altered but lexically similar language, several individually small cumulative changes and a new exposure-pathway fact. Primary comparators are consequential-change recall after blinded adjudication, protected-bypass recall, field reconstruction accuracy, audit-only discovery rate, false escalation rate, reviewer hours and total resource-equivalent cost. Falsify the incremental claim if any protected test is suppressed, the candidate's consequential-change recall is more than 5 percentage points below complete review, reconstruction is below 99.5% for structured fields, version mismatch fails to force fallback, audit-only consequential omissions exceed a preregistered 1% ceiling, or total cost is not lower despite at least a preregistered 20% reduction in specialist review time.","blocking_evidence":["No paired empirical evidence shows non-inferior consequential-change recall or reduced total review cost versus complete review and the existing permit-condition crosswalk.","No validation set establishes semantic-comparison performance for emissions calculations, uncertainty disclosures, controls, receptor context and lexically similar substantive changes.","No empirical audit-rate calculation establishes adequate power to detect rare consequential omissions.","No authority has committed to the candidate's exact regulator-owned residual, cumulative-budget and independent-audit workflow.","No jurisdiction-specific legal and security assessment establishes production treatment of certified records, confidential information, public access and CROMERR applicability.","No directly comparable procurement or operating-cost evidence supports the deployment bands."],"research_disposition":"PARTNERED_RESEARCH_PROGRAM","world_novelty_boundary":"World novelty, patentability, freedom to operate, market size and realized impact were not measured. The bounded search found substantial collision in EPA renewal-streamlining policy, a regulator-produced condition-level renewal crosswalk, risk-tiered permit variations and commercial document comparison. The only remaining claim evaluated here is the empirical advantage and safety of the candidate's combined regulator-owned structured residuals, consequence and cumulative-change routing, protected bypasses, reconstruction and independent full-section audits.","arm":"COMPLETE_PROPOSAL_PORTFOLIO","candidate_version":0,"controller_recommendation":{"action":"STOP_EMPIRICAL_RESEARCH_NEEDED","repairable":false,"material_progress_observed":true,"progress_targets":["Obtain an authorized partner and access to one closed, complex renewal plus its prior baseline, amendments and reviewer records.","Complete the preregistered three-arm shadow replay with blinded independent adjudication.","Demonstrate 100% detection and fallback for protected scripted cases and baseline-version conflicts.","Show consequential-change recall no more than 5 percentage points below complete review, with at least 99.5% structured-field reconstruction accuracy.","Show at least 20% lower specialist review time without higher total resource-equivalent cost than the strongest existing workflow.","Estimate audit-only consequential omission frequency with confidence intervals and set a statistically justified random-audit rate.","Produce a jurisdiction-specific authority, public-record, confidentiality, security and CROMERR determination plus a sourced implementation budget."],"reason":"Bounded web research has resolved the broad problem, adopter, authority framework and close prior art. The remaining decision turns on reviewer behavior, proprietary closed-filing data, semantic-comparison accuracy, audit yield, workflow integration and comparative time/cost—evidence that requires a partnered empirical study rather than further web search. Under the controller rule, this STOP is not marked repairable."},"proposal_index":3}