{"schema_version":1,"research_id":"eoa_inverse_innovation_exp06_external_evaluation_20260803","source_assessment_id":"bounded_rivalry_governance__accounting_auditing:P2:v0","cell_id":"bounded_rivalry_governance__accounting_auditing","search_queries":["site:theiia.org Global Internal Audit Standards performance measurement quality assurance objectivity PDF 2024","internal auditors performance incentives finding counts severity pressure research","internal audit quality review workpaper reperformance held-out transactions research","internal audit challenge competition audit findings leaderboard prior art","site:theiia.org internal audit performance measures number of findings quality review guidance","site:gao.gov audit workpapers reperformance quality control peer review internal audit","site:gov.uk internal audit quality assessment framework workpapers findings root cause","internal audit management training ground objectivity internal auditor incentives study","site:auditboard.com official audit management issue tracking root cause findings quality assurance","site:wolterskluwer.com TeamMate audit quality assurance findings issue tracking workpapers official","site:theiia.org audit findings root cause analysis guidance internal audit official","internal audit findings number performance metric dysfunctional behavior audit","AuditBoard audit management official issue management audit findings workpapers","TeamMate+ Audit official quality assurance issue tracking workpapers","internal audit software duplicate findings root cause issue management official product","site:theiia.org quality assurance improvement program ongoing monitoring periodic self assessments internal audit","site:bls.gov OEWS accountants auditors May 2025 hourly mean wage","site:bls.gov Occupational Outlook Handbook accountants auditors 2026 pay","\"Incentives for Dishonesty\" internal auditors PDF Balafoutas university","\"Are workpaper reviews preparer-specific\" PDF","\"Are workpaper reviews preparer-specific\" university repository","\"Incentives for Dishonesty: An Experimental Study with Internal Auditors\" repository","site:auditboard.com platform internal audit management software workpapers findings official","site:auditboard.com audit management issue tracking workpapers official AuditBoard"],"sources":[{"source_id":"S1","title":"Global Internal Audit Standards, 2024 Edition","publisher":"The Institute of Internal Auditors","url":"https://www.theiia.org/globalassets/site/standards/globalinternalauditstandards_2024january9.pdf","source_class":"STANDARD","publication_date":"2024-01-09","accessed_at":"2026-08-03","claims_supported":["The chief audit executive must establish performance objectives and a performance-measurement methodology with board and senior-management input.","Engagement supervision must confirm that workpapers adequately support findings, conclusions, and recommendations.","Internal audit information, workpapers, confidentiality, privacy, retention, access, and disclosure require controls.","The standards establish CAE responsibility and board oversight relevant to authorizing a shadow quality study."]},{"source_id":"S2","title":"Quality Assurance and Improvement Program (QAIP)","publisher":"The Institute of Internal Auditors","url":"https://www.theiia.org/en/group-services/quality-assurance/quality-services/qaip","source_class":"OFFICIAL_GUIDANCE","publication_date":"undated; describes standards effective 2025-01-09","accessed_at":"2026-08-03","claims_supported":["A CAE must maintain a QAIP covering the internal audit function.","QAIP includes ongoing monitoring, periodic assessment by knowledgeable persons, performance measurement, action plans, and reporting to the board and senior management.","Engagement supervisors must verify work-program completion and evidentiary support in workpapers.","This supplies a credible authorizer and an established noncompetitive comparator."]},{"source_id":"S3","title":"Risk: The Root of the Matter","publisher":"Internal Auditor, The Institute of Internal Auditors","url":"https://internalauditor.theiia.org/en/articles/2024/april/risk-the-root-of-the-matter/","source_class":"AUTHORITATIVE_SECONDARY","publication_date":"2024-04-08","accessed_at":"2026-08-03","claims_supported":["Internal-audit root-cause analysis is established practice and can combine exceptions that are symptoms into fewer key points.","Root causes are often multiple, making mechanical finding counts or one-cause assumptions weak quality proxies.","Sharing root-cause practices and thematic analysis across departments is recommended adjacent practice."]},{"source_id":"S4","title":"Incentives for Dishonesty: An Experimental Study with Internal Auditors","publisher":"University of Innsbruck","url":"https://www2.uibk.ac.at/downloads/c9821000/wpaper/2017-06.pdf","source_class":"PRIMARY_RESEARCH","publication_date":"2017-04-20","accessed_at":"2026-08-03","claims_supported":["A lab-in-the-field experiment with professional internal auditors found that competitive incentives produced under-reporting of another participant's performance, while team incentives produced over-reporting.","The study directly supports the general mechanism that rivalrous or collective incentives can distort peer reporting even among internal-audit professionals.","The experiment does not establish prevalence of finding splitting, severity inflation, evidence hoarding, or lead-mandate competition in operating audit functions."]},{"source_id":"S5","title":"Is the Objectivity of Internal Audit Compromised When the Internal Audit Function Is a Management Training Ground?","publisher":"Monash University research repository; article published by Wiley-Blackwell","url":"https://research.monash.edu/en/publications/is-the-objectivity-of-internal-audit-compromised-when-the-interna/","source_class":"PRIMARY_RESEARCH","publication_date":"2013-12","accessed_at":"2026-08-03","claims_supported":["An experiment with 74 internal auditors found lower objectivity when participants expected later promotion into senior management.","Career opportunities can affect internal-auditor judgment, supporting concern about tying prominent assignments to competitive career signals.","The study concerns management-training-ground incentives, not the proposed lead-mandate challenge or its specific strategic markers."]},{"source_id":"S6","title":"TeamMate Audit Management","publisher":"Wolters Kluwer","url":"https://www.wolterskluwer.com/en/solutions/teammate/teammate-audit","source_class":"COMMERCIAL_FIRST_PARTY","publication_date":"undated","accessed_at":"2026-08-03","claims_supported":["Commercial audit-management infrastructure already centralizes evidence, links workpapers, preserves audit trails, and supports review and validation.","Existing software could host parts of a retrospective replay without building a new core records system.","The product documentation does not describe blinded cross-team tournaments, complementary lead awards, labor caps, collusion screens, or held-out competitive scoring."]},{"source_id":"S7","title":"Connected Risk Quick Start Guide for Internal Audit and Controls Leaders","publisher":"AuditBoard","url":"https://auditboard.com/blog/connected-risk-quick-start-guide-for-internal-audit-and-controls-leaders/","source_class":"COMMERCIAL_FIRST_PARTY","publication_date":"2025-01-31","accessed_at":"2026-08-03","claims_supported":["AuditBoard identifies duplicate rehashing of findings across teams as a source of stakeholder fatigue and recommends consolidated issue tracking.","Internal audit is presented as a plausible owner of consolidated issue-management processes.","Consolidated tracking is a close operational comparator for reducing duplication but does not govern rivalry for lead mandates."]},{"source_id":"S8","title":"Accountants and Auditors: Occupational Outlook Handbook","publisher":"U.S. Bureau of Labor Statistics","url":"https://www.bls.gov/ooh/business-and-financial/accountants-and-auditors.htm","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"2025-08-28","accessed_at":"2026-08-03","claims_supported":["The May 2024 median wage for accountants and auditors was $81,680 annually or $39.27 hourly.","The highest decile exceeded $141,420, supporting higher resource-equivalent rates for senior reviewers and CAEs.","The wage baseline supports broad labor-cost bands but not vendor prices or organization-specific overhead."]}],"problem_evidence":{"support":"MODERATE","rationale":"The general problem mechanism is visible and consequential: experiments with professional internal auditors show that competitive incentives can distort peer reporting and that promotion expectations can reduce objectivity. Standards also treat objectivity, evidentiary support, supervision, and defensible performance measurement as material. However, no opened source establishes the candidate-specific prevalence of scarce lead mandates, finding splitting, severity inflation, evidence withholding, reciprocal validation, or selection based on visible issue production. AuditBoard supports duplicative-finding burden as an adjacent operational problem, not the proposed causal chain in one internal-audit function.","source_ids":["S1","S3","S4","S5","S7"]},"stakeholder_evidence":{"support":"MODERATE","rationale":"The CAE is an identifiable authorizer for performance methodology, internal quality assessment, engagement supervision, and resource administration, while the board or audit committee is an identifiable overseer. Their expressed standards-based need is for quality, objectivity, supported findings, continuous improvement, and performance measurement. No source expresses demand for a competitive assurance challenge, leaderboard, temporary lead prizes, or portfolio awards specifically.","source_ids":["S1","S2"]},"prior_art":{"proximity":"ADJACENT_PRIOR_ART","closest_analogues":[{"name":"IIA quality assurance and improvement program plus performance measurement","similarity":"Uses CAE-owned methodologies, knowledgeable reviewers, workpaper support checks, performance objectives, periodic assessment, corrective action, and board reporting.","remaining_difference":"It evaluates and improves audit quality without creating a scarce-prize contest, ranking teams, or awarding temporary lead mandates.","source_ids":["S1","S2"]},{"name":"Engagement supervision and root-cause/thematic review","similarity":"Checks whether findings are supported and coherent, distinguishes underlying causes from symptoms, and can combine fragmented exceptions into higher-level themes.","remaining_difference":"It is ordinary quality and analytical practice, not a blinded cross-team challenge with held-out replication or bounded rivalry rules.","source_ids":["S1","S3"]},{"name":"TeamMate audit-management workflow","similarity":"Provides centralized evidence, linked workpapers, audit trails, and review or validation infrastructure suitable for a shadow replay.","remaining_difference":"The documented product does not supply competitive eligibility, scoring, collusion monitoring, resource caps, complementary awards, or expiring winner authority.","source_ids":["S6"]},{"name":"AuditBoard consolidated issue tracking","similarity":"Directly addresses duplicative issue handling and stakeholder fatigue by consolidating issue-management data across teams.","remaining_difference":"It reduces duplication through shared records rather than by testing competing risk hypotheses or allocating scarce lead opportunities.","source_ids":["S7"]},{"name":"Experimental competitive incentives among internal auditors","similarity":"Creates relative-performance interdependence among internal auditors and measures strategic distortion of another auditor's reported performance.","remaining_difference":"It is evidence about tournament risk, not an adopted governance practice; it provides no evidence that the proposal's safeguards improve assurance decisions.","source_ids":["S4","S5"]}],"distinctive_claim_remaining":"Conditional on an organization first demonstrating real scarcity and strategic interdependence in lead selection, a separately governed, nonbinding assurance-hypothesis challenge using blinded independent re-performance should add reliable prediction of later finding validity and incremental risk coverage beyond ordinary QAIP review or a risk-adjusted scorecard, without increasing reporting delay, defensive documentation, confidentiality exposure, or auditee burden. This is contrastive and falsifiable; it is not a claim of world novelty.","confidence":"MODERATE"},"implementation_evidence":{"support":"MODERATE","rationale":"A retrospective shadow replay is technically and procedurally feasible using preserved workpapers, existing issue records, knowledgeable independent reviewers, controlled access, and common audit-management infrastructure. The CAE and board have recognizable governance roles. Feasibility remains unverified for reliable cross-engagement normalization, effective identity blinding, reconstruction of nonissued hypotheses and burden, adequate sample size, organization-specific privilege and employment rules, and avoidance of chilling effects. A live contest is therefore not yet supported.","source_ids":["S1","S2","S3","S6","S7","S8"]},"scores":{"meaningful_impact":{"score":4,"rationale":"If the proposed behavior is present, distorted assurance priorities and weakened auditor objectivity could materially affect governance, remediation burden, and confidence in internal audit. Candidate-specific prevalence and effect size remain unknown.","source_ids":["S1","S4","S5"]},"stakeholder_pull":{"score":2,"rationale":"CAEs and boards have explicit demand for quality assurance, supported findings, performance measurement, and continuous improvement, but no opened source shows demand for this contest format.","source_ids":["S1","S2"]},"incremental_advantage":{"score":2,"rationale":"Held-out re-performance and protected, expiring awards could add information, but no evidence shows improvement over QAIP, ordinary independent review, consolidated issue tracking, rotation, or a risk-adjusted scorecard.","source_ids":["S1","S2","S3","S7"]},"distinctiveness_plausibility":{"score":3,"rationale":"No close implementation was found in the bounded search. The contest-and-temporary-mandate combination differs from reviewed standards, research, and products, but most components are established and closed enterprise practices were not observable.","source_ids":["S1","S2","S4","S6","S7"]},"technical_implementability":{"score":3,"rationale":"The shadow replay can use existing repositories and review methods, but reliable blinding, held-out sampling, engagement-risk normalization, and reconstruction of burden and unissued hypotheses require testing.","source_ids":["S1","S2","S6","S7"]},"adoption_authority_feasibility":{"score":3,"rationale":"A CAE with board or audit-committee oversight can plausibly authorize a nonbinding quality study. Live allocation of mandates may additionally implicate the charter, HR policies, legal privilege, regulators, labor agreements, and independence safeguards.","source_ids":["S1","S2"]},"evidence_readiness":{"score":2,"rationale":"The proposal identifies plausible internal records, but none were externally inspected; nonissued hypotheses, informal lead-selection reasons, off-budget labor, reciprocal validation, and auditee burden may be missing or inconsistently recorded.","source_ids":["S1","S6","S7"]},"safety_net_benefit":{"score":3,"rationale":"A retrospective-only design, protected reporting domain, controlled access, no personnel consequences, independent review, stopping rules, and discarded standings limit first-step harm. Their effectiveness and prospective behavioral effects are untested.","source_ids":["S1","S2"]},"scalability":{"score":2,"rationale":"Existing platforms make record handling scalable, but independent re-performance is labor-intensive and heterogeneous engagements may defeat a common rubric or blinding, especially in small audit functions.","source_ids":["S1","S2","S6","S8"]}},"score_confidence":"MODERATE","costs":{"first_evidence":{"band_2026_usd":"10K_TO_50K","scope":"Pre-registration, extraction and de-identification of six closed engagements and 18 candidate items, three independent QA reviewers, limited held-out re-performance, reliability analysis, burden reconstruction, governance review, and a no-ranking report.","confidence":"MODERATE","assumptions":["Approximately 180-320 total internal labor hours.","Resource-equivalent rates of roughly $70-$150 per hour reflect the BLS auditor wage baseline plus seniority, benefits, overhead, and limited analytical support.","Existing workpaper and issue repositories are usable; no auditee recollection, new evidence request, or software purchase is required."],"source_ids":["S1","S2","S6","S8"]},"initial_deployment_startup":{"band_2026_usd":"50K_TO_250K","scope":"Design and validation of a prospective fictional-mandate simulation, rubric and normalization work, privacy and employment review, access controls, workflow configuration, training, and audit-committee approval materials.","confidence":"LOW","assumptions":["Approximately 600-1,600 hours across QA, CAE, analytics, privacy/legal, HR, technology, and participant training.","Uses existing audit-management software with configuration rather than a bespoke platform.","Excludes live personnel decisions and real mandate allocation."],"source_ids":["S1","S2","S6","S8"]},"operational_launch":{"band_2026_usd":"250K_TO_1M","scope":"First live year for one medium-to-large internal-audit function, including four governed rounds, independent panels, held-out re-performance, administration, appeals capacity, monitoring, resource-cap verification, security controls, and post-round review.","confidence":"LOW","assumptions":["A live launch is considered only after shadow and simulation evidence clears safety and validity thresholds.","Approximately 2,000-5,000 loaded labor hours plus workflow, security, and oversight costs.","Mandate hours awarded for underlying assurance work are included as resource-equivalent opportunity cost."],"source_ids":["S1","S2","S6","S8"]},"annual_recurring":{"band_2026_usd":"250K_TO_1M","scope":"Quarterly operation, reviewer and panel labor, data preparation, re-performance, monitoring, appeals reserve, audit-committee reporting, security administration, recalibration, and centrally held correction hours.","confidence":"LOW","assumptions":["Four rounds per year with a limited eligible field.","Independent re-performance remains the dominant cost driver.","No major custom-software development, external investigation, or litigation is included."],"source_ids":["S1","S2","S6","S8"]}},"verified_pipeline_gates":{"externally_supported_problem":{"status":"UNCERTAIN","reason":"External evidence supports the broad risk that competitive career incentives can distort internal-auditor objectivity and peer reporting, but does not verify this candidate's specific lead-scarcity, finding-production, severity-inflation, evidence-hoarding, or reciprocal-validation problem in practice.","source_ids":["S4","S5","S7"]},"externally_credible_adopter_or_authorizer":{"status":"YES","reason":"The standards assign the CAE responsibility for quality, performance methodology, supervision, and resource management, with board or audit-committee oversight; that is credible authority for a nonbinding shadow assessment.","source_ids":["S1","S2"]},"distinct_testable_incremental_claim":{"status":"YES","reason":"The proposal can be compared with ordinary QAIP review and a simpler risk-adjusted scorecard on reliability, later validation, incremental coverage, burden, and reporting behavior.","source_ids":["S1","S2","S3"]},"bounded_next_evidence_step":{"status":"YES","reason":"A pre-registered replay of six closed engagements can be performed without changing reports, assignments, compensation, or auditee obligations and has explicit comparators and stopping criteria.","source_ids":["S1","S2","S6"]},"no_unresolved_safety_or_authority_stop":{"status":"YES","reason":"For the retrospective shadow step only, the CAE can preserve existing authorities while using controlled access, independent review, no personnel consequences, no new auditee contact, discarded standings, and audit-committee oversight. This gate does not authorize a live contest.","source_ids":["S1","S2"]},"credible_cost_scope_and_range":{"status":"YES","reason":"Broad resource-equivalent bands can be scoped from reviewer, governance, analysis, and workflow hours using an official auditor-wage baseline. Precision is low for a live launch because staffing, privilege review, platform configuration, and entry volume are organization-specific.","source_ids":["S1","S2","S6","S8"]}},"next_evidence_step":"Pre-register one retrospective shadow replay using six closed engagements, twelve issued or merged findings, and six documented but nonissued hypotheses. Use three QA reviewers independent of the originating teams; blind identities where feasible; sample preserved held-out transactions without contacting auditees; and compare (A) the proposed composite and re-performance process, (B) existing QAIP or engagement-review outcomes, and (C) a simpler risk-adjusted scorecard without competition. Measure inter-rater reliability, leave-one-engagement-out rank stability, reviewer hours, blinding success, later merger/withdrawal/reopening status, incremental risk coverage, reconstructed evidence-request and remediation burden, and documented strategic markers. Do not publish ranks or allocate mandates. Do not advance if weighted reliability is below 0.70, the proposed method adds no discrimination beyond both comparators, rankings are dominated by engagement identity or workpaper style, material items cannot be tested from authorized preserved records, blinding or confidentiality controls fail, or reviewers judge that prospective use would plausibly delay candid escalation or increase defensive documentation. Because these outcomes require proprietary records and live reviewer work, they cannot be resolved by further bounded web search.","blocking_evidence":["No inspected internal records show that lead opportunities are scarce enough to create strategic interdependence or that visible issue production affects lead selection.","No direct prevalence estimate exists for finding splitting, unsupported severity escalation, delayed referral, evidence withholding, reciprocal validation, or off-budget effort in internal-audit teams.","No reliability, engagement-mix sensitivity, predictive-validity, or incremental-validity result exists for the proposed composite score.","No adopter has expressed demand for a competitive challenge rather than QAIP improvement, rotation, consolidated issue tracking, or a balanced scorecard.","The feasibility of reconstructing nonissued hypotheses, held-out transactions, auditee burden, and later corrections from preserved records is unknown.","Organization-specific charter, privilege, privacy, employment, labor, regulatory, and workpaper-access constraints have not been reviewed.","Prospective effects on auditor independence, urgent reporting, defensive documentation, interpersonal retaliation, and informal career use remain untested.","Live-round staffing, software configuration, and opportunity-cost estimates lack organization-specific time and volume data."],"research_disposition":"PROBLEM_PREVALENCE_STUDY","world_novelty_boundary":"The search assessed only publicly visible standards, official guidance, products, and research. It did not measure world novelty, patentability, freedom to operate, market size, realized impact, unpublished enterprise practices, private audit methodologies, procurement records, or non-English and nonindexed implementations. No novelty conclusion is made.","arm":"COMPLETE_PROPOSAL_PORTFOLIO","candidate_version":0,"controller_recommendation":{"action":"STOP_EMPIRICAL_RESEARCH_NEEDED","repairable":false,"material_progress_observed":true,"progress_targets":["Use proprietary selection and engagement records to establish whether lead scarcity, strategic interdependence, and the proposed behavioral markers actually occur.","Complete the pre-registered six-engagement shadow replay and report reliability, rank stability, burden, blinding success, and incremental validity against QAIP and simple-scorecard comparators.","Obtain documented CAE, audit-committee, privacy/legal, HR, and information-security review before any prospective simulation.","Demonstrate that the method does not interfere with urgent, fraud, whistleblower, legal, material-misstatement, or mandatory audit communications.","Produce organization-specific reviewer-hour, platform, oversight, and opportunity-cost estimates before considering a live pilot."],"reason":"Bounded web research established a credible general incentive risk, a recognizable CAE and board authority structure, and extensive adjacent prior art in QAIP, engagement review, root-cause analysis, issue consolidation, and audit-management software. It did not establish the candidate-specific problem prevalence or the reliability, incremental value, safety, and cost of the proposed challenge. Those questions require proprietary data and reviewer testing, so further web research cannot clear the decisive gates."},"proposal_index":2}