{"schema_version":1,"research_id":"eoa_inverse_innovation_exp06_external_evaluation_20260803","source_assessment_id":"ritualized_meaning_and_commitment_enactment__mathematics:P4:v0","cell_id":"ritualized_meaning_and_commitment_enactment__mathematics","search_queries":["site:nationalacademies.org graduate STEM mentoring report doctoral students mentoring agreements expectations 2019","site:nih.gov individual development plans graduate students postdoctoral researchers policy IDP","doctoral students change research direction supervisor power open problem mathematics PhD study","site:ams.org graduate student mentoring mathematics doctoral advising guidelines","university doctoral annual progress review research plan change topic supervisor official graduate school policy","site:gradschool.cornell.edu doctoral student annual progress review IDP advisor committee official","site:mit.edu mathematics PhD annual committee review advisor change official","graduate school mentoring compact advisor student expectations periodic review official university","International Ombuds Association standards practice confidential independent informal official 2024","site:ombudsassociation.org standards of practice independence impartiality informal confidential","doctoral supervisory relationship power change supervisor qualitative study doctoral students 2021 full text","individual development plan doctoral students effectiveness study mentoring support primary research","ritualized actions group commitment effect experiment collective ritual synchrony conformity primary study","collective ritual commitment behavior field experiment primary research","synchrony compliance conformity social bonding experiment coercion primary research","ritual design organizational change ceremony commitments evidence review","site:bls.gov Occupational Outlook Handbook postsecondary education administrators median pay 2025","site:bls.gov occupational employment wage postsecondary education administrators 2025","site:bls.gov compensation costs private industry benefits percent 2025","\"I didn’t want to be a troublemaker\" doctoral students experiences supervisory arrangements DOI full text","\"Perfect conformity to observable minimal rituals\" full text PDF"],"sources":[{"source_id":"S1","title":"“I didn’t want to be a troublemaker” – doctoral students’ experiences of change in supervisory arrangements","publisher":"Studies in Graduate and Postdoctoral Education / Emerald Publishing","url":"https://www.sciencedirect.com/org/science/article/pii/S2398468621000339","source_class":"PRIMARY_RESEARCH","publication_date":"2021-09-13","accessed_at":"2026-08-03","claims_supported":["Qualitative interviews with 19 doctoral students found that supervisory changes could involve prolonged, stressful decisions and fear of being seen as troublesome.","Some participants feared reprisals or maintained the status quo despite a formal right to change supervisors.","The authors recommend implemented institutional guidance, de-dramatization of supervisory changes, transparent planning, and capable external actors.","The small Swedish snowball sample, dominated by women and excluding students who quit, does not establish prevalence in mathematics or other jurisdictions."]},{"source_id":"S2","title":"Mentoring Could Improve Diversity and Inclusion in STEMM But Needs More Attention in Colleges and Universities, Says New Report","publisher":"National Academies of Sciences, Engineering, and Medicine","url":"https://www.nationalacademies.org/news/mentoring-could-improve-diversity-and-inclusion-in-stemm-but-needs-more-attention-in-colleges-and-universities-says-new-report-which-identifies-effective-mentoring-practices","source_class":"OFFICIAL_GUIDANCE","publication_date":"2019-10-30","accessed_at":"2026-08-03","claims_supported":["STEMM institutions were advised to make mentoring more intentional, inclusive, and evidence-based rather than leaving it ad hoc.","Recommended practices include aligning expectations, facilitating mentee agency, using mentoring compacts and individual development plans, and establishing structured feedback and accountability.","Institutional and departmental leaders are identifiable authorizers for formal mentoring processes."]},{"source_id":"S3","title":"Advice for New Graduate Advisors","publisher":"American Mathematical Society, Math Voices","url":"https://mathvoices.ams.org/teachingandlearning/advice-for-new-graduate-advisors/","source_class":"AUTHORITATIVE_SECONDARY","publication_date":"2024-11","accessed_at":"2026-08-03","claims_supported":["The mathematics-specific article describes graduate-advisor training and mentoring as often ad hoc and informal.","It recommends explicit discussion of expectations and recognizes that advising styles and research-problem ownership can vary and change during doctoral study.","It does not document the prevalence of students remaining on infeasible problems or demand for a ritualized release process."]},{"source_id":"S4","title":"Student Progress Review","publisher":"Cornell University Graduate School","url":"https://gradschool.cornell.edu/academic-progress/degrees-fields/research-degree-requirements/student-progress-review/","source_class":"OFFICIAL_GUIDANCE","publication_date":"n.d.","accessed_at":"2026-08-03","claims_supported":["Cornell already requires an annual formal conversation for second-year-and-beyond research-degree students about progress and future plans.","The workflow includes student reflection on accomplishments, challenges and goals, advisor/committee feedback, written records, and graduate-field oversight.","The process also assigns an evaluative rating, showing why an intervention claiming separation from evaluation must be tested rather than assumed.","This demonstrates that graduate schools and directors of graduate studies possess workflow and authorization capacity for recurring reviews."]},{"source_id":"S5","title":"Compact Between Biomedical Graduate Students and Their Research Advisors","publisher":"Association of American Medical Colleges","url":"https://www.aamc.org/about-us/mission-areas/biomedical-research/grad-compact","source_class":"OFFICIAL_GUIDANCE","publication_date":"2016","accessed_at":"2026-08-03","claims_supported":["The compact treats a successful doctoral mentoring relationship as requiring commitments from student, advisor, program, and institution.","AAMC proposes the compact for regular ongoing discussion, faculty mentoring, evaluations, and development of program support services.","This is close prior art for explicit reciprocal commitments, although it is not an open-problem-specific release assembly."]},{"source_id":"S6","title":"A cross-sectional study of the use and effectiveness of the Individual Development Plan among doctoral students","publisher":"F1000Research / PubMed Central","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC6039936/","source_class":"PRIMARY_RESEARCH","publication_date":"2018-07-05","accessed_at":"2026-08-03","claims_supported":["The opt-in survey included 663 doctoral students from at least 98 US universities, mostly in life, biological, and medical sciences.","Although 53.6% reported IDP use, only 37.4% reported completing one with an advisor; 33.6% felt they could have an honest advisor conversation through it and 33.7% found it helpful for career development.","Perceived usefulness was associated with a positive mentoring relationship, and the authors stated that their cross-sectional study could not establish whether IDPs work as intended.","The study supports both the feasibility of structured planning and the risk that a tool alone cannot neutralize advisor power."]},{"source_id":"S7","title":"Perfect conformity to observable minimal rituals engenders trust: An experimental test of the signaling hypothesis","publisher":"Applied Psychology / International Association of Applied Psychology","url":"https://iaap-journals.onlinelibrary.wiley.com/doi/10.1111/apps.12555","source_class":"PRIMARY_RESEARCH","publication_date":"2024-07-31","accessed_at":"2026-08-03","claims_supported":["Laboratory experiments found that observable perfect conformity to a minimal ritual signaled group commitment and increased ingroup trust.","The result makes visible enactment a non-neutral design element: even a plain marker can be interpreted as evidence of commitment or noncommitment.","The synthetic minimal-group experiment does not establish benefits or harms in doctoral advising, but it strengthens the need for private and no-placement comparators."]},{"source_id":"S8","title":"Table 1. National employment and wage data by occupation, May 2025","publisher":"U.S. Bureau of Labor Statistics","url":"https://www.bls.gov/news.release/ocwage.t01.htm","source_class":"GOVERNMENT_OR_REGULATOR","publication_date":"2026-05-15","accessed_at":"2026-08-03","claims_supported":["For postsecondary education administrators, BLS reported a May 2025 mean hourly wage of $60.84 and mean annual wage of $126,540.","These wage data provide a conservative labor anchor for resource-equivalent estimates but exclude faculty opportunity cost, benefits, legal review, external facilitation, and institutional overhead."]}],"problem_evidence":{"support":"MODERATE","rationale":"External evidence visibly supports supervisory power asymmetry, costly change processes, ad hoc mathematics advising, and the institutional need for explicit expectations and mentee agency. It does not establish how often mathematics doctoral projects persist despite documented feasibility blockers, nor whether current annual reviews omit legitimate direction changes. The exact proposed observable state therefore remains unmeasured.","source_ids":["S1","S2","S3","S4"]},"stakeholder_evidence":{"support":"MODERATE","rationale":"Graduate schools, directors of graduate studies, departments, and funders are identifiable authorizers: Cornell operates annual research-degree reviews, while NASEM, AMS, and AAMC expressly call for structured expectations, reciprocal mentoring, feedback, and institutional accountability. No located source expresses demand for a symbolically marked carry/reshape/hold/release assembly, and no mathematics program is identified as a willing pilot partner.","source_ids":["S2","S3","S4","S5"]},"prior_art":{"proximity":"SUBSTANTIAL_COLLISION","closest_analogues":[{"name":"Cornell Student Progress Review","similarity":"Recurring formal review with student self-reflection, challenges, goals, advisor or committee discussion, written feedback, future planning, records, and graduate-field oversight.","remaining_difference":"It is explicitly evaluative and does not make continuation nondefault, separate each supporter’s commitments, offer a protected release path, or test a ritual layer against a non-symbolic equivalent.","source_ids":["S4"]},{"name":"AAMC Graduate Student–Research Advisor Compact","similarity":"Makes doctoral mentoring reciprocal across student, advisor, program, and institution and is intended for regular ongoing discussion.","remaining_difference":"It is a relationship framework rather than a term-bound decision about one mathematical problem; it lacks independent facilitation, equal path presentation, preserved mathematical residue, and ritual enactment.","source_ids":["S5"]},{"name":"Individual Development Plan practice","similarity":"Periodic self-assessment, goals, action planning, and advisor discussion already operationalize revisable planning for doctoral trainees.","remaining_difference":"IDPs are usually career-development tools, not a student-controlled decision over carrying, reshaping, holding, or releasing a research problem; evidence does not show that adding symbolic enactment improves candor or follow-through.","source_ids":["S2","S6"]}],"distinctive_claim_remaining":"Against a matched, independently facilitated non-symbolic planning review, the optional marked assembly will produce a more complete student-approved record of an explicitly chosen current path, legitimate alternatives or deferral, preserved mathematical residue, and separately accepted support obligations, without increasing perceived evaluation pressure, path stigma, confidentiality concern, or difficulty revising the choice four weeks later.","confidence":"HIGH"},"implementation_evidence":{"support":"MODERATE","rationale":"The folio, short session, optional participation modes, student-approved record, and four-week action check are technically simple and fit existing annual-review workflows. Graduate-school authority to run recurring reviews is visible, and comparable compacts and IDPs are established. Feasibility is weaker for genuine nonretaliatory choice under supervisory dependence, independent staffing, record governance, disability access, funding or employment interactions, and the claimed value of symbolic marking. Observable ritual conformity can itself signal commitment, so privacy and a no-ritual comparator are safety-critical. Jurisdiction-specific student-record, employment, immigration, disability, discrimination, and collective-bargaining review was not performed.","source_ids":["S1","S4","S5","S6","S7","S8"]},"scores":{"meaningful_impact":{"score":3,"rationale":"A safer, earlier direction change could matter substantially to an affected student and preserve useful work, but mathematics-specific prevalence and downstream degree effects are unknown.","source_ids":["S1","S2","S3"]},"stakeholder_pull":{"score":3,"rationale":"Authorizers clearly seek structured mentoring, explicit expectations, and accountability, but no adopter has requested this ritualized form.","source_ids":["S2","S3","S4","S5"]},"incremental_advantage":{"score":2,"rationale":"Annual reviews, IDPs, and mentoring compacts already cover most functional components. The unproven increment is equal-status release plus reciprocal problem-specific obligations and symbolic marking.","source_ids":["S4","S5","S6"]},"distinctiveness_plausibility":{"score":2,"rationale":"The combined release-and-residue protocol is contrastively describable, but substantial prior-art collision leaves the ritual layer as the main differentiator, and its direction of effect is uncertain.","source_ids":["S4","S5","S6","S7"]},"technical_implementability":{"score":4,"rationale":"No novel technology is needed; templates, private instructions, access modes, records, and follow-up checks are straightforward. The hard problems are governance and behavior rather than engineering.","source_ids":["S4","S5","S8"]},"adoption_authority_feasibility":{"score":3,"rationale":"Graduate schools and departments already authorize annual reviews and mentoring tools, but separation from formal evaluation and funding authority requires explicit institutional approval and independent oversight.","source_ids":["S2","S4","S5"]},"evidence_readiness":{"score":2,"rationale":"Outcomes and falsifiers can be measured immediately, but there is no direct evidence for the proposed assembly, no mathematics-specific baseline, no willing partner, and no live safety data.","source_ids":["S1","S3","S6","S7"]},"safety_net_benefit":{"score":3,"rationale":"Private participation, deferral, preserved residue, rollback, and an ordinary-review alternative could reduce lock-in. Their credibility under advisor power remains untested, and visible ritual behavior may itself signal loyalty.","source_ids":["S1","S7"]},"scalability":{"score":3,"rationale":"The format is lightweight and compatible with existing review cycles, but independent facilitation, privacy controls, training, and audits create recurring institutional cost and may limit scale.","source_ids":["S4","S8"]}},"score_confidence":"MODERATE","costs":{"first_evidence":{"band_2026_usd":"UNDER_10K","scope":"One-program, six-to-eight-project feasibility comparison of the marked assembly with a matched non-symbolic facilitated review, including template preparation, consent screening, anonymous feedback, and four-week checks.","confidence":"MODERATE","assumptions":["Approximately 70-120 combined administrator, facilitator, and analyst hours.","Most faculty and committee time is contributed within existing review obligations.","No bespoke software, recording, incentives, or external legal opinion.","BLS postsecondary-administrator mean wage of $60.84 per hour is a labor anchor; benefits and faculty opportunity cost are represented by contingency within the band."],"source_ids":["S4","S8"]},"initial_deployment_startup":{"band_2026_usd":"10K_TO_50K","scope":"Prepare one mathematics department for controlled use: co-design, privacy and authority review, accessibility variants, facilitator training, record rules, comparator materials, and stop procedures.","confidence":"MODERATE","assumptions":["Roughly 150-400 resource-equivalent hours across graduate administration, faculty, accessibility, privacy or counsel, and facilitation.","Existing annual-review infrastructure and secure institutional storage are reused.","No institution-wide software procurement."],"source_ids":["S4","S8"]},"operational_launch":{"band_2026_usd":"50K_TO_250K","scope":"One-year launch across several doctoral programs or roughly 25-75 participating projects, with independent facilitation, monitoring, evaluation, and contingency support.","confidence":"LOW","assumptions":["A 0.5-1.5 FTE-equivalent program function plus faculty, committee, privacy, and evaluation time.","Independent facilitation cannot be supplied entirely by existing ombuds staff.","The estimate excludes compensation for harms, litigation, new enterprise systems, and changes to student funding."],"source_ids":["S2","S4","S8"]},"annual_recurring":{"band_2026_usd":"50K_TO_250K","scope":"Institutional maintenance for scheduling, facilitation, accommodations, secure records, anonymous feedback, support-action checks, annual audit, training refresh, and repair or retirement decisions.","confidence":"LOW","assumptions":["Scale remains approximately 25-75 projects annually.","At least 0.5 FTE-equivalent independent administration is retained.","Faculty review time and institutional overhead are counted as resource-equivalent cost.","Costs could fall into 10K_TO_50K for a small department using existing staff or exceed this band if every session uses external professionals."],"source_ids":["S4","S8"]}},"verified_pipeline_gates":{"externally_supported_problem":{"status":"YES","reason":"External research and professional guidance support consequential supervisory-change barriers, advisor power, ad hoc mathematics advising, and a need for explicit expectations and agency, although the candidate’s exact mathematics-specific prevalence remains unknown.","source_ids":["S1","S2","S3"]},"externally_credible_adopter_or_authorizer":{"status":"YES","reason":"A graduate school, director of graduate studies, or mathematics department is a credible authorizer; Cornell demonstrates authority over recurring research-degree reviews, and national bodies call for structured mentoring accountability.","source_ids":["S2","S4","S5"]},"distinct_testable_incremental_claim":{"status":"YES","reason":"The marked assembly can be compared directly with a matched non-symbolic facilitated review on record completeness, accepted reciprocal support, perceived freedom and pressure, confidentiality, and four-week revisability.","source_ids":["S4","S6","S7"]},"bounded_next_evidence_step":{"status":"YES","reason":"A six-to-eight-project, one-program feasibility comparison with immediate and four-week endpoints, predefined stop rules, and explicit functional and safety falsifiers is bounded in time, participants, and cost.","source_ids":["S4","S6","S8"]},"no_unresolved_safety_or_authority_stop":{"status":"UNCERTAIN","reason":"The proposal preserves ordinary degree authority and includes rollback, but no live evidence shows that refusal is genuinely nonretaliatory under advisor dependence. Experimental evidence that observable ritual conformity signals commitment makes path placement and nonplacement safety empirically unresolved; jurisdiction-specific legal and record review is also absent.","source_ids":["S1","S7"]},"credible_cost_scope_and_range":{"status":"YES","reason":"The intervention is labor-dominant, its deployment scopes are explicit, existing review infrastructure is reusable, and BLS administrator wages provide a public labor anchor. Larger-scale estimates remain low-confidence because facilitator and faculty opportunity costs vary.","source_ids":["S4","S8"]}},"next_evidence_step":"With graduate-school approval and an independent facilitator, recruit six to eight opt-in mathematics doctoral projects already due for a term review and allocate them before preference disclosure to either (A) the proposed marked assembly or (B) an otherwise matched private, non-symbolic planning form plus facilitated advising meeting. Both arms must offer carry, reshape, hold, release, deferral, and participant-authored options; prohibit recording and formal milestone decisions; and use identical folio content and follow-up. Pre-register a five-item record-completeness score: explicit current path or deferral, at least one legitimate alternative, preserved mathematical residue, separately accepted support obligations with owners, and next review date. Collect independent anonymous ratings of choice, evaluation pressure, path safety, confidentiality, stigma, and clarity about what was not decided, then check accepted support actions and costless path revision four weeks later. Treat this only as a feasibility comparison, not an effect-size estimate. Falsify the incremental claim if the assembly fails to improve the median completeness score by at least one item over the non-symbolic comparator, produces no better support-action follow-through, or makes any participant less willing to state or revise a preferred path because of the ritual form. Halt immediately for verified retaliation, confidentiality breach, surprise evaluator participation, or linkage to funding, authorship, immigration support, employment, candidacy, or degree status.","blocking_evidence":["No mathematics-specific estimate of how often doctoral projects continue by default after a documented feasibility, supervision, resource, or goal change.","No mathematics graduate program has expressed demand for, authorized, or volunteered to test the marked assembly.","No comparative evidence shows that symbolic marking adds value over an equally protected non-symbolic facilitated review.","No live evidence establishes that refusal, release, deferral, private placement, or later revision is genuinely nonretaliatory under supervisory power.","No jurisdiction-specific assessment of student-record privacy, disability access, employment, immigration, funding, authorship, discrimination, or collective-bargaining implications.","Resource estimates lack observed preparation time, facilitator capacity, accommodation cost, and faculty opportunity cost from an actual deployment."],"research_disposition":"PARTNERED_RESEARCH_PROGRAM","world_novelty_boundary":"World novelty, patentability, freedom to operate, market size, and realized impact were not measured. The search establishes substantial collision with annual progress reviews, individual development plans, and reciprocal mentoring compacts; it does not establish whether the exact combination of problem-specific release paths, preserved mathematical residue, reciprocal support renewal, and optional symbolic marking exists anywhere in the world.","arm":"COMPLETE_PROPOSAL_PORTFOLIO","candidate_version":0,"controller_recommendation":{"action":"STOP_EMPIRICAL_RESEARCH_NEEDED","repairable":false,"material_progress_observed":true,"progress_targets":["Secure one mathematics doctoral-program and graduate-school partner with authority to protect participation from evaluation and funding decisions.","Measure the candidate problem’s baseline prevalence in that program using recent review records and confidential student reporting.","Run the bounded marked-versus-non-symbolic feasibility comparison with pre-registered functional and safety falsifiers.","Verify through four-week follow-up that accepted support actions occur and students can revise or withdraw paths without penalty.","Complete institutional privacy, accessibility, employment, funding, immigration, authorship, discrimination, and records-governance review before broader deployment.","Replace modeled resource bands with observed preparation, facilitation, accommodation, follow-up, and audit costs."],"reason":"Bounded web research verifies a real supervisory-governance problem, credible authorizers, substantial adjacent practice, and a testable residual claim. It cannot determine whether the ritual layer improves explicit choice or instead intensifies loyalty signaling and pressure. Those decisive functional and safety questions require proprietary program records, participant experience, and live comparative testing, so further web search cannot resolve them."},"proposal_index":4}