{"schema_version":1,"research_id":"eoa_inverse_innovation_exp03_external48_20260801","source_assessment_id":"eoa_inverse_innovation_exp03_opportunity320_20260801","cell_id":"layer_decay_and_expiration_management__ethnography_qualitative_methods","selection_stratum":"DEPLOYABLE_PRIORITY","search_queries":["site:ukdataservice.ac.uk qualitative data consent anonymisation reuse retention data management guidance","site:qdr.syr.edu qualitative data repository versioning provenance consent access preservation documentation","qualitative researchers survey data sharing consent context repository primary study","qualitative data reuse context consent empirical interviews researchers repository study DOI","site:qdr.syr.edu \"Deaccessioning Data\"","Dataverse dataset versioning deaccession provenance official documentation","research data repository retention review disposition superseded metadata official policy","W3C PROV-O invalidatedAtTime wasDerivedFrom specializationOf official recommendation","DDI lifecycle qualitative data metadata relationships version official standard","site:qdr.syr.edu deposit fees curation qualitative data repository cost","qualitative researchers file management version control transcripts codebooks repository study interviews data management challenges","ethnographic data management old files versioning consent repository qualitative research study"],"sources":[{"source_id":"S1","title":"Barriers and facilitators to qualitative data sharing in the United States: A survey of qualitative researchers","publisher":"PLOS ONE","url":"https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0261719","source_class":"PRIMARY_RESEARCH","publication_date":"2021-12-31","accessed_at":"2026-08-02","claims_supported":["A non-probability survey of 425 U.S. qualitative researchers found concerns about participant permission, sensitive data, trust, institutional policy, de-identification, access control, misinterpretation, time, and cost.","Researchers reported greater willingness to share when funding, ethics guidance, repository consultation, and de-identification assistance were available.","The survey concerns data sharing rather than the prevalence or effects of stale-artifact retrieval."]},{"source_id":"S2","title":"The Problem of Data: Data Management and Curation Practices Among University Researchers","publisher":"Council on Library and Information Resources","url":"https://www.clir.org/pubs/reports/pub154/problem-of-data/","source_class":"PRIMARY_RESEARCH","publication_date":"2012-08","accessed_at":"2026-08-02","claims_supported":["Ethnographic interviews across five institutions found ad hoc data-management learning, limited long-term planning, inadequate documentation, fragmented storage, version issues, obsolete formats, and unmet needs for privacy and access controls.","Researchers described nonlinear workflows and difficulty maintaining connections among collected material, analysis, instruments, questions, and outputs.","The study was broader than qualitative repositories and did not measure obsolete interpretations being mistaken for current evidence."]},{"source_id":"S3","title":"Qualitative Data Management and Analysis within a Data Repository","publisher":"Western Journal of Nursing Research / SAGE","url":"https://doi.org/10.1177/0193945919881706","source_class":"PRIMARY_RESEARCH","publication_date":"2019-10-30","accessed_at":"2026-08-02","claims_supported":["A 15-member qualitative research team accumulated more than 1,800 files across interviews, fieldnotes, recordings, photographs, and transcripts.","The repository supported secure collection and storage but introduced analysis-stage challenges requiring negotiation of repository structure and processes.","This case supports corpus complexity and repository-management burden, not the proposed lifecycle intervention's effectiveness."]},{"source_id":"S4","title":"Responsible Sharing of Qualitative Research Data: Insights From a Pioneering Project in the United States","publisher":"International Journal of Qualitative Methods / SAGE","url":"https://doi.org/10.1177/16094069251329607","source_class":"PRIMARY_RESEARCH","publication_date":"2025-04-04","accessed_at":"2026-08-02","claims_supported":["A formative project assisted 28 researchers with preparing, de-identifying, and depositing qualitative datasets in ICPSR, demonstrating feasibility of a human-supported governed workflow.","Median researcher preparation time was six hours, while the median time to obtain an institutional signature was 75 days.","The project found that human review remained necessary, consent and contracting caused friction, and excessive removal could destroy useful context.","The project did not test currentness labels, analytic dependency graphs, recurring revalidation, lifecycle-aware retrieval, or restoration."]},{"source_id":"S5","title":"QDR Digital Preservation Policy","publisher":"Qualitative Data Repository, Syracuse University","url":"https://qdr.syr.edu/content/qdr-digital-preservation-policy","source_class":"OFFICIAL_GUIDANCE","publication_date":"n.d.","accessed_at":"2026-08-02","claims_supported":["QDR operates a qualitative-data repository using Dataverse, DDI metadata, access controls, preservation copies, file migration, and documented curation.","QDR uses subject-area experts and institutional governance for qualitative-data stewardship.","This is operational evidence for preservation and access governance but does not document artifact-level currentness or recurring supersession review."]},{"source_id":"S6","title":"Deaccessioning Data","publisher":"Qualitative Data Repository, Syracuse University","url":"https://qdr.syr.edu/policies/deaccessioning","source_class":"OFFICIAL_GUIDANCE","publication_date":"n.d.","accessed_at":"2026-08-02","claims_supported":["QDR treats published deposits as part of the scientific record and permits deaccession only under specified copyright, ethical, legal, or long-term-use circumstances.","Final decisions involve QDR, depositors, and affected parties; partial deaccession is preferred where possible.","QDR retains a landing page recording the original content and disposition reason."]},{"source_id":"S7","title":"Dataset and File Management","publisher":"The Dataverse Project","url":"https://dataverse-guides.readthedocs.io/en/stable/user/dataset-management.html","source_class":"OFFICIAL_PRODUCT_DOCUMENTATION","publication_date":"n.d.","accessed_at":"2026-08-02","claims_supported":["Dataverse implements dataset versions, file-level access permissions, file provenance, curator review, deaccession reasons, and persistent tombstone metadata.","Dataverse provenance can describe transformations and connect provenance entities to files.","Its documented features do not provide the proposed qualitative-specific currentness taxonomy, consent-state revalidation, analytic claim dependency gate, or lifecycle-aware search comparison."]},{"source_id":"S8","title":"PROV-O: The PROV Ontology","publisher":"World Wide Web Consortium","url":"https://www.w3.org/TR/prov-o/","source_class":"STANDARD","publication_date":"2013-04-30","accessed_at":"2026-08-02","claims_supported":["The W3C Recommendation defines derivation, revision, specialization, alternate versions, generation, use, and invalidation relationships and times.","These primitives can represent important parts of an artifact dependency and supersession graph.","PROV-O does not determine qualitative validity, consent authority, retention policy, or disposition decisions."]}],"problem_evidence":{"support":"MODERATE","rationale":"Primary studies support ad hoc research-data management, fragmented and nonlinear workflows, version and preservation problems, large heterogeneous qualitative corpora, repository-structure challenges, and substantial consent, context, access, and misinterpretation concerns. However, no located study measured how often obsolete qualitative artifacts are retrieved or treated as current, so the candidate's exact prevalence and consequence remain unverified.","source_ids":["S1","S2","S3","S4"]},"stakeholder_evidence":{"support":"MODERATE","rationale":"Researchers report demand for ethics guidance, funding, consultation, de-identification help, and reliable access governance, while the 28-researcher pilot shows actual participation by investigators, repository curators, and institutional signatories. This is credible pull for governed qualitative-data management, but not direct demand for the proposed artifact-level lifecycle composition.","source_ids":["S1","S4","S5"]},"prior_art":{"proximity":"SUBSTANTIAL_COLLISION","closest_analogues":[{"name":"Qualitative Data Repository on Dataverse","similarity":"This operating stack already combines qualitative-data curation, DDI metadata, preservation, restricted file access, repository governance, versioning, file provenance, curator review, and reasoned deaccession with tombstones.","remaining_difference":"The located documentation does not show one integrated workflow assigning every raw and analytic artifact explicit currentness, consent, retention, dependency, supersession, and disposition states; recurring revalidation; uncertainty-gated disposition; and lifecycle-aware retrieval evaluated against ordinary search.","source_ids":["S5","S6","S7"]},{"name":"Dataverse provenance, versioning, and deaccession workflow","similarity":"Dataverse supports immutable file provenance, dataset versions, file permissions, review, version-level deaccession, reasons, and persistent tombstones—several core technical mechanisms in the candidate.","remaining_difference":"Its standard workflow is dataset-centered and does not itself adjudicate qualitative interpretive authority, participant or community governance, claim dependencies, or whether an older artifact should lose active search authority.","source_ids":["S7"]},{"name":"W3C PROV-O provenance standard","similarity":"PROV-O already supplies machine-readable derivation, revision, specialization, use, generation, and invalidation relations suitable for representing successor and dependency links.","remaining_difference":"It is a representation standard, not a governed qualitative-corpus lifecycle process; it supplies neither consent and retention semantics nor review triggers, search behavior, disposition authority, or outcome evidence.","source_ids":["S8"]}],"distinctive_claim_remaining":"The remaining bounded claim is not that provenance, versioning, retention review, access control, or deaccession are new. It is that adding a unified, artifact-level qualitative lifecycle layer—especially explicit interpretive-currentness and consent state, claim dependencies, recurring revalidation, and uncertainty-gated disposition—to an existing repository will reduce obsolete-as-current retrieval and improve contextual interpretation and reconstruction without increasing exposure, erasure, disputes, or restoration failures.","confidence":"HIGH"},"implementation_evidence":{"support":"MODERATE","rationale":"Existing qualitative repositories, Dataverse controls, and PROV-O demonstrate that preservation, fine-grained access, provenance, versioning, review, and deaccession primitives are implementable. A 28-researcher pilot also shows that governed qualitative-data preparation and deposit can work, but with human review and long authority delays. No source demonstrates the integrated lifecycle layer or its claimed retrieval and interpretation effects.","source_ids":["S4","S5","S6","S7","S8"]},"scores":{"meaningful_impact":{"score":4,"rationale":"The supported risks—poor organization, lost context, consent conflict, misinterpretation, and preservation failures—can materially affect participants, research integrity, and reuse. Exact stale-retrieval prevalence is unknown.","source_ids":["S1","S2","S3","S4"]},"stakeholder_pull":{"score":3,"rationale":"Researchers show demand for governed assistance, ethics guidance, funding, and repository support, and actual pilots can recruit investigators and institutional authorities. Pull for artifact-level lifecycle labels specifically has not been established.","source_ids":["S1","S4"]},"incremental_advantage":{"score":3,"rationale":"The integrated workflow could improve search authority and reconstruction beyond current QDR/Dataverse practice, but most enabling mechanisms already exist and no comparative effect has been observed.","source_ids":["S5","S6","S7","S8"]},"distinctiveness_plausibility":{"score":2,"rationale":"The bounded search found substantial collision across an operating qualitative repository, Dataverse, and provenance standards. Only the integrated currentness, consent-state, claim-dependency, revalidation, and lifecycle-aware retrieval composition remains differentiated.","source_ids":["S5","S6","S7","S8"]},"technical_implementability":{"score":3,"rationale":"Standards and repository features can represent provenance, versions, permissions, and invalidation, but reliable artifact identity, consent status, interpretive currentness, and dependency completeness require difficult human and domain-specific judgments.","source_ids":["S3","S4","S7","S8"]},"adoption_authority_feasibility":{"score":3,"rationale":"QDR and the empirical pilot identify credible investigators, curators, repository staff, and institutional signatories. The pilot's 75-day median signature delay and consent problems show meaningful coordination friction.","source_ids":["S4","S5","S6"]},"evidence_readiness":{"score":4,"rationale":"A completed study permits a paired, read-only search comparison with explicit retrieval, interpretation, dependency, exposure, dispute, and restoration outcomes. Classification reliability and decision thresholds still need preregistration.","source_ids":["S2","S3","S7","S8"]},"safety_net_benefit":{"score":4,"rationale":"Preserving source artifacts, requiring human authorization, recording disposition reasons, retaining tombstones, and testing restoration can reduce both unsafe retention and irreversible loss. Metadata leakage and false confidence prevent a maximum score.","source_ids":["S4","S5","S6","S7"]},"scalability":{"score":2,"rationale":"Reusable standards and repository software support transfer, but artifact-level review is substantially more granular than existing dataset-level practice. Human validation, consent review, dependency adjudication, and institutional coordination are likely to dominate scale.","source_ids":["S3","S4","S7","S8"]}},"score_confidence":"MODERATE","costs":{"first_evidence":{"band_2026_usd":"10K_TO_50K","scope":"A read-only shadow study of approximately 200 stratified artifacts from one completed study, including protocol and authority review, two-person lifecycle classification, baseline-versus-lifecycle-aware retrieval testing, interpretation adjudication, dependency sampling, privacy review, dispute logging, and one restore drill.","confidence":"MODERATE","assumptions":["The repository and backups already exist.","Only users already authorized for the source material participate.","No access setting, source artifact, or production search index is changed.","Labor includes a qualitative analyst, data steward, technical configurator, privacy or ethics reviewer, and evaluator.","The empirical pilot's six-hour median deposit-preparation time does not include this proposal's artifact-level classification, comparison testing, or governance design."],"source_ids":["S4","S7"]},"initial_deployment_startup":{"band_2026_usd":"50K_TO_250K","scope":"Configure one program's repository with lifecycle metadata, provenance mappings, protected discovery views, audit logging, authority procedures, privacy review, training, backup validation, and migration of a priority subset of studies.","confidence":"LOW","assumptions":["Existing Dataverse-like storage, identity, and backup services can be extended rather than replaced.","Scope is one research program, not an institution-wide historical corpus.","Costs include software configuration, data mapping, security and privacy work, policy drafting, researcher and steward labor, training, and initial evaluation.","Ambiguous consent, community governance, or extensive legacy remediation could move costs above this band."],"source_ids":["S4","S5","S7","S8"]},"operational_launch":{"band_2026_usd":"50K_TO_250K","scope":"Launch the reviewed workflow across an initial portfolio of studies, including artifact classification, quality assurance, dependency review, authority and exception adjudication, protected search integration, monitoring, support, and comparative outcome evaluation.","confidence":"LOW","assumptions":["The initial portfolio is approximately 5-15 studies rather than a complete institutional archive.","No irreversible disposition is automated.","Human review remains mandatory for interpretive currentness, consent, and ambiguous dependencies.","Repository deposit charges are a small component relative to internal classification, coordination, compliance, engineering, and evaluation labor."],"source_ids":["S3","S4","S5","S7"]},"annual_recurring":{"band_2026_usd":"50K_TO_250K","scope":"Operate recurring review for the initial portfolio, revalidate permissions and exceptions, adjudicate disputes, update dependencies and successor links, maintain software and protected metadata, train users, conduct restore tests, and audit retrieval and reconstruction outcomes.","confidence":"LOW","assumptions":["A sustained fraction of data-steward, researcher, privacy or ethics, technical, and evaluation capacity is required.","Review cadence and corpus growth are moderate.","Contested or community-governed collections receive additional human review.","No source directly prices an artifact-level lifecycle-governance program."],"source_ids":["S2","S4","S5","S6","S7"]}},"verified_pipeline_gates":{"externally_supported_problem":{"status":"YES","reason":"Independent primary evidence supports ad hoc data management, nonlinear and disconnected research artifacts, version and preservation problems, large qualitative file collections, repository-process challenges, and material consent and context concerns. The exact rate of obsolete-as-current retrieval remains a blocking prevalence question, not a reason to deny the broader problem.","source_ids":["S1","S2","S3","S4"]},"externally_credible_adopter_or_authorizer":{"status":"YES","reason":"Operating qualitative repositories and the 28-researcher ICPSR pilot establish credible adopters and authorizers: investigators, repository curators, institutional signatories, and ethics or privacy authorities.","source_ids":["S4","S5","S6"]},"distinct_testable_incremental_claim":{"status":"YES","reason":"Against the QDR/Dataverse analogue, the incremental claim can be isolated as the effect of artifact-level currentness, consent state, dependency and supersession links, recurring review, and lifecycle-aware retrieval on obsolete-as-current selection and contextual interpretation.","source_ids":["S5","S6","S7","S8"]},"bounded_next_evidence_step":{"status":"YES","reason":"One completed study, approximately 200 artifacts, paired scripted searches, blinded adjudication, protected shadow metadata, and one restore drill provide a finite comparison without changing source data or production access.","source_ids":["S3","S4","S7"]},"no_unresolved_safety_or_authority_stop":{"status":"UNCERTAIN","reason":"The proposed design can remain read-only and within existing access, but no actual study, consent language, IRB determination, institutional signatory, participant or community authority, or metadata-leakage review has yet been secured. Those approvals are entry conditions, not assumptions.","source_ids":["S1","S4","S5","S6"]},"credible_cost_scope_and_range":{"status":"YES","reason":"The first study and one-program deployment can be bounded, and existing software reduces infrastructure uncertainty. Evidence shows that repository fees alone are modest while human preparation, contracting, curation, privacy review, and coordination are consequential; the broad bands therefore include those resource equivalents with low-to-moderate confidence.","source_ids":["S4","S5","S7"]}},"next_evidence_step":"With a named repository steward and ethics/privacy authority, select one completed study whose existing consent and governance permit this read-only evaluation. Preregister a stratified sample of approximately 200 artifacts and 30 scripted retrieval-and-interpretation tasks. Two authorized reviewers will independently assign shadow currentness, consent, retention, dependency, supersession, and uncertainty states, while source files, permissions, and the production index remain unchanged. In a randomized paired test, compare the current repository view with a lifecycle-aware shadow view on adjudicated obsolete-as-current selections, correct-context interpretation, dependency recall, and time-to-reconstruct a small set of published claims. Also measure reviewer agreement, unauthorized metadata exposure, contested classifications, and one authorized restore drill. Falsify advancement if the lifecycle-aware view fails to reduce obsolete-as-current selections or improve correct interpretation, or if it causes any unauthorized exposure, unresolved governance dispute, material context loss, or restoration failure. No restriction, archive move, or deletion is part of this step.","blocking_evidence":["No located study estimates the prevalence of obsolete qualitative artifacts being retrieved or treated as current evidence.","No comparative trial shows that lifecycle-aware labels or search improve retrieval, contextual interpretation, or claim reconstruction over an existing repository view.","The achievable inter-reviewer reliability of currentness, consent, retention, dependency, supersession, and uncertainty classifications is unknown.","The completeness of artifact-to-claim and artifact-to-artifact dependency graphs is unknown, especially for tacit interpretive work.","No actual corpus has yet passed consent, ethics, institutional, participant or community-governance review for even a shadow inventory.","It is unknown whether protected lifecycle metadata or tombstones would reveal sensitive existence, identities, relationships, or contested interpretations.","The bounded search found substantial component-level prior art but cannot exclude an unlocated repository or commercial research-operations system implementing the full composition.","Calendar-2026 program costs remain low-confidence because corpus size, legacy condition, repository architecture, review cadence, and governance complexity are unspecified."],"research_disposition":"PILOT_OR_ADOPTION_INQUIRY","world_novelty_boundary":"This bounded search found substantial prior art in QDR, Dataverse, and W3C provenance standards; provenance, versioning, access control, retention review, deaccession, and tombstones are not novel. It did not find direct documentation of a qualitative repository unifying artifact-level interpretive-currentness, consent and retention state, claim dependencies, supersession, recurring revalidation, uncertainty-gated disposition, lifecycle-aware search, and restoration testing, nor evidence that this composition improves outcomes. That absence is only a bounded-search result and is not a world-novelty claim."}