Evaluation¶
Core Idea¶
Evaluation applies a criterion-bearing frame to a bounded object, interprets relevant observations or features against that frame, and produces a result that counts as a verdict, score, rank, grade, priority, or action-guiding judgment. The evaluator may be a person, group, institution, or rule-governed procedure. The criteria may be explicit in a rubric or specification, or reconstructable from repeated judgments, but without some standard of relevance there is only description.
The abstraction is the relation among object, criteria, observations, and evaluative result. It survives changes of substrate: a teacher grades an essay, a panel assesses a proposal, a classifier scores an input, a court weighs conduct against a standard, and an engineer judges a design against several goals. Their local criteria differ, but the same operation turns features into a purpose-relative judgment.
Broad Use¶
- Education: apply learning criteria to work and produce feedback, grades, or mastery judgments.
- Science and medicine: assess evidence quality, intervention effects, diagnoses, or competing explanations.
- Engineering and design: judge an artifact against performance, safety, usability, and maintainability criteria.
- Law and governance: apply rules and purposes to conduct, policies, or claims and issue a reasoned judgment.
- Organizations: score candidates, projects, risks, suppliers, and programs for selection or improvement.
- Computation: a rule-governed evaluator maps features and criteria to classifications, scores, or rankings.
Clarity¶
Evaluation separates observing from judging. Measurement can report a value without saying whether it is good enough. Comparison can reveal a relation without making it decision-relevant. Evaluation declares—or at least makes recoverable—the criterion that converts an observation into a judgment.
It also separates the evaluation from its later uses. A verdict can inform a decision without itself choosing a course of action, and it can be persisted as a review without the persisted artifact being identical to the evaluating act.
Manages Complexity¶
Evaluation compresses many features and standards into an inspectable result. Rubrics, scorecards, test suites, review protocols, and multi-criteria models make the mapping explicit, allowing disagreements to be located in the observations, weights, thresholds, or criteria rather than hidden inside a global impression.
The compression is lossy. A score or verdict cannot preserve every relevant feature, and changing criteria can change the result without changing the object. Good evaluation therefore keeps enough of the frame and warrant visible to audit the compression.
Abstract Reasoning¶
For object (x), criterion frame (C), and relevant observations (O(x)), an evaluation procedure (E) produces result (r=E(x,O(x),C)). Changing (C) can change ® while (x) remains fixed; changing observations can change confidence without changing the governing criterion; changing the procedure can alter how multiple criteria are combined.
This grammar prompts four questions: what exactly is being evaluated, against which criteria, from which observations, and with what result type? If any role is missing, an apparent evaluation may instead be measurement, description, comparison, or unsupported preference.
Knowledge Transfer¶
A grading rubric teaches the design reviewer to expose criteria and weights. A software test suite teaches the policy evaluator to distinguish individual checks from the aggregate verdict. Peer review teaches the classifier designer that a result without an inspectable warrant may be difficult to contest even when it is reproducible. What transfers is not the local standard but the object-criterion-observation-result structure and the audit of how those roles are connected.
Example¶
A committee evaluates three proposals. It observes feasibility, expected benefit, cost, and risk; defines criteria and weights; interprets each proposal's evidence under that frame; and produces a ranked recommendation. The ranking is not identical to the raw measurements, the pairwise comparisons, or the final funding decision. It is the evaluative result produced by applying the declared frame.
Relationships to Other Abstractions¶
Current abstraction Evaluation Prime
Parents (1) — more general patterns this builds on
-
Evaluation presupposes Comparison Prime
Evaluation presupposes Comparison because judging an object requires placing its relevant features and a criterion or reference in a shared frame.
Children (8) — more specific cases that build on this
-
Cognitive Appraisal Prime is a kind of Evaluation
Cognitive Appraisal is the organism-centered species of Evaluation whose object is a situation and whose criteria are goal significance and coping capacity.
-
Verification Prime is a kind of Evaluation
Verification is the strict species of Evaluation whose criterion is a stated specification and whose defined checking procedure yields evidence and a conformance verdict.
-
Expectancy Disconfirmation Domain-specific is part of Evaluation
Expectancy Disconfirmation contains Evaluation because the signed expectation-performance gap becomes a criterion-bearing satisfaction judgment rather than remaining a descriptive residual.
-
Natural Capital Domain-specific presupposes Evaluation
Natural capital requires a criterion-bearing evaluation that treats ecological condition and future service capacity as an asset rather than unpriced background.
-
Peak-end rule Domain-specific presupposes Evaluation
Peak-End Rule presupposes Evaluation because it specifies how an extended experience is converted into a retrospective verdict that guides repeat-or-avoid choice.
- Review Domain-specific is part of Evaluation
A Review strictly contains an Evaluation and adds attribution, warrant, persistence, addressability, and documentary affordances around it.
- Joint vs. Separate Evaluation Prime presupposes Evaluation
Joint-vs-Separate Evaluation presupposes Evaluation because it is a mode effect defined over procedures that map criteria and attributes into verdicts.
- News Values Domain-specific is a decomposition of Evaluation
Removing journalism-specific factors from News Values leaves Evaluation's object–criteria–observations–result mapping: candidate events are interpreted against a weighted frame to produce scores and coverage verdicts.
Hierarchy path (1) — routes to 1 parentless root
- Evaluation → Comparison → Self Checking
Not to Be Confused With¶
- Comparison: places items in a shared frame to read a relation; evaluation uses such a relation to produce a criterion-bearing judgment.
- Measurement: maps an attribute to a scale; evaluation interprets one or more measurements or qualitative observations against a standard.
- Verification: the narrower evaluation that tests conformance to a stated specification by a defined procedure.
- Validation: asks whether an artifact serves its intended real-world purpose, a further specialization built on verification.
- Decision: commits to a course of action; an evaluation may inform that commitment without making it.
- Review: a persisted, attributable artifact containing an evaluation, verdict, and warrant; evaluation itself need not be published or recorded.
- Bare selection: differential retention can occur without a criterion-bearing result. It becomes evaluation only when a rule or process maps candidates against a reference into an evaluative output.
Notes¶
Authored when Review exposed the absence of its portable inner operation. Queued for house-style harmonization and citation verification.