Computer-Mediated Reality¶

Real-time computational interposition between a person and sensory input, using a wearable or handheld device to add, remove, or transform information before it is perceived.

Version: v1 · 2026-09-28 · History
Domain-specific #: 8623
Domain group: Professional & Organizational Practice
Origin domain: Human-Computer Interaction (HCI)
Subdomains: Wearable Computing, Mediated Reality → Human-Computer Interaction (HCI)
Aliases: Mediated reality, Computationally mediated reality, Computer-mediated perception

Core Idea¶

Computer-mediated reality places a computational system in the perceptual path between a person and an environment. A wearable or handheld device captures, generates, or receives sensory information; transforms it by adding, removing, masking, substituting, or otherwise altering content; and presents the transformed result as part of what the user perceives.

The defining idea is broader than adding digital overlays. Augmented reality is additive, diminished reality is subtractive, and virtual reality can replace most or all of the visible environment. Mediated reality treats these as regions of a wider design space organized by how computation changes the perceptual stream.

The frozen evidence describes vision most strongly. A camera-and-display device can act as a visual filter, modifying the stream that would otherwise reach the eyes. The same architecture supports seeing aids, interactive interfaces, games, wayfinding, remote guidance, equipment work, drawing, and other applications. The application supplies the purpose; the abstraction is the transformation loop itself.

How would you explain it like I'm…

Magic Changing Glasses

Imagine magic glasses with a tiny camera and screen inside. They can add pictures to what you see, hide things you don't want to see, or swap the whole view for a make-believe world. Computer-mediated reality is when a computer sits between your eyes and the world and changes what you see.

Computers That Change What You See

Computer-mediated reality means a computer is placed in the middle between you and what you see or hear. A device you wear or hold, like special glasses or a phone, picks up what is around you, changes it, and shows you the changed version. It might add things (augmented reality), take things away (diminished reality), or replace almost everything (virtual reality). These are all parts of one bigger idea: the computer changing the stream of what you perceive. It can be used for games, directions, helping people see, drawing, and fixing equipment.

Computer-Filtered Perception

Computer-mediated reality places a computer in the perceptual path between a person and the environment. A wearable or handheld device captures, generates or receives sensory information, transforms it by adding, removing, masking or substituting content, and presents the result as part of what the user perceives. This is broader than just adding digital overlays: augmented reality adds, diminished reality subtracts, and virtual reality can replace most or all of the view. Mediated reality treats these as regions of one design space defined by how computation changes the perceptual stream. Vision is the clearest case: a camera-and-display device acts as a visual filter on what would otherwise reach your eyes. Uses include seeing aids, games, wayfinding and remote guidance, but the idea itself is the transformation loop.

Computer-mediated reality places a computational system in the perceptual path between a person and their environment. A wearable or handheld device captures, generates, or receives sensory information, transforms it by adding, removing, masking, substituting, or otherwise altering content, and presents the transformed result as part of the user's perception. The concept is broader than digital overlay: augmented reality is additive, diminished reality subtractive, and virtual reality can replace most or all of the visible environment, and mediated reality treats these as regions of a single design space defined by how computation alters the perceptual stream. The best-developed case is visual, where a camera-and-display device acts as a filter on the stream that would otherwise reach the eyes. This architecture supports seeing aids, interactive interfaces, games, wayfinding, remote guidance, equipment work, and drawing. The applications provide purpose, but the abstraction itself is the capture–transform–present loop.

Structural Signature¶

Sig role-phrases:

Sensory environment — A real or represented environment supplies information that could be perceived by the user. The channel must be identified; the documented canonical channel is vision.
Computational interposer — A wearable or handheld electronic system sits in the perceptual loop. It is not merely a remote analytic system because its output returns to the user as experienced information.
Transformation operator — The system adds, removes, masks, substitutes, emphasizes, or otherwise alters content in the stream. Passing an unaltered signal is transmission, not the defining mediation.
Delivered percept — The transformed stream is displayed or otherwise presented as part of the user's perceptual environment. Offline processing alone does not fill this role.
Mediation objective — Enhancement, suppression, immersion, guidance, or interaction determines which transformation is useful. The objective varies without changing the class.
Perception–action loop — In interactive cases, the user's movement or action changes the sensed environment and the system updates the mediated percept. Tight coupling is common, though the identity does not require one particular tracking implementation.

What It Is Not¶

Not ordinary image processing by itself. Processing becomes mediated reality when its result is inserted into a user's perceptual loop.
Not merely recording an environment. A passive recording may capture sensory data without transforming what the user perceives during the relevant interaction.
Not synonymous with augmented reality. Addition is only one operation; mediated reality also includes subtraction, substitution, and extensive replacement.
Not synonymous with virtual reality. Virtual reality is a strongly substitutive region of the design space, whereas mediation can retain most of the physical scene.
Not any smartphone use. Device type is insufficient. The phone must function as an interposer that changes the presented environment.
Not a claim that the transformed percept is more truthful. A system may improve task relevance, create entertainment, or deliberately obscure information. Utility and fidelity are separate properties.

Scope of Application¶

The abstraction applies to systems that alter perception during use. Wearable displays, EyeTap-like systems, smartphones, and head-mounted devices can implement the loop. The hardware is variable; what matters is capture or generation, computation, transformation, and perceptual return.

Documented visual applications include enhancing selected scene information, masking architectural elements, placing game objects into a camera view, providing remote guidance, supporting equipment work, enabling interactive drawing, and replacing the visible world with a virtual environment. These cases differ in objective and degree of intervention while retaining the same mediation structure.

The evidence packet also discusses healthcare and assistive applications, but those establish application interest rather than universal efficacy. This entry does not infer treatment benefit, safety, or clinical suitability. Likewise, the source notes that long-term effects are not thoroughly studied; that is a boundary on warranted claims, not evidence of a particular harm.

Clarity¶

Computer-Mediated Reality clarifies the relationship among neighboring “reality” technologies by asking what happens to the perceptual stream. Does a system add content, remove content, substitute content, or replace the stream? That operation is more informative than relying on a device label alone.

It also distinguishes transformation from display. A screen can show an ordinary camera feed without materially mediating it, while a compact wearable can perform extensive filtering. A clear description names the sensory channel, incoming information, transformation, delivered percept, user objective, and temporal coupling.

Manages Complexity¶

Systems in this area combine sensors, displays, tracking, rendering, interfaces, and task-specific software. The abstraction compresses those implementation details into a functional pipeline:

environment → sensory representation → computational transformation → delivered percept → user response.

That pipeline supports comparison across hardware. It also localizes design questions. Capture errors belong at the representation stage; missing or misleading overlays belong at transformation; latency and registration affect delivery and the perception–action loop; task mismatch belongs to the objective.

Abstract Reasoning¶

To analyze a candidate system:

Identify the sensory channel and the environment or representation being perceived.
Locate the device that intervenes between source information and user.
Specify the transformation as addition, subtraction, masking, substitution, enhancement, or replacement.
Determine whether the transformed output is returned as a lived percept during the interaction rather than only stored for later analysis.
State the mediation objective and the information that must remain faithful for that objective.
Trace the perception–action loop where user motion or action changes the next output.
Evaluate errors by stage: sensing, transformation, delivery, timing, or objective mismatch.

If the system contains computation but no perceptual interposition, reject the label. If it changes the percept only indirectly—for example, by recommending an action in text—state that narrower interface relation rather than assuming mediated reality.

Knowledge Transfer¶

Within human–computer interaction, the pipeline transfers across seeing aids, games, remote expertise, maintenance, wayfinding, and creative systems. The literal invariant is computational transformation of information before or during perception; the chosen channel, device, and objective may change.

Outside perception-oriented systems, “mediated reality” can become a metaphor for algorithmically filtered information. That analogy may be illuminating, but a news feed or database query is not automatically computer-mediated reality in this technical sense. Literal transfer requires a perceptual loop in which transformed sensory information is presented as the user's environment.

Examples¶

Canonical¶

A wearable visual aid captures the scene, computationally adjusts selected visual information, and displays the modified stream to the wearer. The device is neither a passive camera nor a later editing tool; it intervenes in what the user sees during use.

Mapped back: sensory environment → light and scene information that would otherwise reach the user; computational interposer → wearable camera, processor, and display; transformation operator → filtering or enhancement; delivered percept → the altered visual stream; mediation objective → make selected information more usable; sensory channel → vision.

Applied / In Practice¶

A diminished-reality architectural viewer masks selected elements of the visible built environment so that a user can inspect or communicate a view without those elements.

Mapped back: sensory environment → the visible architecture; computational interposer → handheld or wearable viewer; transformation operator → removal or masking of selected visual data; delivered percept → a scene with those elements suppressed; mediation objective → inspect an altered architectural view; sensory channel → vision.

Structural Tensions¶

T1 — Environmental fidelity vs. task-directed transformation. Preserving the incoming scene supports orientation and trust. Stronger filtering can make relevant features clearer while hiding context or introducing distortion.

Diagnostic: Which information must remain faithful, and which may be altered for the task?

T2 — Addition vs. subtraction. Adding guidance can address missing information but also increase perceptual load. Suppressing clutter can improve salience but may remove a cue that later becomes important.

Diagnostic: Is the user's limitation missing information, excessive information, or poor prioritization?

T3 — Transformational power vs. perceptual side effects. Continuous, immersive mediation expands the system's ability to reshape experience. The frozen evidence leaves long-term consequences uncertain and notes possible adverse effects.

Diagnostic: What duration and intensity of mediation are justified by the demonstrated purpose and the remaining uncertainty?

T4 — General platform vs. application-specific calibration. A common capture-transform-display pipeline can support many uses, but an effective transformation depends on a particular user, sensory channel, environment, and task.

Diagnostic: Which components are invariant platform capabilities, and which must be tuned to the application?

T5 — Transformation quality vs. interaction latency. More elaborate processing may improve the intended alteration while delaying the percept. In an interactive loop, delay can weaken alignment between action and display.

Diagnostic: What is the simplest transformation that meets the objective within the required response time?

Structural–Framed Character¶

Computer-Mediated Reality is mixed, structurally leaning. Its core pipeline—capture or generation, computational transformation, perceptual delivery—is independent of a particular application or institution. Addition, subtraction, substitution, and replacement are structural operations.

Its framed side enters through design goals and taxonomies. A “useful” percept depends on the user and task; acceptable alteration depends on norms of safety, consent, and interface practice; and labels such as augmented, diminished, mixed, and virtual reality partition the design space through disciplinary convention. The mechanism travels more readily than its evaluation.

Structural Core vs. Domain Accent¶

The structural core is an interposed transformation of an information stream before it is perceived: source → transformation → delivered percept. The operation can vary in sign and magnitude while preserving the loop.

The domain accent supplies cameras, displays, registration, wearable and handheld devices, perceptual channels, interaction latency, and application-specific objectives. Those commitments make the abstraction literal rather than a loose metaphor for any algorithmic influence.

No current live parent is asserted. Interface, transformation, and perception–action loop are analytically related, while augmented, virtual, mixed, and diminished reality name neighboring or subordinate regions rather than an implemented parent relation in the present DAG.

This entry is a kind of Transformation.

Approved unparented root. The current graph does not assert a verified parent for Computer-Mediated Reality.
Interface. The mediating device forms an interface between environmental information and perception.
Transformation. Addition, removal, substitution, and filtering describe the operative change.
Perception–action loop. Interactive systems couple delivered perception to user movement and subsequent sensing.
Augmented, diminished, mixed, and virtual reality. These are related technical categories distinguished by degree and direction of mediation; they are not all interchangeable names.

Relationships to Other Abstractions¶

Current abstraction Computer-Mediated Reality Domain-specific

Parents (1) — more general patterns this builds on

Computer-Mediated Reality is a kind of Transformation Prime

Computer-Mediated Reality is a Transformation that computationally maps incoming sensory information to an altered perceptual stream in real time.

Hierarchy path (1) — routes to 1 parentless root

Computer-Mediated Reality → Transformation → Function (Mapping)

Neighborhood in Abstraction Space¶

Computer-Mediated Reality sits in a sparse region of the domain-specific corpus (72^nd percentile for distinctiveness): few abstractions share its structure, so a faithful description tends to retrieve it precisely.

Family — Unclustered & Miscellaneous (2551 abstractions)

Nearest neighbors

Form Perception — 0.86
Ecological psychology — 0.86
Dehaene–Changeux model — 0.83
Theory of Indispensable Attributes — 0.83
Responsive-Layout Breakage — 0.82

Computed from structural-signature embeddings · 2026-10-08

Not to Be Confused With¶

Augmented reality. Adds content to a retained environment. Tell: Can the system also remove or replace perceptual information?
Diminished reality. Removes or masks content. Tell: Is subtraction the specific operation or only one option in a broader mediation system?
Virtual reality. Replaces most of the experienced environment. Tell: How much of the physical sensory stream remains and how is it transformed?
Image processing. Transforms images. Tell: Is the result returned into a user's ongoing perceptual experience?
Video recording. Captures a scene. Tell: Does computation alter what the user perceives during the relevant interaction?
Heads-up display. Presents information in the visual field. Tell: Is it integrated into a computationally transformed view of the environment or merely adjacent instrumentation?

References¶

Frozen Wikipedia discovery revision: https://en.wikipedia.org/wiki/Computer-mediated_reality (revision 1357544257).
Preserved source candidate: http://wearcam.org/mr.html
Preserved source candidate: http://wearcomp.org/mediated-reality/node5.html#SECTION00022000000000000000
Preserved source candidate: http://artis.inrialpes.fr/Publications/2003/GGS03/
Preserved source candidate: http://csdl.computer.org/comp/proceedings/ismar/2003/2006/00/20060217abs.htm
Preserved source candidate: http://mitpress.mit.edu/catalog/item/default.asp?sid=A37F2099-C624-4D8E-8FE9-39D8F4522BB1&ttype=6&tid=8823
Preserved source candidate: https://web.archive.org/web/20051130051051/http://mitpress.mit.edu/catalog/item/default.asp?sid=A37F2099-C624-4D8E-8FE9-39D8F4522BB1&ttype=6&tid=8823
Preserved source candidate: https://healthcare.utah.edu/healthfeed/postings/2020/08/eye-strain-screen-time.php
Preserved source candidate: http://www.slashgear.com/quantigraphic-camera-promises-hdr-eyesight-from-father-of-ar-12246941/

The frozen evidence supports the visual mediation loop, its additive and subtractive range, and representative applications. Medical examples are retained only as evidence that the architecture has been explored in that domain; this entry makes no efficacy, safety, diagnostic, or treatment claim.