Automatic item generation¶

Automatic item generation (AIG), or automated item generation, is a process linking test construction with computer programming.

Version: v1 · 2026-09-28 · History
Domain-specific #: 8082
Domain group: Professional & Organizational Practice
Origin domain: Education & Pedagogy
Subdomains: Educational Measurement, Test Construction → Education & Pedagogy

Core Idea¶

Automatic item generation is treated here as the recurring socialscienceshumanitiesarts identity summarized by this source-grounded definition: Automatic item generation (AIG), or automated item generation, is a process linking test construction with computer programming. Automatic item generation (AIG), or automated item generation, is a process linking test construction with computer programming. It uses a computer algorithm to automatically create test items that are the basic building blocks of a psychological test. The method was first described by John R. Bormuth in the 1960s but was not developed until recently.

How would you explain it like I'm…

The Question-Making Machine

Instead of a teacher writing every quiz question one at a time, the teacher makes one question pattern with blanks, like 'Sam has __ apples and gets __ more. How many now?' Then a computer fills in the blanks in lots of different ways and makes many questions from that one pattern.

One Template, Many Test Questions

Automatic item generation is a way of making test questions with a computer. First, a test expert writes a template called an item model, which shows the shape of a question and what parts can change. Then a computer program uses that template to create a whole family of related questions. So instead of a person writing every single question by hand, the computer produces many questions from a few templates. The idea was first described back in the 1960s, but it only got really developed much later.

Template-Based Test Item Generation

Automatic item generation (AIG) links test construction with computer programming: an algorithm creates test items, the basic building blocks of a psychological or educational test. It works in two steps. A test specialist first designs an item model — a template specifying a question's structure and the elements that can vary — and then a computer algorithm generates items from it. The result is families of items produced from a smaller set of parent models, instead of every item being written individually. Bormuth described the idea in the 1960s, but it was not developed until recently. What makes something AIG is this template-plus-algorithm process for producing items, not just using a computer somewhere in testing.

Automatic item generation (AIG), or automated item generation, is a process that connects test construction with computer programming by using algorithms to create test items, the basic units of a psychological test. It follows a two-step process: a test specialist first develops an item model, a template specifying the item's structure and the elements that can vary; then an algorithm generates items from that model. The effect is to replace item-by-item authoring with the generation of item families from a smaller set of parent item models. The approach was first described by John R. Bormuth in the 1960s but saw real development only relatively recently. A case qualifies only if it preserves this core link between test construction and algorithmic generation; sharing the name, a familiar example, or merely a downstream effect such as a large item bank is not enough.

Scope of Application¶

Automatic generation of figural items. The same group used AIG to study differential item functioning (DIF) and gender differences associated with mental rotation.
Context. Some characteristics measured by psychological and educational tests include academic abilities, school performance, intelligence, motivation, etc. and these tests are frequently used to make decisions that have significant consequences on individuals.
Context. AIG is an approach to test development which can be used to maintain and improve test quality economically in the contemporary environment where computerized testing has increased the need for large.
Radicals, incidentals and isomorphs. The purpose of this is to predetermine a given psychometric parameter, such as item difficulty (from now on: ).
Current developments. Gierl and his colleagues used an AIG program called the Item Generator (IGOR ) to create multiple-choice items that test medical knowledge.

Clarity¶

A clear use of Automatic item generation names the carrier, the operative relation, and the conditions under which the source treats the identity as present. The minimal definition is Automatic item generation (AIG), or automated item generation, is a process linking test construction with computer programming.

Manages Complexity¶

Automatic item generation compresses multiple socialscienceshumanitiesarts details into a stable diagnostic relation. The source shows both the central mechanism—cognitive processes taken from a given theory are often matched with item features during their construction.—and the practical consequence—they achieved a Rasch model fit and item difficulties could be explained by the linear logistic test model (LLTM ), as well as by the Random-Effects LLTM.

Abstract Reasoning¶

Type the carrier. Identify the socialscienceshumanitiesarts entities to which the claim applies.
State the relation. Use the source-grounded identity: Automatic item generation (AIG), or automated item generation, is a process linking test construction with computer programming.
Check operation and conditions. Each parent can then grow its own family by manipulating other elements that Irvine called incidentals.
Demand recognition evidence.

Knowledge Transfer¶

Within the home domain. Knowledge about Automatic item generation transfers literally when a new case preserves the same carrier type, relation, and recognition test. The same group used AIG to study differential item functioning (DIF) and gender differences associated with mental rotation. Some characteristics measured by psychological and educational tests include academic abilities, school performance, intelligence, motivation, etc. and these tests are frequently used to make decisions that have significant consequences on individuals or groups of individuals. Beyond the home domain. No canonical parent is asserted for Automatic item generation.

Neighborhood in Abstraction Space¶

Automatic item generation sits in a moderately populated region (49^th percentile for distinctiveness): it has near-neighbors but no dense thicket of look-alikes.

Family — Pedagogy, Testing & Learning Methods (18 abstractions)

Nearest neighbors

Computed from structural-signature embeddings · 2026-10-08