How Raven's Progressive Matrices work

If you have ever seen a three-by-three grid of shapes with the bottom-right cell missing, you have seen the design that has dominated non-verbal ability testing since 1938.

What the test is

John C. Raven published the Progressive Matrices in 1938. Each item shows a matrix of figures with one cell left blank, and asks you to choose the piece that completes it. The items are "progressive" in that they get harder as you go, and each one is meant to teach you a little of the logic needed for the next.

There are no words, no arithmetic and no facts to recall. Everything needed to answer is present in the figure. That property is why the test spread so widely: it can be administered across languages with only the instructions translated, and it has been used in more cross-cultural research than any other cognitive measure.1

Why a grid of shapes

The design descends directly from Charles Spearman, who in 1904 observed that performance on wildly different mental tasks was positively correlated - people good at one tended to be good at the others - and proposed a general factor, g, underlying them all.3

Raven wanted a task that loaded on that general factor as purely as possible, stripped of the vocabulary and schooling that contaminate verbal tests. He described the ability being tapped as eductive - the capacity to make sense of confusion, to generate high-level rules from apparently disorganised material.

That maps closely onto what Raymond Cattell would later call fluid intelligence: reasoning applied to novel problems, as distinct from crystallised knowledge you have accumulated.4 Matrices remain the canonical measure of fluid reasoning, and when researchers need a single short index of general ability, matrices are usually what they reach for.

A useful way to see the design: every item is a small experiment in whether you can infer an unstated rule from a handful of examples, then apply it to a case you have not seen. That is a decent working definition of reasoning, which is why the format has proved so durable.

What makes an item hard

The most influential answer came from a 1990 analysis that built computer models capable of solving matrix items, then compared their behaviour with that of human test-takers.2

Two things predicted difficulty:

The analysis identified a small taxonomy of rules that accounts for most items - constancy along a row, quantitative progression, distribution of three values across rows and columns, and figure addition or subtraction. Later work confirmed that difficulty is largely a function of how many of these must be induced and combined.8

The practical upshot for anyone taking such a test: when an item defeats you, the problem is usually not that you cannot see a rule. It is that you have found one rule and stopped, while a second rule is also running.

The three versions

VersionIntended forDesign note
Coloured (CPM)Young children, older adults, people with impairmentsColoured backgrounds to hold attention; easier range
Standard (SPM)The general populationFive sets of twelve, rising in difficulty
Advanced (APM)High-ability adultsBuilt to spread out scores at the top, where the Standard version ceilings

The existence of three versions makes a general point about measurement: a test only discriminates well over the range it was built for. Give the Standard version to a group of doctoral students and most will approach the ceiling, and the scores will say more about who made a careless slip than about who reasons best. This is the same reason a 30-item test cannot resolve scores at the extremes - a point we make on score ranges and enforce by refusing to report beyond 65 to 135.

What matrices miss

Matrices are excellent at one thing, which is also their limitation.

How this site uses the format

This test uses matrix items, but not Raven’s - those are copyrighted, and the widely circulated copies would compromise any test that used them.

Instead the items here are generated from explicit rule specifications. Each matrix declares which attributes vary and under which rule, and the completing cell is then derived by applying those rules rather than drawn by hand. This is the automatic item generation approach recommended for public-domain ability measures,76 and it buys two things:

The methodology page lists the rule taxonomy used, and there are worked examples with the reasoning spelled out in the practice questions.

Common questions

Is Raven's Progressive Matrices an IQ test?

It measures fluid reasoning, which is the largest single component of general intelligence but not the whole of it. Scores are often converted to an IQ-type scale, and it correlates strongly with full-scale IQ, but it samples one domain rather than the several a clinical battery covers.

What makes one matrix item harder than another?

Mainly the number of independent rules operating at the same time. One rule is easy; three or four simultaneously is hard, because each partial conclusion has to be held in working memory while the next is worked out. Rule type matters too - relations that combine or cancel elements across cells are harder to spot than simple progressions.

Are the matrices on this site the real Raven items?

No. Raven items are copyrighted and widely leaked, which would compromise any test using them. The items here are generated from explicit rule specifications, so the answer is correct by construction and every distractor breaks at least one stated rule.

Why do matrices work across different languages?

Because the item contains everything needed to solve it - no vocabulary, no arithmetic, no facts. Only the instructions need translating. That is why matrices dominate cross-cultural research, though "language-free" is not the same as "culture-free".

References

  1. Raven, J. (2000). The Raven Progressive Matrices: Change and stability over culture and time. Cognitive Psychology, 41(1), 1-48. doi:10.1006/cogp.1999.0735
  2. Carpenter, P. A., Just, M. A., & Shell, P. (1990). What one intelligence test measures: A theoretical account of the processing in the Raven Progressive Matrices Test. Psychological Review, 97(3), 404-431.
  3. Spearman, C. (1904). General intelligence, objectively determined and measured. American Journal of Psychology, 15(2), 201-292.
  4. Cattell, R. B. (1963). Theory of fluid and crystallized intelligence: A critical experiment. Journal of Educational Psychology, 54(1), 1-22.
  5. Pietschnig, J., & Voracek, M. (2015). One century of global IQ gains: A formal meta-analysis of the Flynn effect (1909-2013). Perspectives on Psychological Science, 10(3), 282-306. doi:10.1177/1745691615577701
  6. Condon, D. M., & Revelle, W. (2014). The International Cognitive Ability Resource: Development and initial validation of a public-domain measure. Intelligence, 43, 52-64. doi:10.1016/j.intell.2014.01.004
  7. Arendasy, M., Sommer, M., Gittler, G., & Hergovich, A. (2006). Automatic generation of quantitative reasoning items. Journal of Individual Differences, 27(1), 2-14.
  8. Verguts, T., & De Boeck, P. (2002). The induction of solution rules in Raven Progressive Matrices Test. European Journal of Cognitive Psychology, 14(4), 521-547.

Related reading

Try ten generated matrix items

Part of a 30-question test, with every rule explained afterwards whether you got it right or not.

Start the test

30 questions · about 30 minutes · no sign-up