Psychologists devise free test for measuring intelligence

October 29, 2018, University of California – Riverside
UC psychologists devise free test for measuring intelligence
A UCMRT screenshot. Credit: UCR Brain Game Center

Raven’s Advanced Progressive Matrices, or APM, is a widely used standardized test to measure reasoning ability, often administered to undergraduate students. One drawback, however, is that the test, which has been in use for about 80 years, takes 40 to 60 minutes to complete. Another is that the test kit and answer sheets can cost hundreds of dollars, this amount increasing with more people taking the test.

A team of psychologists at UC Riverside and UC Irvine has now developed a highly comparable free test that takes roughly 10 minutes to complete. Called the University of California Matrix Reasoning Task, or UCMRT, the user-friendly test measures abstract problem-solving ability and works on tablets and other mobile devices.

The researchers report in the journal Behavior Research Methods that UCMRT, which they tested on 713 undergraduate students at UC Riverside and UC Irvine, is a reliable and valid measure of nonverbal problem solving that predicts academic proficiency and measures “fluid “—intelligence that is not dependent on pre-existing knowledge and is linked to reasoning and problem solving. Like APM, the test differentiates among people at the high end of intellectual ability. Compared to APM, the UCMRT offers three alternate versions, allowing the test to be used three times by the same user.

“Performance on UCMRT correlated with a math test, college GPA, as well as college admissions test scores,” said Anja Pahor, a postdoctoral researcher who designed UCMRT’s problems and works at both UC campuses. “Perhaps the greatest advantage of UCMRT is its short administration time. Further, it is self-administrable, allowing for remote testing. Log files instantly provide the number of problems solved correctly, incorrectly, or skipped, which is easily understandable for researchers, clinicians, and users. Unlike standard paper and pencil tests, UCMRT provides insight into problem-solving patterns and reaction times.”

UC psychologists devise free test for measuring intelligence
Another UCMRT screenshot. Credit: UCR Brain Game Center.

Along with many psychologists using Raven’s APM, Pahor and her co-authors—UCR’s Aaron R. Seitz and Trevor Stavropoulos; and UCI’s Susanne M. Jaeggi—realized that APM is not well suited for their studies given its cost, the time it takes to complete the test, and a lack of alternative, cross-validated forms in which participants are confronted with novel questions each time they take the test. So, the psychologists opted to create their own version of the test.

“UCMRT predicts  better than Raven’s APM,” said Seitz, a professor of psychology, director of the Brain Game Center at UCR, and Pahor’s mentor. “Intelligence tests are big-money operations. Companies that create the tests often levy a hefty charge for their use, an impediment to doing research. Our test, available for free, levels the playing field for a vast number of researchers interested in using it. We are already working to make UCMRT better than it already is. Technology has changed over the decades that APM has been around, and people’s expectations have changed accordingly. It’s important to have tests that reflect these changes and respond in a timely manner to them.”

Pahor said UCMRT has only 23 problems for users to solve (APM, in contrast, has 36), yet delivers measurements that are as good as those from APM.

“Of the 713 students who took UCMRT, about 230 students took both tests,” she said. “UCMRT correlates with APM about as well as APM correlates with itself.”

UC psychologists devise free test for measuring intelligence
Trevor Stavropoulos (left) and Anja Pahor at the UCR Brain Game Center. Credit: I. Pittalwala, UC Riverside.

Researchers interested in using the test may contact Pahor at They would be asked to download an app either in Google Play or iTunes and can start administering it immediately. Data from the tests are stored on the device itself and on a secure server.

Jaeggi, who also mentors Pahor and is an associate professor in the School of Education at UCI where she leads the Working Memory and Plasticity Laboratory, adds, “The way we set up and designed UCMRT allows the inclusion of variants that can be used for populations across the lifespan from young children to older adults. The problems we designed are visually appealing, making it easy to motivate participants to complete the task. Furthermore, there are minimal verbal instructions and participants can figure out what to do by completing the practice problems.”

Although UCMRT instructions are currently in English, the test can be easily localized to include relevant translations, Seitz said.

“We are motivated by helping the scientific community and want to create versions of UCMRT for different age groups and abilities,” he added. “This test could help with early intervention programs. We are already working on a project with California State University at San Bernardino to move forward with that.”

UCMRT is largely based on matrix problems generated by Sandia National Laboratories. Most of the ‘s matrices are inspired by those produced by the lab. Stavropoulos at the UCR Brain Game Center programmed UCMRT’s problems.

 Explore further: Simple test may help predict long-term outcome after stroke

More information: Anja Pahor et al. Validation of a matrix reasoning task for mobile devices, Behavior Research Methods (2018). DOI: 10.3758/s13428-018-1152-2

Related Stories

Simple test may help predict long-term outcome after stroke

 October 17, 2018

A simple test taken within a week of a stroke may help predict how well people will have recovered up to three years later, according to a study published in the October 17, 2018, online issue of Neurology, the medical journal …

Are you eating your relish with dogs? Testing, testing AI

 July 17, 2018

Testing, testing: DeepMind sits AI down for an IQ test. While the AI performance results are not staggering in trumping or matching human reasoning, it is a start. AI scientists recognize that establishing their capacity …

What if you could know that your mild cognitive impairment wouldn’t progress

 April 24, 2018

Researchers from the Lisbon School of Medicine, University of Lisbon found that, in some mild cognitive impairment patients, real neuropsychological stability over a decade is possible and that long-term stability could be …

Memory training video games can increase brain power

 June 14, 2011

(Medical Xpress) — In a recent study published in the Proceedings of the National Academy of Sciences, Dr. Susanne Jaeggi from the University of Michigan looked at the use of specialized video games have the ability to help …

Recommended for you

Naps help some preschoolers learn, but may hinder learning in children with Down syndrome

 October 29, 2018

A growing body of research has linked sleep with improved learning and memory consolidation in both children and adults. Yet, a new study done at the University of Arizona shows that napping may not be universally beneficial.

Psychologists devise free test for measuring intelligence

 October 29, 2018

Raven’s Advanced Progressive Matrices, or APM, is a widely used standardized test to measure reasoning ability, often administered to undergraduate students. One drawback, however, is that the test, which has been in use …

Massive study confirms that loneliness increases risk of dementia

 October 29, 2018

A new Florida State University College of Medicine study involving data from 12,000 participants collected over 10 years confirms the heavy toll that loneliness can take on your health: It increases your risk of dementia …

Lifetime peer influences, and parenting, predict adult coercive relationships

 October 29, 2018

Crude, vulgar or offensive talk, even among friends in private, can signal the beginning of a pathway leading to antisocial behaviors, substance abuse and romantic relationships dominated by anger, control and fear.

Binary bias distorts how we integrate information

 October 25, 2018

When we evaluate and compare a range of data points—whether that data is related to health outcomes, head counts, or menu prices—we tend to neglect the relative strength of the evidence and treat it as simply binary, …

A decade of data reveals that heavy multitaskers have reduced memory

 October 25, 2018

The smartphones that are now ubiquitous were just gaining popularity when Anthony Wagner became interested in the research of his Stanford colleague, Clifford Nass, on the effects of media multitasking and attention. Though …