Peelen bench
Peelen bench

How the brain predicts objects in a changing world

In everyday life, we often encounter objects that are partially hidden or only seen from the corner of our eye. On top of that, the visual input reaching our eyes is constantly moving, causing objects to change in size, orientation, or appearance as we move. Despite these challenges, our brain is remarkably good at keeping track of objects, and new research reveals how the brain is able to do so.

In their recent publication in ScienceAdvances, researchers at the Donders Institute show that the brain actively predicts how objects should appear based on the three-dimensional structure of their surroundings. When objects rotated in a way that matched the geometry of the scene, their representations in the visual cortex of the brain were stronger. Remarkably, even when an object was completely hidden from view, its expected orientation could still be read-out from brain activity.

In one of the studies, participants were shown realistic rooms with a central object, such as a bed or a couch. This object was viewed from one of two possible angles and on each trial the viewpoint was changed by rotating the room in discrete steps. During the first two snapshots, the object was fully visible, allowing participants to encode its position within the room. In the following three snapshots, the object was hidden, so only the rotating room was visible. In the final snapshot, the object reappeared, either in a way that was congruent with the room’s rotation or incongruent, creating a mismatch between expected and actual orientation. Importantly, the total rotation (30° or 90°) varied, and participants could only infer the object’s new orientation from the changing viewpoint of the room. This design allowed researchers to measure how the brain dynamically updates object representations in response to predictable changes in the environment

Marius Peelen ScienceAdvances
Marius Peelen ScienceAdvances

The predictive power of our visual system

These findings suggest that our visual system does not just passively register what we see. Instead, it uses predictive processes guided by the structure of the environment, helping us perceive objects reliably even in dynamic, complex scenes. Although this study is fundamental in nature, understanding how the brain predicts objects could inform future applications in artificial vision systems, robotics, and neurological rehabilitation.

“While previous research showed that the brain uses scene context to predict which objects are likely to appear in a scene (e.g., a car on a road), this research shows that the brain also continuously and dynamically predicts the specific appearance of objects in scenes, such as their orientation and size. Together, these scene-based predictive mechanisms help us make sense of ambiguous and dynamic visual input.”

Funding

This research was supported by the European Research Council (ERC) under the European Union’s Horizon 2020 program (grant 725970), the NWO Talent Programme 2023 (project VI.C.231.057), and the NWO 2019 Veni Grant VI.Veni.191G.085.

Contact information

Theme
Behaviour, Brain, Science