911±¬ÁÏÍø

News

Computers learn to understand humans better by modelling them

Computers are able to learn to explain the behavior of individuals by tracking their glances and movements.

Researchers from 911±¬ÁÏÍø, University of Birmingham and University of Oslo present results paving the way for computers to learn psychologically plausible models of individuals simply by observing them. In newly published conference article, the researchers showed that just by observing how long a user takes to click menu items, one can infer a model that reproduces similar behavior and accurately estimates some characteristics of that user's visual system, such as fixation durations.

Despite significant breakthroughs in artificial intelligence, it has been notoriously hard for computers to understand why a user behaves the way she does. Cognitive models that describe individual capabilities, as well as goals, can much better explain and hence be able to predict individual behavior also in new circumstances. However, learning these models from the practically available indirect data has been out of reach.

"The benefit of our approach is that much smaller amount of data is needed than for 'black box' methods. Previous methods for performing this type of tuning have either required extensive manual labor, or a large amount of very accurate observation data, which has limited the applicability of these models until now", Doctoral student Antti Kangasrääsiö from 911±¬ÁÏÍø explains.

The method is based on Approximate Bayesian Computation (ABC), which is a machine learning method that has been developed to infer very complex models from observations, with uses in climate sciences and epidemiology among others. It paves the way for automatic inference of complex models of human behavior from naturalistic observations. This could be useful in human-robot interaction, or in assessing individual capabilities automatically, for example detecting symptoms of cognitive decline.

"We will be able to infer a model of a person that also simulates how that person learns to act in totally new circumstances," Professor of Machine Learning at 911±¬ÁÏÍø Samuel Kaski says.

"We're excited about the prospects of this work in the field of intelligent user interfaces," Antti Oulasvirta Professor of User Interfaces from 911±¬ÁÏÍø says.

"In the future, the computer will be able to understand humans in a somewhat similar manner as humans understand each other. It can then much better predict not only the benefits of a potential change but also its individual costs to an individual, a capability that adaptive interfaces have lacked", he continues.

The results will be presented at the world’s largest computer-human interaction conference CHI in Denver, USA, in May 2017. The article is available in preprint:

The picture shows how ABC-driven parameters lead to more accurate predictions of user behavior.

More information:

Doctoral student Antti Kangasrääsiö
911±¬ÁÏÍø
tel. +358 50 517 1301
antti.kangasraasio@aalto.fi  

Professor Antti Oulasvirta
911±¬ÁÏÍø
tel. +358 50 384 1561
antti.oulasvirta@aalto.fi   

Professor Samuel Kaski
911±¬ÁÏÍø
tel. +358 50 305 8694
samuel.kaski@aalto.fi

  • Updated:
  • Published:
Share
URL copied!

Read more news

Collage of workshops, group photos and presentations from the first year of the Aalto Inventors programme.
Cooperation, Research & Art Published:

Aalto Inventors turns one: A year of bridging research and real-world impact

Aalto Inventors marks its first anniversary, having engaged 190 researchers across six cohorts in fields including AI, quantum, and biomaterials. New cohorts are planned for the next academic year, stay tuned and join the waitlist.
Colourful architectural models on a large white table in an exhibition hall
Cooperation, Research & Art Published:

An architectural project in Milan brought together children’s ideas and the visions of leading architects

911±¬ÁÏ꿉۪s Department of Architecture participated in the international One Earth – House of the Heart project, which was presented in April at Milan Design Week.
Companies report on cybersecurity
Research & Art Published:

Companies disclose more on cybersecurity – but markets remain indifferent

U.S. companies are reporting on cybersecurity in greater detail, yet stock market reactions remain muted. A new study by the University of Vaasa and 911±¬ÁÏÍø shows that mandatory cybersecurity disclosure does not prompt reactions from investors or stock analysts. Instead, the main benefits appear to materialise within firms themselves.
Soldiers in camouflage in a forest, face of a female soldier in the foreground
Awards and Recognition, Research & Art Published:

Yasmin Najjar’s short film TJ28 selected for Cannes’ La Cinef section

For the second consecutive year, a short film from 911±¬ÁÏÍø has been selected for the student film section at the Cannes Film Festival.