Music Style Analysis Could Assist Therapists

July 5, 2019

The inexpressible depth of music, so easy to understand and yet so inexplicable, is due to the fact that it reproduces all the emotions of our innermost being, but entirely without reality and remote from its pain.  Oliver Sacks, Musicophilia: Tales of Music and the Brain

In this quote Sacks is drawing on a long history of using music to diagnose and treat mental health: The ancient Greeks assigned both music and medicine to the god Apollo (who also embodied ideals of masculine beauty). In the twentieth century, music therapy was developed to treat soldiers who had suffered mental and physical trauma in the world wars. How does the act of creating music calm the soul and heal the mind?

New research at the Weizmann Institute of Science may help crack the mystery by quantifying some of the connection between music making and the behavioural effects this activity can arouse.

Some may find the connection between arts therapies and computerized modelling a bit surprising, but for Dr Billie Sandak, both subjects are close to her heart, and she has found a way to use one to provide insight into the other. Sandak is in the group of Professor David Harel of Weizmann’s Computer Science and Applied Mathematics Department.

To construct a computer-based method of investigating a creative process such as playing a musical instrument, Sandak and Harel first had to identify some objective parameters for analysis.

“The ears and eyes of therapists cannot take in every detail of the complex dynamics of the creation process, and hence they may write progress reports that are subjective,” said Sandak.

The method they developed is based on a computer language called Statecharts, created by Harel in the 1980s, which is a visual language for specifying the behaviour of large, multi-component reactive systems. This includes the computerised systems for operating aircraft, but it applies equally to biological systems and social ones. With Statecharts, users can create complex diagrams of all possible events and the transitions between actions, revealing hierarchies and sequences.  Since Statecharts is just like any programming language, the resulting diagrams can then be run, simulating the behaviour of the system. Sandak and Harel had first presented the method and demonstrated how it could be used in art therapy with a modest group of subjects participating in drawing sessions.

In the present study, conducted in collaboration with Drs Avi Gilboa and Shai Cohen of the Music Department at Bar-Ilan University, they used the insights of the earlier research to conduct a broader investigation into a different, related therapy: one that involves playing a musical instrument. The results of this research were recently published in PLoS ONE.

Music therapy most often involves improvisation – whether or not the patient has had any musical training – and the idea is that the unspoken language of music can express emotional states in a way that words do not.

The researchers worked with 108 subjects, men and women, between the ages of 18 and 77. Some had musical training at various levels; others had none at all. All were given the same four tasks: to play improvised pieces on an electronic piano keyboard on four different themes: ‘negative feeling’, ‘ugly’, ‘positive feeling’ and ‘beautiful’.

The music expressing negative emotions and ugliness was, indeed, quantitatively different from that expressing positive emotions and beauty. The negative concepts involved the use of lower notes, more intensity and the playing of several keys at once. The idea of ugliness required the use of more keys even than negative emotions, while beauty involved a softer touch on the keyboard than positive emotions.

There were other differences, as well. Between men and women, for example: Women explored fewer parts of the keyboard, employed a smaller range of notes and intensities than the men, and even pressed fewer keys. This is similar to one of the findings of the earlier research – namely, that women tend to use fewer drawing tools than men.

Age also played a role, as well. Compared to the younger subjects, the older ones played with more keys pressed simultaneously and preferred the black ones – that is, their style exhibited more of the characteristics of negative emotions. For Sandak, this resonates with the earlier research.

“Older people used less color in their drawings and erased more,” she said.

Of course, in music therapy, as in any therapy, there is quite a lot going on around the act of playing music. The researchers now plan to apply their computational method to the more ambitious goal of analysing additional occurrences in the therapy room, including the patient-therapist relationship.

“Ultimately, we want to create a tool that will help the therapist track progress and change through creative therapy in real time,” said Sandak.

“This could be a kind of dashboard enabling the therapist to address issues throughout the session — for example, ‘does the patient avoid high notes and low intensities, and are his/her notes played clearly or in a muddled way?’ ‘Does the patient avoid the colour green in drawing and are his or her lines intense or erased repeatedly?’  Such information, made possible by research results, might be used by therapists to improve treatment.”

Professor David Harel’s research is supported by the estate of Emile Mimran. Professor Harel is the incumbent of the William Sussman Professorial Chair of Mathematics.


More Research

Liver Cells Give Away Their ‘Friends’ Locations

Researchers at the Weizmann Institute of Science have discovered that by pairing liver cells in cell research makes it easier to find and the smaller ones, which are often hard…

eastRead More

Ultra-Personalised Therapy for Melanoma on Horizon

The recovery rates in new immunotherapy treatments for melanoma have risen dramatically, in some cases to around 50%, but these could go higher. A new study led by researchers at…

eastRead More

Malaria Tricks the Immune System

Global efforts to eradicate malaria are dependent on scientists’ ability to outsmart the malaria parasite and a new study suggests a possible defence in the battle against this disease. Plasmodium…

eastRead More

Coronavirus Video Series

The Weizmann Institute of Medical Research and Weizmann Australia have produced online presntation and information videos, plus others about Weizmann what science they are doing with regard to Coronovirus and…

eastRead More

View All