Emotional perceptions associated with sound environments

People pay more attention to sounds when vision is absent than when it is present. Typically identifying individual sounds of people and objects; activities and scenes; locations and distances. They listen more to sounds for pleasure. For example, to trees whistling, cracking, and hissing in the winter; echoes in narrow places; constantly varying soft sounds; birds singing and the sea. (See our blog for Sensory mismatch, Decay and maintenance of sensory memories, and Using the senses when vision and hearing are impaired). And they describe more emotional perceptions too.


I have invited Professor Christina Eviutami Mediastika, School of Creative Industry, Universitas Ciputra to write this blog post on the emotional perceptions people who are visually impaired and fully sighted describe in soundscapes and soundwalks. Christina E. Mediastika has conducted and published a series of studies on emotional perceptions in parks, on pavements, and inside shopping centres in Surabaya and Yogyakarta, Indonesia. And one study in cinemas.


According to United Nations Development Programme data from 2017, Indonesia has the second largest population of people who are visually impaired (after India), with 1.5% of its population having a visual impairment. The pavements are narrow, damaged, contoured or uneven, and obstructed; the parks are most often located next to major streets, even within roundabouts. And the streets are noisy, polluted, hazardous, and unpleasant. The shopping malls are busy housing a wide variety of offices, and clinics as well as retail.


In our studies, people with visual impairments were encouraged to explore these public facilities and data about their emotional perceptions of each surrounding sound environment was collected. Our studies were based on the ISO 2014 and 2018 Acoustics – Soundscape.


People who are visually impaired describe more emotional perceptions of soundscapes than the fully sighted, especially when outdoors. For example, those with a visual impairment used 56 words and the fully sighted 32 words in urban parks; with “eventfulness” and “pleasantness”, respectively, as the most important emotional perceptions. This finding indicates that engagement with the sonic environment is higher for people who are visually impaired than for those who are fully sighted.

 


More specifically, for people who are visually impaired the most important aspect is how much data the outdoor sound environment provides, which impacts both their ability to navigate and their feeling of being safe (related to “eventfulness”). In contrast, for the fully sighted the most critical aspect is whether the sonic environment makes them feel comfortable (related to “pleasantness”).


Furthermore, people who are visually impaired associate more words to each perceived emotion than the fully sighted. On pavements, for example, “pleasantness” is the most important emotional perception for the fully sighted and “pleasantness-direction-safety” for those with a visual impairment. The fully sighted associate five words to “pleasantness” – comfort, fun, safe, easy, and clear route. And those with a visual impairment three more to “pleasantness-direction-safety” – clear direction, know the location, and soothing: they find pleasantness when they believe in their direction and feel safe.


Regarding indoor sound environments. Both groups perceive “pleasantness” as their dominant emotion inside shopping malls, using words like happy, comfortable, luxurious, and modern.


Moreover, when people who are visually impaired watch movies with a fully sighted narrator guide, their three most significant emotional perceptions are pleasure, storyline, and sound dynamic. Pleasure is associated with comfort, clear sound, and interest in the story. Storyline dimension is the extent to which the storyline was understood. Sound dynamic is connected to intensity and quality of the soundtrack.


There is a misconception that people who are visually impaired have more sensitive hearing than sighted individuals. Both groups have equally sensitive hearing. However, people who are visually impaired rely on sound for many aspects of their daily lives because they are forced to do so, which trains their hearing to be used to its fullest potential. This includes being aware of their surroundings, understanding the direction, recognising safety or danger, and experiencing enjoyment using their surrounding sounds.


See our blog for Activities; especially 46-48.


Some suggestions for further listening, reading, and watching:

Emotional responses to music

From Perception to Pleasure

How the sound in your home affects your mood

Soundspace: A Manifesto

The Psychology of Sound and Emotions

Urban noise: Why cities need to turn down the volume

Food for thought: taste, smell and flavour

Eating and drinking are a truly multisensory experience – flavour occurs when input from all senses is combined. Not just from two or three senses; like when admiring the sea or the botanical garden; when skiing on a cold winter day; or when playing with a kitten or a puppy. (See our blog for Multisensory processing.)


In this blog post, I have invited Dr Xinni Xua,b and Professor Thomas Hummela to explain the relationship between smell and taste (known as chemical senses), and the other senses too. Dr Xinni Xu specialises in ear, nose, and throat conditions, both as a clinician and a researcher. Professor Thomas Hummel’s research focuses on the diagnostics and treatment of olfactory / gustatory loss, the mechanisms involved in irritation of the upper airways, the olfaction in neurodegenerative disorders, and the interactions between the olfactory, trigeminal, and gustatory systems. Between them, they have published over 800 articles, books, book chapters, and abstracts. And received several awards for their work (e.g., the Young Surgeon Award and the European Chemoreception Research Organization (ECRO) for “Excellence in Chemosensory Research”).


aSmell & Taste Clinic, Department of Otorhinolaryngology, Universitätsklinik Dresden. bDepartment of Otolaryngology – Head & Neck Surgery, National University Hospital, Singapore.


Let’s start with a simple exercise. Think about one of your favourite foods. Why is it your favourite?


Perhaps some of the immediate things that came to mind were that you like the way it tastes, or that its flavour appeals to you. But are taste and flavour the same thing? These terms are often used interchangeably in common language. Biologically speaking, they mean different things.


Not just a matter of taste

Humans can recognise five fundamental tastes: sweet, sour, salty, bitter and umami (savoury). In the last decade, the taste of fat (oleogustus)1 and even water2 have been added to this list. The taste buds containing taste receptor cells that are responsible for detecting these tastes are located mainly on the tongue, but they can also be found in other areas such as the soft palate, epiglottis and upper esophagus.


The scientific meaning of taste, of gustatory function, is therefore rather narrow. Food is much more than just these few categories. For example, vanilla and chocolate ice cream both taste sweet, but at the same time, you would not say that they “taste” the same. Your ability to smell is what distinguishes between the two flavours.


The nose knows

Diagram of how flavour is synthesised by the brain, mouth, nose and ears
Figure 1: The senses in flavour (Xu & Hummel)

There are two ways that odour molecules reach the olfactory receptors high up in the nose. The first is by sniffing through the nose, which is called orthonasal olfaction. The second way is from the back of the mouth and through the back of the nose. This is termed retronasal olfaction. Retronasal olfaction plays a bigger role in flavour perception than orthonasal olfaction3 . The next time you eat, for example something fruity, try chewing first with your nose pinched and focus on the taste. Then, after some 15-20 seconds, release your nose. With the first part of the experiment, the experience may have come across as somewhat flat. In the second part of the experiment, the added dimension of smell from retronasal olfaction creates the perception of flavour. One reason why the sense of smell adds body to flavour is because humans can detect thousands of distinct odours, if not more, compared to our ability to detect only a few types of taste4. We have about 400 different receptor types for smell5. In addition, combinatorial encoding occurs in olfaction, in which each odourant is recognised by varying combinations of olfactory receptors6. This makes our olfactory sense significantly more intricate than the gustatory sense.


Another aspect of smell is that it is directly linked with emotions – neurologically speaking. The olfactory bulb, a structure at the base of the brain, receives olfactory signals from the nasal olfactory receptors. The olfactory bulb projects neurons directly to the limbic system, including the amygdala and hippocampus, which are responsible for regulating emotions, memory and behaviour. This is why odours can involuntarily evoke memories of events past and feelings associated with them. This experience has a name: the Proustian effect, coined after the French author Marcel Proust. In his tome “À la recherche du temps perdu (Remembrance of things past)”, he famously reflected on how a morsel of madeleine soaked in tea brought forth a heady rush of vivid memories from the past and whimsical nostalgia.


“Mouth-feel”

A big part of food experience is how food feels in the mouth. This is known as somato-sensation. Receptors from the trigeminal nerve in the oral cavity are responsible for this, and they include mechanoreceptors to detect texture and tactile stimulation, thermoreceptors to detect temperature and nociceptors detect noxious stimuli. Mouth-feel is what allows us to savour the creaminess of a pudding, the crunch of crisps, the prickle of carbonated drinks and the spiciness of curries. These sensations can influence our preference or rejection for foods of certain temperatures or textures. Somato-sensation becomes even more important in improving the hedonic quality of a meal for people who have lost their sense of smell or taste.


In short, flavour is the synthesis of individual tastes, smells and feels into an overall perception, modified by mastication sounds during eating, the appearance of the food and numerous environmental factors7. Yet at the same time, flavour is more than the sum of its parts, because it is shaped by our individual experiences, cultures and preferences. Hence the reason why the flavour of your favourite food appeals to you is really a matter of personal taste.


See our blog for Activities; especially 40-42.


Some suggestions for further listening, reading, and watching:

Losing the sense of taste

Madeleines and memories – the Proust Effect

Overview of Smell and Taste Disorders

This is What it’s Like to Live in a World Without Smell

Taste Test

What is life like without smells

_______________

1Running, C. A., Craig, B. A., & Mattes, R. D. (2015). Oleogustus: The Unique Taste of Fat. Chemical Senses, 40(7), 507-516. DOI: 10.1093/chemse/bjv036

2Zocchi, D., Wennemuth, G., & Oka, Y. (2017). The cellular mechanism for water detection in the mammalian taste system. Nature Neuroscience, 20(7), 927-933. DOI: 10.1038/nn.4575

3Hummel, T., & Seok, H. S. (2016). Orthonasal and retronasal perception. In: E. Guichard, C., Salles, M. Morzel, and A.-M. Le Bon (eds). Flavour: From food to perception [pp 310-318]. Oxford: Wiley Blackwell. DOI: 10.1002/9781118929384.ch13

4Dunkel, A., Steinhaus, M., Kotthoff, M., Nowak, B., Krautwurst, D., Schieberle, P., & Hofmann, T. (2014). Nature’s Chemical Signatures in Human Olfaction: A Foodborne Perspective for Future Biotechnology. Angewante Chemie International Edition, 53(28), 7124-7143. DOI: 10.1002/anie.201309508

5Mainland, J. D., Keller, A., Li, Y. R., Zhou, T., Trimmer, C., Snyder, L. L., Moberly, A. H., Adipietro, K. A., Liu, W. L. L., Zhuang, H., Zhan, S., Lee. S. S., Lin, A., & Matsunami, H. (2014). The missense of smell: functional variability in the human odorant receptor repertoire. Nature Neuroscience, 17(1), 114-20. DOI: 10.1038/nn.3598

6Firestein, S. (2001). How the olfactory system makes sense of scents. Nature, 413(6852), 211-218. DOI: 10.1038/35093026

7Spence, C. (2020). Multisensory Flavour Perception: Blending, Mixing, Fusion, and Pairing Within and Between the Senses. Foods, 9(4), 407. DOI: 10.3390/foods9040407