Effects of audio-visual interactions on soundscape and landscape perception and their influence on satisfaction with the urban environment

Jin Yong Jeon, Hyun In Jo

Research output: Contribution to journalArticle

Abstract

This study investigated the relationship between overall satisfaction with the urban environment and its soundscape and landscape based on a subjective evaluation of the audio-visual interaction effects within various urban spaces with different environmental conditions. Actual site conditions were simulated using immersive virtual reality technology in which subjects were provided with visual information via a head-mounted display (HMD) and audio information via head-tracking technology using the first-order ambisonics (FOA) of headphone-based three-dimensional auralization. Subjective responses to sound sources and visual elements such as cognitive response, semantic expression, and rated satisfaction were investigated in audio-visual as well as audio- and visual-only environments. It was shown that the availability of visual information affects the auditory perception of a number of human-made and natural sounds and the availability of audio information affects the visual perception of various visual elements. Semantic differential evaluation revealed that pleasantness and eventfulness and overall quality, regularity, spatial impression, and naturalness were the main evaluation factors for soundscapes and landscapes, respectively. One new finding was that audio information affects the perception of the naturalness of a landscape. Audio and visual information had effects of 24 and 76%, respectively, on overall satisfaction. Based on our findings, overall satisfaction models based on audio-visual elements and soundscape and landscape components, which exhibited 31 and 51% explanatory powers, respectively, were proposed. These newly proposed audio-visual interaction-based satisfaction models can be used for better urban planning.

Original languageEnglish
Article number106544
JournalBuilding and Environment
Volume169
DOIs
StatePublished - 2020 Feb

Fingerprint

Semantics
Availability
Acoustic waves
Headphones
Urban planning
interaction
Virtual reality
naturalness
Display devices
evaluation
virtual reality
visual perception
semantic differential
regularity
urban planning
environmental factors
effect
environmental conditions
semantics
sound

Keywords

  • Audio-visual interaction
  • Landscape
  • Overall satisfaction
  • Perceptual evaluation
  • Soundscape
  • Virtual reality

Cite this

@article{59937c03277844a992dd4a5f9fc05675,
title = "Effects of audio-visual interactions on soundscape and landscape perception and their influence on satisfaction with the urban environment",
abstract = "This study investigated the relationship between overall satisfaction with the urban environment and its soundscape and landscape based on a subjective evaluation of the audio-visual interaction effects within various urban spaces with different environmental conditions. Actual site conditions were simulated using immersive virtual reality technology in which subjects were provided with visual information via a head-mounted display (HMD) and audio information via head-tracking technology using the first-order ambisonics (FOA) of headphone-based three-dimensional auralization. Subjective responses to sound sources and visual elements such as cognitive response, semantic expression, and rated satisfaction were investigated in audio-visual as well as audio- and visual-only environments. It was shown that the availability of visual information affects the auditory perception of a number of human-made and natural sounds and the availability of audio information affects the visual perception of various visual elements. Semantic differential evaluation revealed that pleasantness and eventfulness and overall quality, regularity, spatial impression, and naturalness were the main evaluation factors for soundscapes and landscapes, respectively. One new finding was that audio information affects the perception of the naturalness of a landscape. Audio and visual information had effects of 24 and 76{\%}, respectively, on overall satisfaction. Based on our findings, overall satisfaction models based on audio-visual elements and soundscape and landscape components, which exhibited 31 and 51{\%} explanatory powers, respectively, were proposed. These newly proposed audio-visual interaction-based satisfaction models can be used for better urban planning.",
keywords = "Audio-visual interaction, Landscape, Overall satisfaction, Perceptual evaluation, Soundscape, Virtual reality",
author = "Jeon, {Jin Yong} and Jo, {Hyun In}",
year = "2020",
month = "2",
doi = "10.1016/j.buildenv.2019.106544",
language = "English",
volume = "169",
journal = "Building and Environment",
issn = "0360-1323",

}

TY - JOUR

T1 - Effects of audio-visual interactions on soundscape and landscape perception and their influence on satisfaction with the urban environment

AU - Jeon, Jin Yong

AU - Jo, Hyun In

PY - 2020/2

Y1 - 2020/2

N2 - This study investigated the relationship between overall satisfaction with the urban environment and its soundscape and landscape based on a subjective evaluation of the audio-visual interaction effects within various urban spaces with different environmental conditions. Actual site conditions were simulated using immersive virtual reality technology in which subjects were provided with visual information via a head-mounted display (HMD) and audio information via head-tracking technology using the first-order ambisonics (FOA) of headphone-based three-dimensional auralization. Subjective responses to sound sources and visual elements such as cognitive response, semantic expression, and rated satisfaction were investigated in audio-visual as well as audio- and visual-only environments. It was shown that the availability of visual information affects the auditory perception of a number of human-made and natural sounds and the availability of audio information affects the visual perception of various visual elements. Semantic differential evaluation revealed that pleasantness and eventfulness and overall quality, regularity, spatial impression, and naturalness were the main evaluation factors for soundscapes and landscapes, respectively. One new finding was that audio information affects the perception of the naturalness of a landscape. Audio and visual information had effects of 24 and 76%, respectively, on overall satisfaction. Based on our findings, overall satisfaction models based on audio-visual elements and soundscape and landscape components, which exhibited 31 and 51% explanatory powers, respectively, were proposed. These newly proposed audio-visual interaction-based satisfaction models can be used for better urban planning.

AB - This study investigated the relationship between overall satisfaction with the urban environment and its soundscape and landscape based on a subjective evaluation of the audio-visual interaction effects within various urban spaces with different environmental conditions. Actual site conditions were simulated using immersive virtual reality technology in which subjects were provided with visual information via a head-mounted display (HMD) and audio information via head-tracking technology using the first-order ambisonics (FOA) of headphone-based three-dimensional auralization. Subjective responses to sound sources and visual elements such as cognitive response, semantic expression, and rated satisfaction were investigated in audio-visual as well as audio- and visual-only environments. It was shown that the availability of visual information affects the auditory perception of a number of human-made and natural sounds and the availability of audio information affects the visual perception of various visual elements. Semantic differential evaluation revealed that pleasantness and eventfulness and overall quality, regularity, spatial impression, and naturalness were the main evaluation factors for soundscapes and landscapes, respectively. One new finding was that audio information affects the perception of the naturalness of a landscape. Audio and visual information had effects of 24 and 76%, respectively, on overall satisfaction. Based on our findings, overall satisfaction models based on audio-visual elements and soundscape and landscape components, which exhibited 31 and 51% explanatory powers, respectively, were proposed. These newly proposed audio-visual interaction-based satisfaction models can be used for better urban planning.

KW - Audio-visual interaction

KW - Landscape

KW - Overall satisfaction

KW - Perceptual evaluation

KW - Soundscape

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85075528316&partnerID=8YFLogxK

U2 - 10.1016/j.buildenv.2019.106544

DO - 10.1016/j.buildenv.2019.106544

M3 - Article

AN - SCOPUS:85075528316

VL - 169

JO - Building and Environment

JF - Building and Environment

SN - 0360-1323

M1 - 106544

ER -