# Multimodal Interaction - Homework 5 - <br>Group 60
<table>
<tr>
<th></th>
<th>Visual dominance</th>
<th>Modality Appropriateness</th>
<th>Optimal Integration</th>
</tr>
<tr>
<th>McGurk</th>
<th><span style='color:green;font-size:30px'><b>&#10003;</b></span> </th>
<th></th>
<th></th>
</tr>
<tr>
<th>Ventriloquist</th>
<th><span style='color:green;font-size:30px'><b>&#10003;</b></span> </th>
<th></th>
<th></th>
</tr>
<tr>
<th>Audio-visual effect on counting</th>
<th></th>
<th><span style='color:green;font-size:30px'><b>&#10003;</b></span> </th>
<th></th>
</tr>
<tr>
<th>Audio-visual location after Alais & Burr (2004)</th>
<th></th>
<th></th>
<th><span style='color:green;font-size:30px'><b>&#10003;</b></span> </th>
</tr>
</table>

<ul>
<li>
The McGurk effect describes a phenomenon, where humans perceive a sound differently depending on whether they see the person making the sound or not. If they only listen, they hear a 'baba', if they only watch, they hear 'gaga' or 'dada' and if they watch and listen, they hear 'dada'.
The information changes depending on which and how many modalities are used and the visual information dominates the auditorial one.
This effect is in line with the theory of Visual Dominance, which describes the phenomenon of the vision dominating over other modalities, leading to a perceived distortion of reality, like hearing a 'dada', where humans would hear a 'baba', if they ignored their visual sense.
</li>
<li>
Another example for the Visual Dominance theory is the act of a Ventriloquist, an auditory illusion, in which the sound is misperceived as emanating from a source that can be seen moving appropriately, namely the doll, when it actually emanates from the person holding the doll or a speaker. The same effect can be observed in movies, again the sound seems to emanate from actor's lips rather than from an invisible sound source.
Again, the visual information is dominating the auditorial one in order to achieve this deception, since of course most puppets don't actually talk.
</li>

<li>
The Audio-visual effect on counting describes the effect of more auditory stimulation leads to a mismatch in visual stimuli counts by the perceiver. This means if for a fraction of a second a picture of a dot is shown with two "beep" sounds, humans tend to have counted two dots, if asked.
Since the amounts of dots counted is mostly influenced and dominated by the sound, in this case the audio is dominant and therefore the whole Audio-visual effect on counting is a good example for the theory of modality appropriateness. Because modality appropriateness says that situational appropriateness determines dominant modality and, in this case, it is the hearing which is, according to the therory, dominant for hearing, that is used by the human to count the dots.
</li>

<li>
The Audio-visual location after Alais & Burr describes the phenomenon where humans combine auditory and visual information depending on how clear the visual information is. For example, if a person is placed in front of a screen and shown light "blobs" and sound "clicks" the person will rely on the visual information and will pinpoint the location of the "blob" and "click" on the screen precisely. But if the visual information gets more and more blurred, the person will more and more depend in the auditory information and use it to pinpoint the "blob" and "click". If the visual information is blurred to a similar precision as acoustic information has, both information get averaged. This fulfills the definition of optimal integration, where a weighting dependent on the estimated accuracy of information is described as a result and even an averaging is possible.
</li>
</ul>