# Compare cross modality calibration with audio modality calibration ## Research Question 1. **To what extent does the calibration improve audio room size perception?** 2. <font color="#f00">**Is the effect (improvement, which means higher accurarcy) of the calibration different between calibration methods on different modalities?**</font> This research question is want to compare the calibration effect between two condition (adjust auditory stmuli / adjust visual stimuli). **拆開詳細一點RQ2** 3. **Is the workload of the tasks different these two calibration?** ## Experiment Design Factors 寫清楚 3*2 ### Condition 1. Adjust visual stmuli to match the audio room size 2. Adjust audio stmuli to match the audio room size match 的用詞 量測方式在寫細 ### Phase Pretest → Calibration → Post-test ### Tasks - Condition (1) - same as the previous experiment design * **Pretest and Post-test** 1. **Perceiving stage**: Listen to the audio stimuli 2. **Measurement stage**: Adjust the visual virtual room to match the perceived room size (**no audio stimuli here**). * **Calibration** 1. **Perceiving stage**: Listen to the audio stimuli 2. **Measurement stage**: Adjust the visual virtual room to match the perceived room size (**no audio stimuli here**). 3. **Correction stage**: Red wall will be shown as the correct position of the walls, adjust the walls to the correct position, and the walls will turn green. (feed back and correction) ### Tasks - Condition (2) <font color="#f00">**The biggest difference between the other condition is that in the measurement stage, there is audio stimuli or not.**</font> <font color="#00f">The target is to let participant to answer with audio modality but need to avoid doing only audio matching, therefore, there is something needed to let the participant know they are answering the room size.</font> * **Pretest and Post-test** 1. **Perceiving stage**: Listen to the audio stimuli 2. **Measurement stage**: 1. Manipulate the size of the room (can see the room), simulate the audio change with the size at the same time (can hear the stimuli, and see the visual stimuli at the same time). 2. Manipulate the size of the room (can see the room, with no audio stimuli in the beginning). When the size hit the wanted one, press a button, visual stimuli will disappear, and audio stimuli can be heard (visual and audio stimuli are not appeared in the same time). Participant can decide if he want to confirm the answer or continue the adjustment. 3. Adjust the audio stimuli without visual stimuli (it is like adjusting invisible walls, which cause the room acoustics to change according the room made by the invisible walls.), when participant thinks it's the size they want, press a butoon, the visual walls will show up ,and the audio stimuli will stop. Participant can decide if he want to confirm the answer or continue the adjustment. The difference between (1)&(2) is that the audio stimuli appear at the same time or not. (3) is like the opposite of (2), the participant adjust audio stimuli , and the visual stimuli will show after the confirmation. (3) is not discussed in the meeting. I noted (3) method down here because I still felt a little be strange that (1) or (2) let the participant to correct on audio modality. Therefore, just noted it here as one of possibile designs. * **Calibration** 定義一些詞彙,比較好解釋 關鍵字、列表、流程圖 **明顯標示差異** 不一樣東西再強調 Continuous 的thresold 1. **Perceiving stage**: Listen to the audio stimuli 2. **Measurement stage**: 1. Manipulate the size of the room (can see the room), simulate the audio change with the size at the same time (can hear the stimuli, and see the visual stimuli at the same time). 2. Manipulate the size of the room (**can see the room, without audio stimuli in the beginning**). When the size hit the wanted one, press a button, visual stimuli will disappear, and audio stimuli can be heard (visual and audio stimuli are not appeared in the same time). Participant can decide if he want to confirm the answer or continue the adjustment. 3. Adjust the audio stimuli without visual stimuli (it is like adjusting invisible walls, which cause the room acoustics to change according the room made by the invisible walls.), when participant thinks it's the size they want, press a butoon, the visual walls will show up ,and the audio stimuli will stop. Participant can decide if he want to confirm the answer or continue the adjustment. 3. **Correction stage**: After the confirmation of the response, the correct answer (both visual and the audio) will show together for a period of time then disappear. The participant need to adjust until the correct answer was hit. If the correct answer is hit, the walls turn green. # Calibration in a Reverse Way ## Research Question 1. **To what extent the calibration with visual stimuli improve audio room size perception?** 2. **Does the calibration effect exist in the opposite condition?** Let the participant to see the room, adjust audio stimuli. 3. **Difference between the both ways** ## Experiment Design ### Condition 1. Adjust visual stmuli to match the audio room size 2. Adjust audio stmuli to match the visual room size ### Phase Pretest → Calibration → Post-test ### Tasks Condition (1) - same as the previous experiment design * **Pretest and Post-test** 1. **Perceiving stage**: Listen to the audio stimuli 2. **Measurement stage**: Adjust the visual virtual room to match the perceived room size (**no audio stimuli here**). * **Calibration** 1. **Perceiving stage**: Listen to the audio stimuli 2. **Measurement stage**: Adjust the visual virtual room to match the perceived room size (**no audio stimuli here**). 3. **Correction stage**: Red wall will be shown as the correct position of the walls, adjust the walls to the correct position, and the walls will turn green. (feed back and correction) ### Tasks Condition (2) * **Pretest and Post-test** 1. **Perceiving stage**: See the visual room. 2. **Measurement stage**: Adjust the audio stimuli (it is like adjusting invisible walls which cause the room acoustics to change according the room made by the invisible walls.) to match the room in previous stage (without visual stimuli). * **Calibration** 1. **Perceiving stage**: See the visual room. 2. **Measurement stage**: Adjust the audio stimuli (it is like adjusting invisible walls, which cause the room acoustics to change according the room made by the invisible walls.) to match the room in previous stage (without visual stimuli). 3. **Correction stage**: * There will be sounds to let the participant know their answer is too small or too large, and the participant need to adjust the wall util the correct size is hit. * There will be visible ui (maybe words) to let the participant know their answer is too small or too large, and the participant need to adjust the wall util the correct size is hit.