## A Short Introduction to Spoken Language Processing Dr. Chen-Yu Chiang (江振宇博士) Speech & Multimedia Signal Processing Lab (SMSPLab) Dept. of Communication Engineering, National Taipei University, Taiwan --- ### Spoken Language Processing is Ubiquitous! (1/3) <hr /> - Human to human phone communications: - local call (家用電話) - mobile phone (行動電話) - voice over internet protocol (VoIP like Skype) - concall/video/audio conferece (Google Meet/Webex/Team/Zoom/jitsi) --- ### Spoken Language Processing is Ubiquitous! (2/3) <hr /> - Human-machine communication: - Apple Siri - Amazon Alexa - Google home - 小米音箱 - Google voice search --- ### Spoken Language Processing is Ubiquitous! (3/3) <hr /> - Assistive systems: - speech-generating device - speech-to-speech translation (e.g., Mandarin <--> English) - computer-assisted language learning system - talkback (語音輔助) - 雅婷逐字稿 - Any device that generates speech to inform you something! --- ### Spoken Language Processing Technologies <hr /> - Speech coding and compression - Speech recognition (speech to text) - Text to speech (TTS)/speech synthesis - Voice conversion - Spoken dialog system --- ##### If we do not have speech coding and compression by machines ... <hr /> {%youtube zQHhbhtpJ3M %} ###### source: https://www.youtube.com/watch?v=zQHhbhtpJ3M --- #### Speech to speech translation <hr />  --- #### Voice conversion <hr />  --- #### Sampling/cloning your voice! <hr /> * 在DJ雷欧的家中,洛托姆图鉴启动了新功能扩展——声音取样功能,同时洛托姆图鉴的假发也被库库伊博士送给了地鼠。 * 在阿羅拉!第一次的教學觀摩!!中,洛托姆图鉴运用声音取样功能,在教学观摩活动上代替小智进行发言,但结果由于洛托姆图鉴的语速越来越快以及突然用成也・大木的声音说出了宝可梦谐音冷笑话并且说出了“洛托”的口头禅而穿帮。 ###### source: http://www.linban.com/j/197604.shtml and https://wiki.52poke.com/wiki/%E5%AE%9D%E5%8F%AF%E6%A2%A6_%E5%A4%AA%E9%98%B3%EF%BC%86%E6%9C%88%E4%BA%AE_%E7%AC%AC24%E9%9B%86 --- ##### Stephen Hawking's speech-generating device, 2008 <hr /> {%youtube xjBIsp8mS-c %} ###### source: https://www.youtube.com/watch?v=xjBIsp8mS-c&t=508s --- ##### Project Revoice: What it means to lose your ability to speak (2018) <hr /> {%youtube 6A2zt3JrPFo %} ###### source: https://www.youtube.com/watch?v=6A2zt3JrPFo&t=0s --- ##### Interview with Dr. Peter Scott-Morgan [Peter 2.0]: Changing what it means to be human (2022) {%youtube 8FkxDYvDL7U %} ###### source: https://www.youtube.com/watch?v=8FkxDYvDL7U&t=195s --- ##### Meet The 'Human Cyborg' Defying Motor Neuron Disease With The Help Of Technology (2021) {%youtube WQdCxQ6rG5s %} ###### source: https://www.youtube.com/watch?v=WQdCxQ6rG5s --- #### Scientist Attempts To Overcome MND! | Peter: The Human Cyborg (2021) {%youtube u3ovqznXZLs %} ###### source: https://www.youtube.com/watch?v=u3ovqznXZLs --- ##### 回聲計畫/重 聲 save & sound (2020-2021) {%youtube XYeAfpCGwIk %} ###### source: https://www.youtube.com/watch?v=XYeAfpCGwIk --- ### End >(c) Speech & Multimedia Signal Processing Lab (SMSPLab), National Taipei University, New Taipei City, Taiwan, 2012-2022