ITE Technical Group Submission System
Conference Paper's Information		 Online Proceedings
[Sign in]
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2023-05-31 16:40
AR Environmental Sound Display with Onomatopoeia for Deaf or Hard of Hearing People
Yuito Arisumi, Yutaro Hirao, Monica Perusquia-Hernandez (NAIST), Naoya Isoyama (Otsuma Women's University), Hideaki Uchiyama, Kiyoshi Kiyokawa (NAIST)
Abstract (in Japanese) (See Japanese page) 
(in English) In Japan, onomatopoeia such as onomatopoeia and mimetic words are often used to add concreteness to speech. On the other hand, hearing-impaired people rarely use onomatopoeia because they use sign language for conversation. Therefore, in order to learn onomatopoeia, deaf people learn onomatopoeia through reading and classes at schools for the deaf, but it is difficult to learn onomatopoeia because it is difficult to connect onomatopoeia with one's own experiences and the atmosphere of the place. In this study, we propose an AR device that superimposes sounds generated by the user and surrounding sound effects as onomatopoeia in real time. This enables users to be exposed to various onomatopoeia in their daily lives, making it easier to learn based on their own experiences.
Keyword (in Japanese) (See Japanese page) 
(in English) augmented reality / hearing-impaired person / onomatopoeia / sound source localization / / / /  
Reference Info. ITE Tech. Rep.
Paper #  
Date of Issue  
ISSN Online edition: ISSN 2424-1970
Download PDF

Conference Information
Committee IEICE-MVE HI VRSJ HI-SIG-DeMO IPSJ-HCI IPSJ-EC  
Conference Date 2023-05-31 - 2023-06-01 
Place (in Japanese) (See Japanese page) 
Place (in English) Univ. of Tokyo 
Topics (in Japanese) (See Japanese page) 
Topics (in English)  
Paper Information
Registration To IEICE-MVE 
Conference Code 2023-05-MVE-HCI-EC-VRSJ-HI-SIG-DeMO 
Language Japanese 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) AR Environmental Sound Display with Onomatopoeia for Deaf or Hard of Hearing People 
Sub Title (in English)  
Keyword(1) augmented reality  
Keyword(2) hearing-impaired person  
Keyword(3) onomatopoeia  
Keyword(4) sound source localization  
Keyword(5)  
Keyword(6)  
Keyword(7)  
Keyword(8)  
1st Author's Name Yuito Arisumi  
1st Author's Affiliation Nara Institute of Science and Technology (NAIST)
2nd Author's Name Yutaro Hirao  
2nd Author's Affiliation Nara Institute of Science and Technology (NAIST)
3rd Author's Name Monica Perusquia-Hernandez  
3rd Author's Affiliation Nara Institute of Science and Technology (NAIST)
4th Author's Name Naoya Isoyama  
4th Author's Affiliation Otsuma Women's University (Otsuma Women's University)
5th Author's Name Hideaki Uchiyama  
5th Author's Affiliation Nara Institute of Science and Technology (NAIST)
6th Author's Name Kiyoshi Kiyokawa  
6th Author's Affiliation Nara Institute of Science and Technology (NAIST)
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Speaker Author-1 
Date Time 2023-05-31 16:40:00 
Presentation Time 20 minutes 
Registration for IEICE-MVE 
Paper #  
Volume (vol) vol. 
Number (no)  
Page  
#Pages  
Date of Issue  

[Return to Top Page]

[Return to ITE Web Page]
The Institute of Image Information and Television Engineers (ITE), Japan