| Paper Abstract and Keywords |
| Presentation |
2023-05-31 16:40
AR Environmental Sound Display with Onomatopoeia for Deaf or Hard of Hearing People
Yuito Arisumi, Yutaro Hirao, Monica Perusquia-Hernandez (NAIST), Naoya Isoyama (Otsuma Women's University), Hideaki Uchiyama, Kiyoshi Kiyokawa (NAIST) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
In Japan, onomatopoeia such as onomatopoeia and mimetic words are often used to add concreteness to speech. On the other hand, hearing-impaired people rarely use onomatopoeia because they use sign language for conversation. Therefore, in order to learn onomatopoeia, deaf people learn onomatopoeia through reading and classes at schools for the deaf, but it is difficult to learn onomatopoeia because it is difficult to connect onomatopoeia with one's own experiences and the atmosphere of the place. In this study, we propose an AR device that superimposes sounds generated by the user and surrounding sound effects as onomatopoeia in real time. This enables users to be exposed to various onomatopoeia in their daily lives, making it easier to learn based on their own experiences. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
augmented reality / hearing-impaired person / onomatopoeia / sound source localization / / / / |
| Reference Info. |
ITE Tech. Rep. |
| Paper # |
|
| Date of Issue |
|
| ISSN |
Online edition: ISSN 2424-1970 |
| Download PDF |
|
| Conference Information |
| Committee |
IEICE-MVE HI VRSJ HI-SIG-DeMO IPSJ-HCI IPSJ-EC |
| Conference Date |
2023-05-31 - 2023-06-01 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Univ. of Tokyo |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
|
| Paper Information |
| Registration To |
IEICE-MVE |
| Conference Code |
2023-05-MVE-HCI-EC-VRSJ-HI-SIG-DeMO |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
AR Environmental Sound Display with Onomatopoeia for Deaf or Hard of Hearing People |
| Sub Title (in English) |
|
| Keyword(1) |
augmented reality |
| Keyword(2) |
hearing-impaired person |
| Keyword(3) |
onomatopoeia |
| Keyword(4) |
sound source localization |
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Yuito Arisumi |
| 1st Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
| 2nd Author's Name |
Yutaro Hirao |
| 2nd Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
| 3rd Author's Name |
Monica Perusquia-Hernandez |
| 3rd Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
| 4th Author's Name |
Naoya Isoyama |
| 4th Author's Affiliation |
Otsuma Women's University (Otsuma Women's University) |
| 5th Author's Name |
Hideaki Uchiyama |
| 5th Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
| 6th Author's Name |
Kiyoshi Kiyokawa |
| 6th Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-1 |
| Date Time |
2023-05-31 16:40:00 |
| Presentation Time |
20 minutes |
| Registration for |
IEICE-MVE |
| Paper # |
|
| Volume (vol) |
vol. |
| Number (no) |
|
| Page |
|
| #Pages |
|
| Date of Issue |
|