| Paper Abstract and Keywords |
| Presentation |
2023-03-06 10:25
Automating NPC Reactions Using Acoustic Feature Recognition Technology in Games
Maria Kuroda, Yoshihisa Kanematsu, Suguru Matsuyoshi, Hirokazu Yasuhara, Koji Mikami (TUT) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
Speech recognition games are progressing day by day, mainly through the improvement of natural language processing technology, so that even ambiguous utterances of the player can be processed. However, existing game productions have not taken into account what is described as "tone of voice" which can contain information about the speaker's intentions and emotions. Therefore, this study focuses on the human tone of voice. We developed SEReN, a system that infers emotions from players' speech and changes NPCs' reactions and responses according to estimated emotions. Subsequently, we conducted system evaluation experiments. The emotional connection to the NPC character was evaluated using a questionnaire. The study revealed a significant difference between SEReN and the conventional system for some of the questions. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
Speech recognition / Emotion inference / NPC emotion expression / / / / / |
| Reference Info. |
ITE Tech. Rep., vol. 47, pp. 227-230, March 2023. |
| Paper # |
|
| Date of Issue |
2023-02-27 (AIT) |
| ISSN |
Print edition: ISSN 1342-6893 Online edition: ISSN 2424-1970 |
| Download PDF |
|
| Conference Information |
| Committee |
AIT IIEEJ AS CG-ARTS |
| Conference Date |
2023-03-06 - 2023-03-06 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Tokyo Polytechnic Univ. (Nakano) |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Expressive Japan 2023 |
| Paper Information |
| Registration To |
AS |
| Conference Code |
2023-03-AIT-IIEEJ-AS-ARTS |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Automating NPC Reactions Using Acoustic Feature Recognition Technology in Games |
| Sub Title (in English) |
|
| Keyword(1) |
Speech recognition |
| Keyword(2) |
Emotion inference |
| Keyword(3) |
NPC emotion expression |
| Keyword(4) |
|
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Maria Kuroda |
| 1st Author's Affiliation |
Tokyo University of Technology (TUT) |
| 2nd Author's Name |
Yoshihisa Kanematsu |
| 2nd Author's Affiliation |
Tokyo University of Technology (TUT) |
| 3rd Author's Name |
Suguru Matsuyoshi |
| 3rd Author's Affiliation |
Tokyo University of Technology (TUT) |
| 4th Author's Name |
Hirokazu Yasuhara |
| 4th Author's Affiliation |
Tokyo University of Technology (TUT) |
| 5th Author's Name |
Koji Mikami |
| 5th Author's Affiliation |
Tokyo University of Technology (TUT) |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| Speaker |
Author-1 |
| Date Time |
2023-03-06 10:25:00 |
| Presentation Time |
80 minutes |
| Registration for |
AS |
| Paper # |
AIT2023-99 |
| Volume (vol) |
vol.47 |
| Number (no) |
no.9 |
| Page |
pp.227-230 |
| #Pages |
4 |
| Date of Issue |
2023-02-27 (AIT) |