| Paper Abstract and Keywords |
| Presentation |
2022-03-08 09:54
Prototyping of a real-time sound effect tool for live streaming with CG avatar
Hikaru Murakami, Akinori Ito (TUT) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
In this study, we created a prototype of a tool that plays sound effects in real time in response to the actions of a CG avatar. We analyzed three VTuber live streams focusing on the actions and confirmed seven types of repeated actions and characteristic actions. The analysis of one of the movements, a small wave of the left hand, showed that the z-axis rotation occurred with a fixed period, and the angular velocity changed periodically around 0. Based on the results, we created a prototype that detects the motion and plays a sound effect using VIVE Pro 2. Using the prototype, we confirmed that the sound effect was played back along with the movement. We also ported some of the functions to HoloLens 2 and discussed them. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
CG Avatar / VTuber / Motion Capture / Unity / Sound Effect / / / |
| Reference Info. |
ITE Tech. Rep., vol. 46, pp. 17-20, March 2022. |
| Paper # |
|
| Date of Issue |
2022-03-01 (AIT) |
| ISSN |
Print edition: ISSN 1342-6893 Online edition: ISSN 2424-1970 |
| Download PDF |
|
| Conference Information |
| Committee |
AIT IIEEJ AS CG-ARTS |
| Conference Date |
2022-03-08 - 2022-03-08 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Online |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Expressive Japan 2022 |
| Paper Information |
| Registration To |
AS |
| Conference Code |
2022-03-AIT-IIEEJ-AS-ARTS |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Prototyping of a real-time sound effect tool for live streaming with CG avatar |
| Sub Title (in English) |
|
| Keyword(1) |
CG Avatar |
| Keyword(2) |
VTuber |
| Keyword(3) |
Motion Capture |
| Keyword(4) |
Unity |
| Keyword(5) |
Sound Effect |
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Hikaru Murakami |
| 1st Author's Affiliation |
Tokyo University of Technology (TUT) |
| 2nd Author's Name |
Akinori Ito |
| 2nd Author's Affiliation |
Tokyo University of Technology (TUT) |
| 3rd Author's Name |
|
| 3rd Author's Affiliation |
() |
| 4th Author's Name |
|
| 4th Author's Affiliation |
() |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| Speaker |
Author-1 |
| Date Time |
2022-03-08 09:54:00 |
| Presentation Time |
12 minutes |
| Registration for |
AS |
| Paper # |
AIT2022-42 |
| Volume (vol) |
vol.46 |
| Number (no) |
no.10 |
| Page |
pp.17-20 |
| #Pages |
4 |
| Date of Issue |
2022-03-01 (AIT) |