| Paper Abstract and Keywords |
| Presentation |
2023-09-07 09:30
An Automatic Generation of Guitar Playing Avatar using TDPT from Air Guitar Performance
Yuuta Ueno, Isao Miyagawa (SIT) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
We aim to realize unique live music performances in a metaverse space with easy operation and low-cost equipment. It provides live music performances that reflect individuality as with streaming a live video on personal YouTube channel. We propose a method to automatically generate an avatar that plays a guitar in accordance with the movements of an air musical performance. Our approach introduces TDPT (ThreeDPoseTracker) to obtain 3D coordinates of sample points defined on a human body by using single camera. Our method generates an avatar with playing a guitar linked to the motion of the sample points in response to user's air guitar performances. Our experiments demonstrate the usefulness of the proposed method by comparing it to avatar generation using a high-performance motion capture system. Our experimental results show that our method faithfully reproduces guitar performance avatars from image sequence in real time. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
3D Human Pose / TDPT / Motion Capture Systems / 3D Humanoid Model / Avatar / / / |
| Reference Info. |
ITE Tech. Rep., vol. 47, no. 25, ME2023-89, pp. 1-6, Sept. 2023. |
| Paper # |
ME2023-89 |
| Date of Issue |
2023-08-31 (ME) |
| ISSN |
Online edition: ISSN 2424-1970 |
| Download PDF |
|
| Conference Information |
| Committee |
ME IEICE-EMM IEICE-IE IEICE-LOIS IEE-CMN IPSJ-AVM |
| Conference Date |
2023-09-07 - 2023-09-07 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Osaka Metropolitan Univ. |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
|
| Paper Information |
| Registration To |
ME |
| Conference Code |
2023-09-ME-EMM-IE-LOIS-CMN-AVM |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
An Automatic Generation of Guitar Playing Avatar using TDPT from Air Guitar Performance |
| Sub Title (in English) |
|
| Keyword(1) |
3D Human Pose |
| Keyword(2) |
TDPT |
| Keyword(3) |
Motion Capture Systems |
| Keyword(4) |
3D Humanoid Model |
| Keyword(5) |
Avatar |
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Yuuta Ueno |
| 1st Author's Affiliation |
Shonan Institute of Technology (SIT) |
| 2nd Author's Name |
Isao Miyagawa |
| 2nd Author's Affiliation |
Shonan Institute of Technology (SIT) |
| 3rd Author's Name |
|
| 3rd Author's Affiliation |
() |
| 4th Author's Name |
|
| 4th Author's Affiliation |
() |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| Speaker |
Author-1 |
| Date Time |
2023-09-07 09:30:00 |
| Presentation Time |
20 minutes |
| Registration for |
ME |
| Paper # |
ME2023-89 |
| Volume (vol) |
vol.47 |
| Number (no) |
no.25 |
| Page |
pp.1-6 |
| #Pages |
6 |
| Date of Issue |
2023-08-31 (ME) |