ITE Technical Group Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2023-09-07 09:30
An Automatic Generation of Guitar Playing Avatar using TDPT from Air Guitar Performance
Yuuta Ueno, Isao Miyagawa (SIT)
Abstract (in Japanese) (See Japanese page) 
(in English) We aim to realize unique live music performances in a metaverse space with easy operation and low-cost equipment. It provides live music performances that reflect individuality as with streaming a live video on personal YouTube channel. We propose a method to automatically generate an avatar that plays a guitar in accordance with the movements of an air musical performance. Our approach introduces TDPT (ThreeDPoseTracker) to obtain 3D coordinates of sample points defined on a human body by using single camera. Our method generates an avatar with playing a guitar linked to the motion of the sample points in response to user's air guitar performances. Our experiments demonstrate the usefulness of the proposed method by comparing it to avatar generation using a high-performance motion capture system. Our experimental results show that our method faithfully reproduces guitar performance avatars from image sequence in real time.
Keyword (in Japanese) (See Japanese page) 
(in English) 3D Human Pose / TDPT / Motion Capture Systems / 3D Humanoid Model / Avatar / / /  
Reference Info. ITE Tech. Rep., vol. 47, no. 25, ME2023-89, pp. 1-6, Sept. 2023.
Paper # ME2023-89 
Date of Issue 2023-08-31 (ME) 
ISSN Online edition: ISSN 2424-1970
Download PDF

Conference Information
Conference Date 2023-09-07 - 2023-09-07 
Place (in Japanese) (See Japanese page) 
Place (in English) Osaka Metropolitan Univ. 
Topics (in Japanese) (See Japanese page) 
Topics (in English)  
Paper Information
Registration To ME 
Conference Code 2023-09-ME-EMM-IE-LOIS-CMN-AVM 
Language Japanese 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) An Automatic Generation of Guitar Playing Avatar using TDPT from Air Guitar Performance 
Sub Title (in English)  
Keyword(1) 3D Human Pose  
Keyword(2) TDPT  
Keyword(3) Motion Capture Systems  
Keyword(4) 3D Humanoid Model  
Keyword(5) Avatar  
1st Author's Name Yuuta Ueno  
1st Author's Affiliation Shonan Institute of Technology (SIT)
2nd Author's Name Isao Miyagawa  
2nd Author's Affiliation Shonan Institute of Technology (SIT)
3rd Author's Name  
3rd Author's Affiliation ()
4th Author's Name  
4th Author's Affiliation ()
5th Author's Name  
5th Author's Affiliation ()
6th Author's Name  
6th Author's Affiliation ()
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Speaker Author-1 
Date Time 2023-09-07 09:30:00 
Presentation Time 20 minutes 
Registration for ME 
Paper # ME2023-89 
Volume (vol) vol.47 
Number (no) no.25 
Page pp.1-6 
Date of Issue 2023-08-31 (ME) 

[Return to Top Page]

[Return to ITE Web Page]

The Institute of Image Information and Television Engineers (ITE), Japan