Paper Abstract and Keywords |
Presentation |
2022-03-08 09:29
Context-Aware Speaker Estimation in Manga Toshiya Yamaguchi (TUS), Ryosuke Furuta (UTokyo), Yukinobu Taniguchi (TUS), Ryota Hinami, Shonosuke Ishiwatari (Mantra) |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
In manga, the story unfolds as the illustrated characters speak their lines expressed in text. Therefore, it is important for understanding manga to link each line to the character who speaks it.
In this study, we propose a context-aware speaker estimation method for manga that estimates the speaker of a line by taking consecutive lines as input. The proposed method considers the conversation context and the manga-specific expression by using the prediction results obtained by the natural language processing model and the candidate speakers defined by the distance between the target lines and each character in the manga image. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Manga / Speaker Estimation / / / / / / |
Reference Info. |
ITE Tech. Rep., vol. 46, pp. 67-70, March 2022. |
Paper # |
|
Date of Issue |
2022-03-01 (AIT) |
ISSN |
Print edition: ISSN 1342-6893 Online edition: ISSN 2424-1970 |
Download PDF |
|
Conference Information |
Committee |
AIT IIEEJ AS CG-ARTS |
Conference Date |
2022-03-08 - 2022-03-08 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Online |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Expressive Japan 2022 |
Paper Information |
Registration To |
IIEEJ |
Conference Code |
2022-03-AIT-IIEEJ-AS-ARTS |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Context-Aware Speaker Estimation in Manga |
Sub Title (in English) |
|
Keyword(1) |
Manga |
Keyword(2) |
Speaker Estimation |
Keyword(3) |
|
Keyword(4) |
|
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Toshiya Yamaguchi |
1st Author's Affiliation |
Tokyo University of Science (TUS) |
2nd Author's Name |
Ryosuke Furuta |
2nd Author's Affiliation |
The University of Tokyo (UTokyo) |
3rd Author's Name |
Yukinobu Taniguchi |
3rd Author's Affiliation |
Tokyo University of Science (TUS) |
4th Author's Name |
Ryota Hinami |
4th Author's Affiliation |
Mantra Inc (Mantra) |
5th Author's Name |
Shonosuke Ishiwatari |
5th Author's Affiliation |
Mantra Inc (Mantra) |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2022-03-08 09:29:00 |
Presentation Time |
12 minutes |
Registration for |
IIEEJ |
Paper # |
AIT2022-55 |
Volume (vol) |
vol.46 |
Number (no) |
no.10 |
Page |
pp.67-70 |
#Pages |
4 |
Date of Issue |
2022-03-01 (AIT) |