| Paper Abstract and Keywords |
| Presentation |
2024-03-05 15:16
A Fundamental Study on 3D CG Image Quality Assessment in Vision & Language Based on Stable Diffusion
Norifumi Kawabata (Kanazawa Gakuin Univ.) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
GPT-4, which is a multimodal large-scale language model, was released on March 14, 2023. GPT-4 is equipped with Transformer, a machine learning model for natural language processing, which trains a large neural network through unsupervised learning, followed by reinforcement learning from human feedback (RLHF) based on human feedback. Although GPT-4 is one of the research achievements in the field of natural language processing (NLP), it is a technology that can be applied not only to natural language generation but also to image generation. However, specifications for GPT-4 have not been made public, therefore it is difficult to use for research purposes. In this study, we first generated an image database by adjusting parameters using Stable Diffusion, which is a deep learning model that is also used for image generation based on text input and images. And then, we carried out experiments to evaluate the image quality from the generated database, and discussed the quality assessment of the image generation model. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
Image Generation AI / Diffusion Model / Vision and Language / image-to-image / Image Quality Assessment / / / |
| Reference Info. |
ITE Tech. Rep., vol. 48, no. 8, AIT2024-115, pp. 288-291, March 2024. |
| Paper # |
AIT2024-115 |
| Date of Issue |
2024-02-27 (AIT) |
| ISSN |
Online edition: ISSN 2424-1970 |
| Download PDF |
|
| Conference Information |
| Committee |
AIT IIEEJ AS CG-ARTS |
| Conference Date |
2024-03-05 - 2024-03-05 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Tokyo University of Technology |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Expressive Japan 2024 |
| Paper Information |
| Registration To |
AIT |
| Conference Code |
2024-03-AIT-IIEEJ-AS-ARTS |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
A Fundamental Study on 3D CG Image Quality Assessment in Vision & Language Based on Stable Diffusion |
| Sub Title (in English) |
|
| Keyword(1) |
Image Generation AI |
| Keyword(2) |
Diffusion Model |
| Keyword(3) |
Vision and Language |
| Keyword(4) |
image-to-image |
| Keyword(5) |
Image Quality Assessment |
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Norifumi Kawabata |
| 1st Author's Affiliation |
Kanazawa Gakuin University (Kanazawa Gakuin Univ.) |
| 2nd Author's Name |
|
| 2nd Author's Affiliation |
() |
| 3rd Author's Name |
|
| 3rd Author's Affiliation |
() |
| 4th Author's Name |
|
| 4th Author's Affiliation |
() |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| Speaker |
Author-1 |
| Date Time |
2024-03-05 15:16:00 |
| Presentation Time |
12 minutes |
| Registration for |
AIT |
| Paper # |
AIT2024-115 |
| Volume (vol) |
vol.48 |
| Number (no) |
no.8 |
| Page |
pp.288-291 |
| #Pages |
4 |
| Date of Issue |
2024-02-27 (AIT) |
|