Paper Abstract and Keywords |
Presentation |
2025-02-18 15:55
A Note on Personalized Anomaly Detection Based on Vision Language Model Using Image Prompt Haruka Matsuda, Ren Togo, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama (Hokkaido Univ.) |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
This paper presents a personalized anomaly detection method based on the Vision Language Model (VLM) that utilizes image prompt input. Conventional VLM-based anomaly detection methods mainly utilize Contrastive Language-Image Pre-training (CLIP) to detect anomalies based on the relationship between text and image features. However, such approaches have a problem that detailed information on the target object is missing when calculating features.
To address this problem, our study inputs target object information into the overall structure of CLIP via image prompts. This operation suppresses the missing information and enables accurate anomaly detection of object-specific anomalies. In addition, by constructing a framework that allows arbitrary image prompt input to CLIP's image encoder through an adapter, the proposed method can handle both general anomalies and object-specific anomalies. At the end of the paper, we verify the effectiveness of the proposed method through experiments using a real-world dataset for industrial anomaly detection. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Anomaly detection / Vision language model / Personalization / Vision transformer / / / / |
Reference Info. |
ITE Tech. Rep., vol. 49, no. 4, ME2025-18, pp. 91-95, Feb. 2025. |
Paper # |
ME2025-18 |
Date of Issue |
2025-02-11 (MMS, ME, AIT, SIP) |
ISSN |
Online edition: ISSN 2424-1970 |
Download PDF |
|
Conference Information |
Committee |
ME AIT MMS IEICE-IE IEICE-ITS SIP |
Conference Date |
2025-02-18 - 2025-02-19 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Hokkaido Univ. |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Image Processing, etc. |
Paper Information |
Registration To |
ME |
Conference Code |
2025-02-ME-AIT-MMS-IE-ITS-SIP |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
A Note on Personalized Anomaly Detection Based on Vision Language Model Using Image Prompt |
Sub Title (in English) |
|
Keyword(1) |
Anomaly detection |
Keyword(2) |
Vision language model |
Keyword(3) |
Personalization |
Keyword(4) |
Vision transformer |
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Haruka Matsuda |
1st Author's Affiliation |
Hokkaido University (Hokkaido Univ.) |
2nd Author's Name |
Ren Togo |
2nd Author's Affiliation |
Hokkaido University (Hokkaido Univ.) |
3rd Author's Name |
Keisuke Maeda |
3rd Author's Affiliation |
Hokkaido University (Hokkaido Univ.) |
4th Author's Name |
Takahiro Ogawa |
4th Author's Affiliation |
Hokkaido University (Hokkaido Univ.) |
5th Author's Name |
Miki Haseyama |
5th Author's Affiliation |
Hokkaido University (Hokkaido Univ.) |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
21st Author's Name |
|
21st Author's Affiliation |
() |
22nd Author's Name |
|
22nd Author's Affiliation |
() |
23rd Author's Name |
|
23rd Author's Affiliation |
() |
24th Author's Name |
|
24th Author's Affiliation |
() |
25th Author's Name |
|
25th Author's Affiliation |
() |
26th Author's Name |
/ / |
26th Author's Affiliation |
()
() |
27th Author's Name |
/ / |
27th Author's Affiliation |
()
() |
28th Author's Name |
/ / |
28th Author's Affiliation |
()
() |
29th Author's Name |
/ / |
29th Author's Affiliation |
()
() |
30th Author's Name |
/ / |
30th Author's Affiliation |
()
() |
31st Author's Name |
/ / |
31st Author's Affiliation |
()
() |
32nd Author's Name |
/ / |
32nd Author's Affiliation |
()
() |
33rd Author's Name |
/ / |
33rd Author's Affiliation |
()
() |
34th Author's Name |
/ / |
34th Author's Affiliation |
()
() |
35th Author's Name |
/ / |
35th Author's Affiliation |
()
() |
36th Author's Name |
/ / |
36th Author's Affiliation |
()
() |
Speaker |
Author-1 |
Date Time |
2025-02-18 15:55:00 |
Presentation Time |
15 minutes |
Registration for |
ME |
Paper # |
MMS2025-18, ME2025-18, AIT2025-18, SIP2025-18 |
Volume (vol) |
vol.49 |
Number (no) |
no.4 |
Page |
pp.91-95 |
#Pages |
5 |
Date of Issue |
2025-02-11 (MMS, ME, AIT, SIP) |