| Paper Abstract and Keywords |
| Presentation |
2024-10-03 14:30
Object Location Interpretation for Service Robots using Vision-Language Model and Object Detection Model
Kosei Yamao, Daiju Kanaoka, Kosei Isomoto, Hakaru Tamukoh (Kyutech) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
Service robots are required to understand and execute various commands from humans. However, robots have challenges recognizing the environment and interpreting an object's location. For example, when a robot receives a command, ``Bring me the fruit behind the cup,'' it cannot understand the concept of "behind" in real-world space, making it difficult to perform the command correctly. To solve this problem, we propose a new method in which a vision-language model can accurately understand the positional relationship of target objects by overlaying marks only on the objects to be recognized using an object detection model. Experimental results show that the proposed system is more accurate than the previous method. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
object location interpretation / service robots / visual prompting / object detection / vision-language model / / / |
| Reference Info. |
ITE Tech. Rep. |
| Paper # |
|
| Date of Issue |
|
| ISSN |
Online edition: ISSN 2424-1970 |
| Download PDF |
|
| Conference Information |
| Committee |
IEICE-SIS BCT |
| Conference Date |
2024-10-03 - 2024-10-04 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Hokusei Gakuen Univ. |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
|
| Paper Information |
| Registration To |
IEICE-SIS |
| Conference Code |
2024-10-SIS-BCT |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Object Location Interpretation for Service Robots using Vision-Language Model and Object Detection Model |
| Sub Title (in English) |
|
| Keyword(1) |
object location interpretation |
| Keyword(2) |
service robots |
| Keyword(3) |
visual prompting |
| Keyword(4) |
object detection |
| Keyword(5) |
vision-language model |
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Kosei Yamao |
| 1st Author's Affiliation |
Kyushu Institute of Technology (Kyutech) |
| 2nd Author's Name |
Daiju Kanaoka |
| 2nd Author's Affiliation |
Kyushu Institute of Technology (Kyutech) |
| 3rd Author's Name |
Kosei Isomoto |
| 3rd Author's Affiliation |
Kyushu Institute of Technology (Kyutech) |
| 4th Author's Name |
Hakaru Tamukoh |
| 4th Author's Affiliation |
Kyushu Institute of Technology (Kyutech) |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| Speaker |
Author-1 |
| Date Time |
2024-10-03 14:30:00 |
| Presentation Time |
20 minutes |
| Registration for |
IEICE-SIS |
| Paper # |
|
| Volume (vol) |
vol.48 |
| Number (no) |
|
| Page |
|
| #Pages |
|
| Date of Issue |
|