| Paper Abstract and Keywords |
| Presentation |
2026-10-08 16:40
[Invited Talk]
Safety Evaluation of Large Language Models
Tetsuro Takahashi (Kagoshima Univ.) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
The use of generative AI is rapidly expanding beyond a small group of specialists to a broad range of users, making its safety an increasingly important concern. In order to build a society in which people can use generative AI with confidence, it is essential to assess its safety appropriately and use the results to inform users' choices and guide system improvements. This talk focuses on Japanese-language large language models (LLMs) and discusses a range of safety risks associated with interactions with LLMs, including disinformation and misinformation, bias, discrimination, and outputs that violate public order and accepted moral standards. It then introduces efforts to evaluate safety and tune models based on the evaluation results. A variety of benchmarks have been developed and used to evaluate LLM safety. As part of these broader efforts, a collaborative project involving industry, government, and academia was launched in autumn 2025 to develop a safety benchmark, and work on the evaluation data is progressing steadily. Through safety evaluations, the project aims to provide useful information to both users and developers. For users, it seeks to provide information on LLM safety that is as accurate as possible, helping them make informed choices appropriate to their intended uses and circumstances. For developers, it provides insights that help identify areas where LLM safety needs improvement and guide concrete actions to address them. This talk introduces the project's activities and explores future directions for ensuring safety based on societal consensus. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
Large Language Models / Safety Evaluation / Benchmarks / Societal Consensus / / / / |
| Reference Info. |
ITE Tech. Rep. |
| Paper # |
|
| Date of Issue |
|
| ISSN |
Online edition: ISSN 2424-1970 |
| Download PDF |
|
| Conference Information |
| Committee |
IEICE-SIS BCT |
| Conference Date |
2026-10-08 - 2026-10-09 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Kagoshima Univ. |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
|
| Paper Information |
| Registration To |
IEICE-SIS |
| Conference Code |
2026-10-SIS-BCT |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Safety Evaluation of Large Language Models |
| Sub Title (in English) |
|
| Keyword(1) |
Large Language Models |
| Keyword(2) |
Safety Evaluation |
| Keyword(3) |
Benchmarks |
| Keyword(4) |
Societal Consensus |
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Tetsuro Takahashi |
| 1st Author's Affiliation |
Kagoshima University (Kagoshima Univ.) |
| 2nd Author's Name |
|
| 2nd Author's Affiliation |
() |
| 3rd Author's Name |
|
| 3rd Author's Affiliation |
() |
| 4th Author's Name |
|
| 4th Author's Affiliation |
() |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-1 |
| Date Time |
2026-10-08 16:40:00 |
| Presentation Time |
60 minutes |
| Registration for |
IEICE-SIS |
| Paper # |
|
| Volume (vol) |
vol.50 |
| Number (no) |
|
| Page |
|
| #Pages |
|
| Date of Issue |
|