| Paper Abstract and Keywords |
| Presentation |
2025-02-19 10:25
Communication-Efficient Real-Time External Abnormality Detection for AVs Using MLLMs
Kiminobu Makino, Naoya Kaneko, Toru Furusawa, Haruka Futatsubashi, Shota Mishima (TMC) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
This paper proposes a real-time external abnormality detection method for autonomous vehicles (AVs) using multimodal large language models (MLLMs). In recent years, the R&D of AV technology has advanced significantly, and trials of fully AVs have begun. Fully AVs are expected to solve critical transportation challenges. However, the absence of drivers challenges rapid responses to external abnormalities, such as traffic accidents and congestion. The proposed method achieves an F1 score of up to 0.97, indicating superior abnormality detection performance. Compared to conventional methods, the
proposed method achieves up to four orders of magnitude reduction in communication costs during normal operation and one order of magnitude during abnormality situations, while maintaining real-time capabilities. Furthermore, this paper analyzes the system’s break-even point to offer practical design guidelines. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
MLLM / abnormality detection / autonomous driving / communication efficiency / real-time communication / / / |
| Reference Info. |
ITE Tech. Rep. |
| Paper # |
|
| Date of Issue |
|
| ISSN |
Online edition: ISSN 2424-1970 |
| Download PDF |
|
| Conference Information |
| Committee |
ME AIT MMS IEICE-IE IEICE-ITS SIP |
| Conference Date |
2025-02-18 - 2025-02-19 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Hokkaido Univ. |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Image Processing, etc. |
| Paper Information |
| Registration To |
IEICE-ITS |
| Conference Code |
2025-02-ITS-IE-MMS-ME-AIT-SIP |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Communication-Efficient Real-Time External Abnormality Detection for AVs Using MLLMs |
| Sub Title (in English) |
|
| Keyword(1) |
MLLM |
| Keyword(2) |
abnormality detection |
| Keyword(3) |
autonomous driving |
| Keyword(4) |
communication efficiency |
| Keyword(5) |
real-time communication |
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Kiminobu Makino |
| 1st Author's Affiliation |
Toyota Motor Corporation (TMC) |
| 2nd Author's Name |
Naoya Kaneko |
| 2nd Author's Affiliation |
Toyota Motor Corporation (TMC) |
| 3rd Author's Name |
Toru Furusawa |
| 3rd Author's Affiliation |
Toyota Motor Corporation (TMC) |
| 4th Author's Name |
Haruka Futatsubashi |
| 4th Author's Affiliation |
Toyota Motor Corporation (TMC) |
| 5th Author's Name |
Shota Mishima |
| 5th Author's Affiliation |
Toyota Motor Corporation (TMC) |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-1 |
| Date Time |
2025-02-19 10:25:00 |
| Presentation Time |
15 minutes |
| Registration for |
IEICE-ITS |
| Paper # |
|
| Volume (vol) |
vol.49 |
| Number (no) |
|
| Page |
|
| #Pages |
|
| Date of Issue |
|