Exploración de Redes Neuronales Holográficas con Cuantificación Difusa para el Monitoreo de Conductores en Conducción Autónoma Condicional

Luis Ariel  Diago Marquez; Hiroe  Abe; Kana  Adachi; Ichiro  Hagiwara

Authors

Luis Ariel Diago Marquez MEIJI UNIVERSITY
Hiroe Abe MEIJI UNIVERSITY
Kana Adachi MEIJI UNIVERSITY
Ichiro Hagiwara MEIJI UNIVERSITY

Keywords:

Conditional driving automation; Explainable artificial intelligence; Driver monitoring; Fuzzy-Quantized Holographic Neural Networks

Abstract

The Society of Automotive Engineers (SAE) defines Automated Driving Systems (ADS) for road vehicles as being that can perform the entire dynamic driving task without a human driver in the loop. Under conditional driving automation (SAE Level 3), when automated driving fails the drivers are expected to resume manual driving. For this transition to occur safely, it is imperative that drivers react in an appropriate and timely manner, which is difficult to happen once the driver has been subjected to long distances of autonomous driving. Artificial Intelligence (AI) techniques could be used for safety assurance of adaptive safety-critical systems. Not only sensing the external environment of the vehicle, but also monitoring the state of the driver-vehicle communication. Further, the concept of explainable AI was highlighted as having potential to provide evidence from ADS that could support safety assurance and regulatory compliance. In this work we present a neuro-fuzzy method working as an explainable machine learning approach suitable for domains where validation of the underlying non-linear prediction models is required. The results of comparison between proposed model and other models from the literature show that the proposed model could provide explanations about its predictions in real time to ensure smooth transitions in SAE Level 3

References

Appriou, A., Cichocki, A., & Lotte, F. (2020). Modern Machine-Learning Algorithms: For Classifying Cognitive and Affective States From Electroencephalography Signals. IEEE Systems, Man, and Cybernetics Magazine, 6(3), 29-38.

Ballingall, S., Sarvi, M. & Sweatman, P. (2020). Safety Assurance Concepts for Automated Driving Systems. SAE Technical Paper Series, 2(3), pp. 1528-1537. doi:10.4271/2020-01-0727.

Braunagel, C., Rosenstiel, W., & Kasneci, E. (2017). Ready for take-over? A new driver assistance system for an automated classification of driver take-over readiness. IEEE Intelligent Transportation Systems Magazine, 9(4), 10-22.

Deo, N., & Trivedi, M. M. (2019). Looking at the driver/rider in autonomous vehicles to predict take-over readiness. IEEE Transactions on Intelligent Vehicles, 5(1), 41-52.

Diago, L., Kitaoka, T., Hagiwara, I., & Kambayashi, T. (2011a). Neuro-fuzzy quantification of personal perceptions of facial images based on a limited data set. IEEE Transactions on Neural Networks, 22(12), 2422-2434.

Diago, L., Kitaoka, T., Hagiwara, I., & Ishiguro, S. (2011b). Analyzing facial expressions with fuzzy quantification theory II: indefinite generalized eigenvalue problem. Japan Journal of Industrial and Applied Mathematics, 28(1), 153-170.

Diago, L., Yang, Y., Abe, H. & Hagiwara, I.. (2018). NeuroFaceLab : A new framework for passengers analysis in autonomous driving. En Proceedings of the 31st International Computational Mechanics Symposium - CMD2018(286). Japan: JSME..

Fukushima, H., Kamada, Y., & Hagiwara, I. (2004). Optimum engine mounting layout using MPOD. Nippon Kikai Gakkai Ronbunshu, C Hen/Transactions of the Japan Society of Mechanical Engineers, Part C, 70(1), 54-61.

Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014). A survey on concept drift adaptation. ACM computing surveys (CSUR), 46(4), 1-37.

He, J., Liu, D., Wan, Z., & Hu, C. (2014). A noninvasive real-time driving fatigue detection technology based on left prefrontal Attention and Meditation EEG. In 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI) (pp. 1-6). IEEE.

Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural computation, 9(8), 1735-1780.

Khan, M. Q. y Lee, S. (2019). A Comprehensive Survey of Driving Monitoring and Assistance Systems. Sensors (Basel, Switzerland), 19(11), 2574. https://doi.org/10.3390/s19112574

Kudo, M., Toyama, J., & Shimbo, M. (1999). Multidimensional curve classification using passing-through regions. Pattern Recognition Letters, 20(11-13), 1103-1111.

Roche, F., Somieski, A., & Brandenburg, S. (2019). Behavioral changes to repeated takeovers in highly automated driving: effects of the takeover-request design and the nondriving-related task modality. Human factors, 61(5), 839-849.

SAE On-Road Automated Vehicle Standards Committee. (2018). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. SAE International: Warrendale, PA, USA.

Sutherland, J. G. (1990). A holographic model of memory, learning and expression. International Journal of Neural Systems, 1(03), 259-267.

Wu, Y., Kihara, K., Hasegawa, K., Takeda, Y., Sato, T., Akamatsu, M., & Kitazaki, S. (2020). Age-related differences in effects of non-driving related tasks on takeover performance in automated driving. Journal of safety research, 72, 231-238.