Activation functions study for the trustworthiness supervisor artificial neural networks

Examining and potentially adjusting one’s cognitive processes in response to dissatisfaction with one’s performance is a fundamental aspect of intelligence. Remarkably, such sophisticated abstract concepts necessary for achieving Artificial General Intelligence can be effectively incorporated into basic Machine Learning algorithms. In this study, we introduce a method for replicating self-awareness through a supervisory Artificial Neural Network (ANN), which monitors patterns in the activation functions of an underlying ANN to identify signs of substantial uncertainty within the underlying ANN and, consequently, the reliability of its predictions. The underlying ANN in this context is a Convolutional Neural Network (CNN) ensemble primarily utilized for tasks related to facial recognition and facial expression analysis. We evaluate the performance of the supervisory ANNs using various activation functions as they learn to gauge the dependability of predictions made by the Inception v3 CNN ensemble. To conduct computational experiments, we employ a facial data set that incorporates makeup and occlusion factors. These experiments are designed to mimic real-world conditions where the training data set exclusively consists of images without makeup or occlusion, while the test data set comprises images featuring makeup and occlusion. This partitioning ensures the model is tested under challenging out-of-training data distribution scenarios.