Search Results - "activation function"

The paper discusses issues connected with the use of an artificial neural network (ANN) to approximate the experimental data. One of the problems in the development of the ANN is the choice of an appropriate activation function for neurons of the hidden layer and adjusting the parameters of the func...

Full description

In this paper, the task of assessment of numerical conditioning of multilayer perceptron, forecasting time series with sliding window method, has been considered. Performance of the forecasting perceptron with various hyperparameters sets, with different amount of neurons and various activation func...

Full description

Batik motifs from South Sulawesi such as the Pinisi boat, Lontara script, Tongkonan house and Toraja combinations embody rich cultural narratives but are difficult to identify automatically. Automatic classification supports cultural preservation and education and empowers tourism and digital herita...

Full description

In deep learning, activation functions (AFs) influence a model’s performance, convergence rate, and generalization capability. Conventional activation functions such as ReLU, Swish, ELU, and Tanh have been widely utilized, each offering distinct advantages but also exhibiting intrinsic dr...

Full description

In recent years, Artificial Neural Networks (ANNs) have stood out among machine learning algorithms in many applications, such as image and video pattern recognition. Activation functions play a crucial role in the operation of these algorithms, directly influencing the effectiveness of ANNs. The lo...

Full description

Multi-label classification is a crucial machine learning task that assigns multiple labels to a single instance, making it distinct from traditional single-label classification. The sigmoid activation function, commonly used in multi-label learning, suffers from saturation and vanishing gradient iss...

Full description

Inkjet-printed circuits on flexible substrates are rapidly emerging as a key technology in flexible electronics, driven by their minimal fabrication process, cost-effectiveness, and environmental sustainability. Recent advancements in inkjet-printed devices and circuits have broadened their applicat...

Full description

Gesture recognition aims to understand the dynamic gestures of human body, and is one of the most important interaction methods in the field of human-computer interaction. In order to improve the current situation that the existing gesture recognition algorithms need a lot of training data, this pap...

Full description

Laser-induced breakdown spectroscopy (LIBS) has played a critical role in Mars exploration missions, substantially contributing to the geochemical analysis of Martian surface substances. However, the complex nonlinearity of LIBS processes can considerably limit the quantification accuracy of convent...

Full description

The article describes some principles of operation of an artificial neural network. It provides an example of implementing a neural network model by selecting its best architecture using the Statistica 12 software package. The article considers a method for neural network forecasting of a series of...

Full description

In state is to analyze the influence an activation function, strategy initialization and kind of normaliza- tion on the quality of a training and generalization.

Our goal is addressing the problems of preassigned-time projective synchronization and fixed-time projective synchronization of the system that studied in our article, and fuzzy terms, mixed delays, inertial terms and discontinuous activation function are also included in this system. And the result...

Full description

Purpose of the research. The purpose of this research is to study the problems of the features of teaching technologies of modern artificial neural networks for carrying out the procedure of unambiguous authentication of students according to a pre-formed reference base of digital biometric characte...

Full description

The choice of the activation functions in neural networks (NN) are of paramount importance in the training process and the performance of NNs. Therefore, the machine learning community has directed its attention to the development of computationally efficient activation functions. In this paper we i...

Full description

In this study, we present a comparative analysis of gradient descent-based optimizers frequently used in Convolutional Neural Networks (CNNs), including SGD, mSGD, RMSprop, Adadelta, Nadam, Adamax, Adam, and the recent EVE optimizer. To explore the interaction between optimization strategies and act...

Full description

The socio-economic situation in Ukraine suggests that there is insufficient research into the applicability of the model of economic development in forecasting the economic environment in which trade enterprises function. Researchers into issues relating to the efficiency of enterprises’ functioning...

Full description

In order to investigate the influence of the number of freeze-thaw cycles (freeze-thaw) on the spontaneous combustion characteristics of coal gangue, this study simulated the alpine environment and examined the spontaneous combustion characteristics of coal gangue after undergoing multiple freeze-th...

Full description

Tensor calculus is a necessary tool in various natural sciences.