Abstract: The de Bruijn identity states that Fisher information is equal to twice the time-derivative of Shannon differential entropy along heat flow. In the same spirit, a generalized version of ...
Abstract: The cross-entropy loss is widely used in neural networks for classification problems, however it may not be the best choice. In this study the problem of designing new loss function is ...