Some Technical Remarks on Negations of Discrete Probability Distributions and Their Information Loss

Klein I (2022)


Publication Type: Journal article

Publication year: 2022

Journal

Book Volume: 10

Article Number: 3893

Journal Issue: 20

DOI: 10.3390/math10203893

Abstract

Negation of a discrete probability distribution was introduced by Yager. To date, several papers have been published discussing generalizations, properties, and applications of negation. The recent work by Wu et al. gives an excellent overview of the literature and the motivation to deal with negation. Our paper focuses on some technical aspects of negation transformations. First, we prove that independent negations must be affine-linear. This fact was established by Batyrshin et al. as an open problem. Secondly, we show that repeated application of independent negations leads to a progressive loss of information (called monotonicity). In contrast to the literature, we try to obtain results not only for special but also for the general class of (Formula presented.) -entropies. In this general framework, we can show that results need to be proven only for Yager negation and can be transferred to the entire class of independent (=affine-linear) negations. For general (Formula presented.) -entropies with strictly concave generator function (Formula presented.), we can show that the information loss increases separately for sequences of odd and even numbers of repetitions. By using a Lagrangian approach, this result can be extended, in the neighbourhood of the uniform distribution, to all numbers of repetition. For Gini, Shannon, Havrda–Charvát (Tsallis), Rényi and Sharma–Mittal entropy, we prove that the information loss has a global minimum of 0. For dependent negations, it is not easy to obtain analytical results. Therefore, we simulate the entropy distribution and show how different repeated negations affect Gini and Shannon entropy. The simulation approach has the advantage that the entire simplex of discrete probability vectors can be considered at once, rather than just arbitrarily selected probability vectors.

Authors with CRIS profile

How to cite

APA:

Klein, I. (2022). Some Technical Remarks on Negations of Discrete Probability Distributions and Their Information Loss. Mathematics, 10(20). https://dx.doi.org/10.3390/math10203893

MLA:

Klein, Ingo. "Some Technical Remarks on Negations of Discrete Probability Distributions and Their Information Loss." Mathematics 10.20 (2022).

BibTeX: Download