Weighted entropy: basic inequalities
This paper represents an extended version of an earlier note . The concept of
weighted entropy takes into account values of different outcomes, i.e., makes entropy contextdependent,
through the weight function. We analyse analogs of the Fisher information inequality
and entropy power inequality for the weighted entropy and discuss connections with
weighted Lieb’s splitting inequality. The concepts of rates of the weighted entropy and information
are also discussed.
Properties of Erdos measure and the invariant Erdos measure for the golden ratio and all values of the Bernoulli parameter are studies. It is proved that a shift on the two-sided Fibonacci compact set with invariant Erdos measure is isomorphic to the integral automorphism for a Bernoulli shift with countable alphabet. An effective algorithm for calculating the entropy of an invariant Erdos measure is proposed. It is shown that, for certain values of the Bernulli parameter, the algorithm gives the Hausdorff dimension of an Erdos measure to 15 decimal places.
Properties of Erdos measure and the invariant Erdos measure for the golden ratio and all values of the Bernoulli parameter are studies. It is proved that a shift on the two-sided Fibonacci compact set with invariant Erdos measure is isomorphic to the integral automorphism for a Bernoulli shift with countable alphabet.
In this paper we propose a new machine learning concept called randomized machine learning, in which model parameters are assumed random and data are assumed to contain random errors. Distinction of this approach from "classical" machine learning is that optimal estimation deals with the probability density functions of random parameters and the "worst" probability density of random data errors. As the optimality criterion of estimation, randomized machine learning employs the generalized information entropy maximized on a set described by the system of empirical balances. We apply this approach to text classification and dynamic regression problems. The results illustrate capabilities of the approach.
A new approach to network decomposition problems (and, hence, to classification problems, presented in network form) is suggested. Opposite to the conventional approach, consisting in construction of one, “the most correct” decomposition (classification), the suggested approach is focused on construction of a family of classifications. Basing on this family, two numerical indices are introduced and calculated. The suggested indices describe the complexity of the initial classification problem as whole. The expedience and applicability of the elaborated approach are illustrated by two well-known and important cases: political voting body and stock market. In both cases the presented results cannot be obtained by other known methods. It confirms the perspectives of the suggested approach.
In this paper, we consider a large class of hierarchical congestion population games. One can show that the equilibrium in a game of such type can be described as a minimum point in a properly constructed multi-level convex optimization problem. We propose a fast primal-dual composite gradient method and apply it to the problem, which is dual to the problem describing the equilibrium in the considered class of games. We prove that this method allows to find an approximate solution of the initial problem without increasing the complexity.
The formula for calculating the entropy and the Hausdorff dimension of an invariant Erdos measure for the pseudogolden ratio and all values Bernoulli parameter is obtained. This formula make possible calculating the entropy and the Hausdorff dimension with high accuracy.
A model for organizing cargo transportation between two node stations connected by a railway line which contains a certain number of intermediate stations is considered. The movement of cargo is in one direction. Such a situation may occur, for example, if one of the node stations is located in a region which produce raw material for manufacturing industry located in another region, and there is another node station. The organization of freight traﬃc is performed by means of a number of technologies. These technologies determine the rules for taking on cargo at the initial node station, the rules of interaction between neighboring stations, as well as the rule of distribution of cargo to the ﬁnal node stations. The process of cargo transportation is followed by the set rule of control. For such a model, one must determine possible modes of cargo transportation and describe their properties. This model is described by a ﬁnite-dimensional system of diﬀerential equations with nonlocal linear restrictions. The class of the solution satisfying nonlocal linear restrictions is extremely narrow. It results in the need for the “correct” extension of solutions of a system of diﬀerential equations to a class of quasi-solutions having the distinctive feature of gaps in a countable number of points. It was possible numerically using the Runge–Kutta method of the fourth order to build these quasi-solutions and determine their rate of growth. Let us note that in the technical plan the main complexity consisted in obtaining quasi-solutions satisfying the nonlocal linear restrictions. Furthermore, we investigated the dependence of quasi-solutions and, in particular, sizes of gaps (jumps) of solutions on a number of parameters of the model characterizing a rule of control, technologies for transportation of cargo and intensity of giving of cargo on a node station.
This proceedings publication is a compilation of selected contributions from the “Third International Conference on the Dynamics of Information Systems” which took place at the University of Florida, Gainesville, February 16–18, 2011. The purpose of this conference was to bring together scientists and engineers from industry, government, and academia in order to exchange new discoveries and results in a broad range of topics relevant to the theory and practice of dynamics of information systems. Dynamics of Information Systems: Mathematical Foundation presents state-of-the art research and is intended for graduate students and researchers interested in some of the most recent discoveries in information theory and dynamical systems. Scientists in other disciplines may also benefit from the applications of new developments to their own area of study.