By calculating the Kullback–Leibler divergence between two probability measures belonging to different exponential families dominated by the same measure, we obtain a formula that generalizes the ordinary Fenchel–Young divergence. Inspired by this formula, we define the duo Fenchel–Young divergence and report a majorization condition on its pair of...
In a wavefunction-only philosophy, thermodynamics must be recast in terms of an ensemble of wavefunctions. In this perspective we study how to construct Gibbs ensembles for magnetic quantum spin models. We show that with free boundary conditions and distinguishable “spins” there are no finite-temperature phase transitions because of high dimensiona...
Recently, there is a growing interest in applying Transfer Entropy (TE) in quantifying the effective connectivity between artificial neurons. In a feedforward network, the TE can be used to quantify the relationships between neuron output pairs located in different layers. Our focus is on how to include the TE in the learning mechanisms of a Convol...
The interactive effect is significant in the Chinese stock market, exacerbating the abnormal market volatilities and risk contagion. Based on daily stock returns in the Shanghai Stock Exchange (SSE) A-shares, this paper divides the period between 2005 and 2018 into eight bull and bear market stages to investigate interactive patterns in the Chinese...
Published in Entropy
The recent results attained from a thermodynamically conceived numerical scheme applied on wave propagation in viscoelastic/rheological solids are generalized here, both in the sense that the scheme is extended to four spacetime dimensions and in the aspect of the virtues of a thermodynamical approach. Regarding the scheme, the arrangement of which...
Published in Entropy
This paper proposes a speech-based method for automatic depression classification. The system is based on ensemble learning for Convolutional Neural Networks (CNNs) and is evaluated using the data and the experimental protocol provided in the Depression Classification Sub-Challenge (DCC) at the 2016 Audio–Visual Emotion Challenge (AVEC-2016). In th...
Published in Entropy
Measurement and feedback allows for an external agent to extract work from a system in contact with a single thermal bath. The maximum amount of work that can be extracted in a single measurement and the corresponding feedback loop is given by the information that is acquired via the measurement, a result that manifests the close relation between i...
We consider information-theoretic bounds on the expected generalization error for statistical learning problems in a network setting. In this setting, there are K nodes, each with its own independent dataset, and the models from the K nodes have to be aggregated into a final centralized model. We consider both simple averaging of the models as well...
Published in Entropy
The dynamics of cellular aggregates is driven by the interplay of mechanochemical processes and cellular activity. Although deterministic models may capture mechanical features, local chemical fluctuations trigger random cell responses, which determine the overall evolution. Incorporating stochastic cellular behavior in macroscopic models of biolog...
In econophysics, the analysis of the return distribution of a financial asset using statistical physics methods is a long-standing and important issue. This paper systematically conducts an analysis of composite index 1 min datasets over a 17-year period (2005–2021) for both the Shanghai and Shenzhen stock exchanges. To reveal the differences betwe...
