Entropy production in stochastics

D. Koutsoyiannis, Entropy production in stochastics, Entropy, 19 (11), 581, doi:10.3390/e19110581, 2017.



While the modern definition of entropy is genuinely probabilistic, in entropy production the classical thermodynamic definition, as in heat transfer, is typically used. Here we explore the concept of entropy production within stochastics and, particularly, two forms of entropy production in logarithmic time, unconditionally (EPLT) or conditionally on the past and present having been observed (CEPLT). We study the theoretical properties of both forms, in general and in application to a broad set of stochastic processes. A main question investigated, related to model identification and fitting from data, is how to estimate the entropy production from a time series. It turns out that there is a link of the EPLT with the climacogram, and of the CEPLT with two additional tools introduced here, namely the differenced climacogram and the climacospectrum. In particular, EPLT and CEPLT are related to slopes of log-log plots of these tools, with the asymptotic slopes at the tails being most important as they justify the emergence of scaling laws of second-order characteristics of stochastic processes. As a real-world application, we use an extraordinary long time series of turbulent velocity and show how a parsimonious stochastic model can be identified and fitted using the tools developed.

PDF Full text:

Our works referenced by this work:

1. D. Koutsoyiannis, A random walk on water, Hydrology and Earth System Sciences, 14, 585–601, doi:10.5194/hess-14-585-2010, 2010.
2. D. Koutsoyiannis, Hurst-Kolmogorov dynamics as a result of extremal entropy production, Physica A: Statistical Mechanics and its Applications, 390 (8), 1424–1432, doi:10.1016/j.physa.2010.12.035, 2011.
3. A. Montanari, and D. Koutsoyiannis, A blueprint for process-based modeling of uncertain hydrological systems, Water Resources Research, 48, W09555, doi:10.1029/2011WR011412, 2012.
4. Y. Markonis, and D. Koutsoyiannis, Climatic variability over time scales spanning nine orders of magnitude: Connecting Milankovitch cycles with Hurst–Kolmogorov dynamics, Surveys in Geophysics, 34 (2), 181–207, doi:10.1007/s10712-012-9208-9, 2013.
5. D. Koutsoyiannis, Physics of uncertainty, the Gibbs paradox and indistinguishable particles, Studies in History and Philosophy of Modern Physics, 44, 480–489, doi:10.1016/j.shpsb.2013.08.007, 2013.
6. D. Koutsoyiannis, Entropy: from thermodynamics to hydrology, Entropy, 16 (3), 1287–1314, doi:10.3390/e16031287, 2014.
7. D. Koutsoyiannis, and A. Montanari, Negligent killing of scientific concepts: the stationarity case, Hydrological Sciences Journal, 60 (7-8), 1174–1183, doi:10.1080/02626667.2014.959959, 2015.
8. P. Dimitriadis, and D. Koutsoyiannis, Climacogram versus autocovariance and power spectrum in stochastic modelling for Markovian and Hurst–Kolmogorov processes, Stochastic Environmental Research & Risk Assessment, 29 (6), 1649–1669, doi:10.1007/s00477-015-1023-7, 2015.
9. D. Koutsoyiannis, Generic and parsimonious stochastic modelling for hydrology and beyond, Hydrological Sciences Journal, 61 (2), 225–244, doi:10.1080/02626667.2015.1016950, 2016.
10. C. Pappas, M.D. Mahecha, D.C. Frank, F. Babst, and D. Koutsoyiannis, Ecosystem functioning is enveloped by hydrometeorological variability, Nature Ecology & Evolution, 1, 1263–1270, doi:10.1038/s41559-017-0277-5, 2017.
11. P. Dimitriadis, and D. Koutsoyiannis, Stochastic synthesis approximating any process dependence and distribution, Stochastic Environmental Research & Risk Assessment, 32 (6), 1493–1515, doi:10.1007/s00477-018-1540-2, 2018.
12. D. Koutsoyiannis, P. Dimitriadis, F. Lombardo, and S. Stevens, From fractals to stochastics: Seeking theoretical consistency in analysis of geophysical data, Advances in Nonlinear Geosciences, edited by A.A. Tsonis, 237–278, doi:10.1007/978-3-319-58895-7_14, Springer, 2018.

Our works that reference this work:

1. P. Dimitriadis, and D. Koutsoyiannis, Stochastic synthesis approximating any process dependence and distribution, Stochastic Environmental Research & Risk Assessment, 32 (6), 1493–1515, doi:10.1007/s00477-018-1540-2, 2018.
2. I. Tsoukalas, C. Makropoulos, and D. Koutsoyiannis, Simulation of stochastic processes exhibiting any-range dependence and arbitrary marginal distributions, Water Resources Research, 54 (11), 9484–9513, doi:10.1029/2017WR022462, 2018.
3. E. Klousakou, M. Chalakatevaki, P. Dimitriadis, T. Iliopoulou, R. Ioannidis, G. Karakatsanis, A. Efstratiadis, N. Mamassis, R. Tomani, E. Chardavellas, and D. Koutsoyiannis, A preliminary stochastic analysis of the uncertainty of natural processes related to renewable energy resources, Advances in Geosciences, 45, 193–199, doi:10.5194/adgeo-45-193-2018, 2018.
4. D. Koutsoyiannis, Knowable moments for high-order stochastic characterization and modelling of hydrological processes, Hydrological Sciences Journal, 64 (1), 19–33, doi:10.1080/02626667.2018.1556794, 2019.
5. D. Koutsoyiannis, Time’s arrow in stochastic characterization and simulation of atmospheric and hydrological processes, Hydrological Sciences Journal, 64 (9), 1013–1037, doi:10.1080/02626667.2019.1600700, 2019.
6. D. Koutsoyiannis, Simple stochastic simulation of time irreversible and reversible processes, Hydrological Sciences Journal, 65 (4), 536–551, doi:10.1080/02626667.2019.1705302, 2020.
7. D. Koutsoyiannis, Stochastics of Hydroclimatic Extremes - A Cool Look at Risk, 330 pages, Edition 0, National Technical University of Athens, Athens, 2020.

Works that cite this document: View on Google Scholar or ResearchGate

Tagged under: Hurst-Kolmogorov dynamics, Course bibliography: Stochastic methods, Determinism vs. stochasticity, Entropy, Most recent works, Scaling, Stochastics