Goodwell & Kumar, 2017

Paper/Book

Temporal Information Partitioning: Characterizing Synergy, Uniqueness, and Redundancy in Interacting Environmental Variables

Goodwell, A.E., and Kumar, P. (2017)
Water Resources Research 53, 2017  

Plain English Summary

Within an ecosystem, variables such as temperature, humidity, solar radiation, and wind interact with each other in various ways. Although some of these relationships are well understood, others are more complex and may change along with weather conditions or due to human impacts. This study presents a new method with which to characterize these relationships based on time-series data. We develop a metric to detect relationships between multiple source variables that influence target variables at different time delays. This can be applied to environmental time-series datasets that present challenges for other types of analyses. We show the advantages of our method using several theoretical examples and an application to weather station data. In the weather station case, we find that air temperature and wind speed both tend to influence relative humidity, but in different ways. Over a several-day period, we find that the relationships between the three variables change with weather conditions. The method presented here can be applied to a wide range of systems in which variables are interacting in complex ways.

Abstract

Information theoretic measures can be used to identify nonlinear interactions between source and target variables through reductions in uncertainty. In information partitioning, multivariate mutual information is decomposed into synergistic, unique, and redundant components. Synergy is information shared only when sources influence a target together, uniqueness is information only provided by one source, and redundancy is overlapping shared information from multiple sources. While this partitioning has been applied to provide insights into complex dependencies, several proposed partitioning methods overestimate redundant information and omit a component of unique information because they do not account for source dependencies. Additionally, information partitioning has only been applied to time-series data in a limited context, using basic pdf estimation techniques or a Gaussian assumption. We develop a Rescaled Redundancy measure (Rs) to solve the source dependency issue, and present Gaussian, autoregressive, and chaotic test cases to demonstrate its advantages over existing techniques in the presence of noise, various source correlations, and different types of interactions. This study constitutes the first rigorous application of information partitioning to environmental time-series data, and addresses how noise, pdf estimation technique, or source dependencies can influence detected measures. We illustrate how our techniques can unravel the complex nature of forcing and feedback within an ecohydrologic system with an application to 1 min environmental signals of air temperature, relative humidity, and windspeed. The methods presented here are applicable to the study of a broad range of complex systems composed of interacting variables.

Citation

Goodwell, A.E., and Kumar, P. (2017): Temporal Information Partitioning: Characterizing Synergy, Uniqueness, and Redundancy in Interacting Environmental Variables. Water Resources Research 53, 2017. DOI: 10.1002/2016WR020216

This Paper/Book acknowledges NSF CZO grant support.