On the Detection of Significant Pairwise Interactions in Complex Systems

Many systems in nature, society and technology are complex systems, i.e., they are composed of numerous parts that interact in a non-linear way giving rise to positive and negative feedback. The dynamic organization of these systems often allows the emergence of intermediate structures that once formed profoundly influence the system and therefore play a key role in understanding its behavior. In the recent past our group has devised an effective method for identifying groups of interacting variables within a system, based on their observation. The result is a set of entities, each of which connects two or more nodes of the system: this result can therefore be represented by a hypergraph, which can be of considerable use for understanding the system under consideration. In particular, we use an index that allows us to evaluate the level of integration of a group of variables. In order for a group to be identified as significant, the value of this index must exceed a threshold that corresponds (under appropriate hypotheses) to a level of statistical significance decided by the user. In this work we propose a more elaborate approach to determining the significance threshold, which is (i) in itself theoretically interesting and (ii) of considerable practical utility. We use the new approach to determine collections of pairwise relationships in meaningful cases, such as relationships in gene regulatory networks.