The objective of this article is to provide a tutorial for neurosurgeons regarding information theory, specifically time-delayed mutual information, and to compare time-delayed mutual information, an information theoretic quantity based on statistical dependence, with cross-correlation, a commonly used metric for this task in a preliminary analysis of rat hippocampal neurons.
Synergy is an information theoretic quantity well-suited for discovering epistatic interactions.
Information theoretic quantities such as entropy and mutual information can then be evaluated from the probabilistic model that results from the relative frequencies (see Methods).
The proposed scoring metric uses information theoretic quantities having not only relevant properties but also implicitly includes the biological truth that some genes may jointly regulate other genes.
Once we have the model defined, then we can readily evaluate all the information theoretic quantities directly from these counts (Anastassiou, 2007; Varadan and Anastassiou, 2006).
In this algorithm, the information theoretic quantities MI and CMI determine the regulatory relationships between genes and the PMDL principle method attempts to determine the best MI threshold without the need of a user-specified fine tuning parameter.
Our goal is to develop an algorithm which reduces the number of fine tuning parameters and thresholds and improve the performance of algorithm using higher order information theoretic quantities such as CMI. 1.
If the expression data are binarized, then each joint expression state automatically defines a "cluster" of co-located samples, as in Figures 1D, 1E and 1F, in which case evaluation of all information theoretic quantities are straightforward, as explained earlier.
In the current work, the connection between system dynamics and the information theoretic quantities such as entropy and mutual information (either Gibbs-Shannon or Tsallis) arises solely because the solution of the growth equation takes a certain form (either exponential or q-exponential).
Another way to achieve this qualitative property is to use the pointwise mutual information, another information-theoretic quantity, as a merit function (Setlur & Stone, 2016).
In the present paper, we investigate an information-theoretic quantity, empowerment, as a hypothetical candidate for a possible optimality principle behind the evolution and development of sensorimotor loops.
