ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2311.13431
17
0

Extracting individual variable information for their decoupling, direct mutual information and multi-feature Granger causality

22 November 2023
Jarek Duda
ArXiv (abs)PDFHTML
Abstract

Working with multiple variables they usually contain difficult to control complex dependencies. This article proposes extraction of their individual information, e.g. X∣Y‾\overline{X|Y}X∣Y​ as random variable containing information from XXX, but with removed information about YYY, by using (x,y)↔(xˉ=CDFX∣Y=y(x),y)(x,y) \leftrightarrow (\bar{x}=\textrm{CDF}_{X|Y=y}(x),y)(x,y)↔(xˉ=CDFX∣Y=y​(x),y) reversible normalization. One application can be decoupling of individual information of variables: reversibly transform (X1,…,Xn)↔(X~1,…X~n)(X_1,\ldots,X_n)\leftrightarrow(\tilde{X}_1,\ldots \tilde{X}_n)(X1​,…,Xn​)↔(X~1​,…X~n​) together containing the same information, but being independent: ∀i≠jX~i⊥X~j,X~i⊥Xj\forall_{i\neq j} \tilde{X}_i\perp \tilde{X}_j, \tilde{X}_i\perp X_j∀i=j​X~i​⊥X~j​,X~i​⊥Xj​. It requires detailed models of complex conditional probability distributions - it is generally a difficult task, but here can be done through multiple dependency reducing iterations, using imperfect methods (here HCR: Hierarchical Correlation Reconstruction). It could be also used for direct mutual information - evaluating direct information transfer: without use of intermediate variables. For causality direction there is discussed multi-feature Granger causality, e.g. to trace various types of individual information transfers between such decoupled variables, including propagation time (delay).

View on arXiv
Comments on this paper