As some of you may know, I'm in the process of writing a paper with frequent commenter (and MD) Todd Zorick on applying the information equilibrium model to neuroscience -- in particular: can you distinguish different states of consciousness by different information transfer indices that characterize EEG data? It's been something of a slog, but one reviewer brought up the similarity of the approach with a "scale dependent Lyapunov exponent" [pdf].
You can consider this post a draft of a response to the reviewer (and Todd, feel free to use this as part of the response), but I thought it was interesting enough for everyone following the blog. Let's start with an information equilibrium relationship A⇄B between an information source A and an information destination (receiver) B (see the paper for more details on the steps of solving this differential equation):
If we have a constant information source (in economics, partial equilibrium where A moves slowly with respect to B), we can say:
Let's define B and Bref as BAref+ΔA and BAref, respectively, and rewrite the previous equation:
This is exactly the form of the Lyapunov exponent [wikipedia] λ if we consider A (the information source) to be the time variable and λ=1/kA0
Bt+Δt=BtexpλΔt
[Update 13 June 2016: As brought up in peer review, we should consider the B to be some aggregation of a multi-dimensional space (in economics, individual transactions; in neuroscience, individual neuron voltages) because λ measures the separation between two paths in that phase space.]
This is interesting for many reasons, not the least of which is that a positive λ (and it is typically in the economics case) is associated with a chaotic system. Additionally, the Lyapunov dimension is directly related to the information dimension. (See the Wikipedia article linked above.)
...
In general equilibrium we have
Bt+Δt=Btexp(1klog(t+Δtt))
which reduces the the other form for t≫Δt (i.e. short time scales).
Thanks, I will add some of this! Kind of reminds me of a warped version of the TV show "Jeopardy": "Please phrase your answer in the form of a blog post..."
ReplyDeleteHa! And sorry for the delay in getting back to you -- my primary job has intruded on the fun work.
Delete