tag:blogger.com,1999:blog-6837159629100463303.post4224708664645423146..comments2022-11-10T00:45:32.228-08:00Comments on Information Transfer Economics: Entropy is working for the weekendJason Smithhttp://www.blogger.com/profile/12680061127040420047noreply@blogger.comBlogger33125tag:blogger.com,1999:blog-6837159629100463303.post-22812170169697390552015-08-31T14:13:08.488-07:002015-08-31T14:13:08.488-07:00Sorry about leaving off responding to the question...Sorry about leaving off responding to the question about predictions. I've used various methods with some true out of sample (forecasts) and pseudo out of sample (using part of the available data to predict another part):<br /><br />Pseudo out of sample:<br /><br /><a href="http://informationtransfereconomics.blogspot.com/2015/08/comparison-of-interest-rate-predictions.html" rel="nofollow">http://informationtransfereconomics.blogspot.com/2015/08/comparison-of-interest-rate-predictions.html</a><br /><a href="http://informationtransfereconomics.blogspot.com/2014/05/out-of-sample-predictions-with.html" rel="nofollow">http://informationtransfereconomics.blogspot.com/2014/05/out-of-sample-predictions-with.html</a><br /><br />Forecasts:<br /><br /><a href="http://informationtransfereconomics.blogspot.com/2015/08/latest-pce-inflation-data.html" rel="nofollow">http://informationtransfereconomics.blogspot.com/2015/08/latest-pce-inflation-data.html</a><br /><a href="http://informationtransfereconomics.blogspot.com/2015/07/model-prediction-holding-up-for-japan.html" rel="nofollow">http://informationtransfereconomics.blogspot.com/2015/07/model-prediction-holding-up-for-japan.html</a><br /><br />The horizon is usually about a few years (the number of steps depends on the frequency of the data series). I usually use the same horizon as the models I am comparing to. I go into is a bit more here about the accuracy:<br /><br /><a href="http://informationtransfereconomics.blogspot.com/2014/07/inflation-prediction-errors.html" rel="nofollow">http://informationtransfereconomics.blogspot.com/2014/07/inflation-prediction-errors.html</a><br /><br />And I think I understand your question about upward coordination now -- I have to think a bit more about my answer and get back to you.<br /><br />Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-61598887212668850172015-08-31T13:58:18.969-07:002015-08-31T13:58:18.969-07:00Thanks for the response. I'll check out the li...Thanks for the response. I'll check out the links. I should have been clearer in my comment. By "upward coordination" i was referring to situations in which the sales are actually realized. Since this is an instance of coordination and the result (Coordination -> Recession) is independent of the realization, how would this lead to recession? Would situations in which these types of coordination really just be what you described here "Actually, build up at some rate close to the economic growth rate would probably be the equilibrium, not zero growth.)"<br /><br />This may be a a slight miscommunication. <br /><br />thanks again. Any information on the questions regarding the forecasts? elihttps://www.blogger.com/profile/10220404092693775249noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-18663474211146048012015-08-31T11:47:15.176-07:002015-08-31T11:47:15.176-07:00Forgot a link to hyperinflation
http://informatio...Forgot a link to hyperinflation<br /><br />http://informationtransfereconomics.blogspot.com/2013/09/hyperinflation.html<br /><br />The language of the post might be a bit confusing since it uses the physics model language but "floating" vs "constant" is just general vs partial equilibrium.Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-30679569562287290942015-08-31T11:38:56.214-07:002015-08-31T11:38:56.214-07:00Your example above of overproduction is an example...Your example above of overproduction is an example of a story of how upward coordination could lead to a recession. Producers are optimistic about sales, ramp up production and the sales aren't realized.<br /><br />That is a negative shock, however I think true recessions are a bit more complicated than that. The negative shocks sometimes produce a much bigger effect than their size alone would dictate. I go into this a bit more here:<br /><br />http://informationtransfereconomics.blogspot.com/2015/03/non-ideal-information-transfer-tail.html<br /><br />Regarding hyperinflation, there are actually two solutions to the differential equation that governs the price level. Basically if money is printed faster than nominal output can adjust, you get accelerating inflation.Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-56308792452658563972015-08-31T09:30:55.345-07:002015-08-31T09:30:55.345-07:00Got it, but still how does upward coordination lea...Got it, but still how does upward coordination lead to a recession?<br /><br />I'm under the impression that by recession you really mean adverse deviations from some trend growth state. Is this correct? In other words, the "equilibrium" corresponds to 2.5% but you get 1%. Though not technically a recession in the standard sense it is one in your framework. <br /><br />With regards to price stickiness, there are plenty of "stories" to explain nominal rigidities. Calvo's is just one of many. Contracts, menu costs, or <br />so-called efficiency wages are all very simple and yet intuitive ways of explaining this phenomenon. In your framework, the phenomenon is just a manifestation of countervailing entropic forces. But then how do we explain rapidly changing prices as in hyperinflation? Are they just downward rigid?<br /><br />again, this is a very novel approach and i'm just trying to wrap my head around everything. Thus far, your predictions have led me to investigate further. Regarding your predictions (from the paper and other posts), are they out-of-sample and what's the forecast horizon (one-step ahead)? <br /><br /> <br />elihttps://www.blogger.com/profile/10220404092693775249noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-38339765416447676382015-08-30T12:40:56.304-07:002015-08-30T12:40:56.304-07:00I think of the efficient market hypothesis as havi...I think of the efficient market hypothesis as having a strong form and a weak form. The strong form is 'The price is right.' The weak form is 'Prices follow a random walk.'<br /><br />It was Graham, IIRC, who observed that the price moves to the largest bid or ask. I think that contradicts the strong form but agrees with the weak form.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-58750225191107483482015-08-28T18:28:23.999-07:002015-08-28T18:28:23.999-07:00I think the EMH is a statement of maximum entropy:...I think the EMH is a statement of maximum entropy:<br /><br />http://informationtransfereconomics.blogspot.com/2014/02/ii-entropy-and-microfoundations.html<br /><br />It is definitely falsifiable (depending on the form ... )Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-39614631812142965832015-08-28T17:00:00.061-07:002015-08-28T17:00:00.061-07:00Jason, O/T: the discussion arose at Sumner's a...Jason, O/T: the discussion arose at <a href="http://www.themoneyillusion.com/?p=30337" rel="nofollow">Sumner's</a> about falsifiability and the EMH. If the EMH leads to falsifiable predictions, what do you think they are?Tom Brownhttps://www.blogger.com/profile/17654184190478330946noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-13632520136817035602015-08-28T13:48:01.406-07:002015-08-28T13:48:01.406-07:00...if anybody here has a well stocked (but unused)......if anybody here has a well stocked (but unused) Y2K end-times bunker, no offense. I'm sure it's very nice... and your grand kids might appreciate it someday. (c:<br /><br />Also, that's "much ballyhooed" not "must ballyhooed."Tom Brownhttps://www.blogger.com/profile/17654184190478330946noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-19322574296464753492015-08-28T13:44:31.549-07:002015-08-28T13:44:31.549-07:00An interesting implication seems to be that any su...An interesting implication seems to be that any sudden change in the distribution, regardless if that change will in the long term create greater, equal or less output than does the current distribution, will result in a recession. Now the question is, what if that sudden change is anticipated well in advance? So that virtually everybody has time to prepare (as if they're preparing for a change to daylight savings time)?<br /><br />I would guess that if this is a recurring change (like a holiday or daylight savings), it won't be a big deal, but if it's a one time change, regardless of how prepared everybody *thinks* they are, there will be some disruption, depending on the magnitude of the change. Clearly the must ballyhooed Y2K paranoia was not a show stopper, but that might not always be the case. (Y2K did produce an uptick in dry goods and ammo sales probably... and perhaps some hours of lost output due to it being diverted to digging underground end-times bunkers... Lol).Tom Brownhttps://www.blogger.com/profile/17654184190478330946noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-88188699813731608622015-08-28T09:38:32.089-07:002015-08-28T09:38:32.089-07:00Thanks, guys. :)
A metaphor I think of is that of...Thanks, guys. :)<br /><br />A metaphor I think of is that of a balloon with a certain intrinsic shape, instead of a spherical chicken. ;) <br /><br />To put it another way, culture matters. Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-3281972912132649012015-08-27T19:43:56.670-07:002015-08-27T19:43:56.670-07:00D(Q||P) would measure a recession for transitionin...D(Q||P) would measure a recession for transitioning back to P if Q became the new normal (i.e. the new equilibrium -- if for example, things stayed at Q for long enough).Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-2450836917544084442015-08-27T19:42:08.691-07:002015-08-27T19:42:08.691-07:00Yep, that's it. Thanks Tom. It's true that...Yep, that's it. Thanks Tom. It's true that a transition from P to A would in the short term create a recession, but as A is a higher entropy state, overall growth would increase in the long run ... if A becomes the new normal.Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-29643831145303026812015-08-27T19:40:12.591-07:002015-08-27T19:40:12.591-07:00Yes.Yes.Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-22979103890546519372015-08-27T19:39:26.823-07:002015-08-27T19:39:26.823-07:00In general, yes -- coordination leads to lower ent...In general, yes -- coordination leads to lower entropy states than "uncoordinated" states. The idea behind this model is that the economy is in a maximum entropy state most of the time, so all other states are lower entropy. <br /><br />If every agent built up excess inventories, that would represent a lower entropy state than a set of random inventories (some building up, others depleting). (Actually, build up at some rate close to the economic growth rate would probably be the equilibrium, not zero growth.)<br /><br />These kind of recessions are emergent properties of economies, so there is no true "story" of what is happening. You can invent them, but they are not true of agents. In diffusion, you could invent a "story" of a density dependent force evening out the distribution of molecules. But there is no such force, only entropy evening out the distribution.<br /><br />In economics I am under the impression that Calvo pricing used to justify price stickiness is one of these fictitious forces. There appears to be an emergent aspect of the economy that tries to maintain a maximum entropy distribution of price growth rates and attempts to change it (by having prices fall together) has an entropic force pushing against it.Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-77278551372256922252015-08-27T15:30:35.146-07:002015-08-27T15:30:35.146-07:00Bill, I think I already asked Jason that in the nu...Bill, I think I already asked Jason that in the numerous comments I wrote above (which I wouldn't blame anybody for skipping!). He said essentially switching to any other distribution X (with P =/= X) would result in a D(P||X) > 0, and this includes distribution X = A (Jason describes A as a uniform distribution for the week). So, in other words, yes that would cause a recession too, even though the overall entropy of A < the entropy of P.Tom Brownhttps://www.blogger.com/profile/17654184190478330946noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-57293579529163511262015-08-27T14:13:04.433-07:002015-08-27T14:13:04.433-07:00On the assumption that weekends with less work are...On the assumption that weekends with less work are the equilibrium condition, what if (all of a sudden, as Nick Rowe likes to say) work were spread evenly over the week? Wouldn't that also indicate a recession?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-5273844753742430782015-08-27T10:41:40.388-07:002015-08-27T10:41:40.388-07:00In your example as it stands (with P normal and Q ...In your example as it stands (with P normal and Q the oddball, not the other way around), is it possible to dream up any meaning for D(Q||P)? Or is that just not at all obvious?Tom Brownhttp://www.google.comnoreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-75641999312119004142015-08-27T10:29:17.747-07:002015-08-27T10:29:17.747-07:00Jason, just to be clear, in your example, the Q we...Jason, just to be clear, in your example, the Q week (or any X =/= P week) does suffer an overall decline in output as opposed to the P week, correct? Since it's a "mini-recession?"Tom Brownhttp://www.google.comnoreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-41986576171461103252015-08-26T21:55:14.620-07:002015-08-26T21:55:14.620-07:00Thank you for your very thorough response. You are...Thank you for your very thorough response. You are correct, this isn't the way i would think of managing expectations. I ask that you bare with me here, as this is indeed a novel framework (for me at least) to work with.<br /><br />Do the effects of coordination (negative shocks to the economy) hold regardless of the actual realizations? For instance, if every agent in the economy expects higher than average growth and we actually get this result what happens to the level of real output. I'm thinking in terms of what the "story" is. I can imagine a situation in which the average expectation of the economy is for over-performance, so firms build up inventories and increase production. However, 6 months later it turns out the economy under-performed so there is an inventory swing. This could lead to recession. Now what if instead 6 months later the economy actually performed as expected, there is no inventory swing so what is the negative shock? <br /><br />Also, when you say negative shocks are you referring to a decline in real output?<br /><br />thanks again. I just downloaded your paper. i look forward to reading it. elihttps://www.blogger.com/profile/10220404092693775249noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-55298561379402339272015-08-26T17:18:00.163-07:002015-08-26T17:18:00.163-07:00Welcome!
Regarding your first question:
The rate...Welcome!<br /><br />Regarding your first question:<br /><br />The rate at which prices adjust would definitely enter into the duration of the slump -- if prices adjusted instantly, there could be an instantaneous drop in entropy in the case above. However we'd instantly start treating Q as the new distribution and the time integrated effect could be close to zero.<br /><br />However, it's more than just prices adjusting. There is a distribution of supply (based on Q) that is mismatched to demand (based on P). If there isn't any of something in place at the right time (e.g. cash in the ATMs) even an infinite price won't get it there faster.<br /><br />The information transfer model so far only hints at the way to think about non-equilibrium situations; it is similar to how thermodynamics only hints at how to think about non-equilibrium systems. If a system develops entropy gradients, it will tend to even them out. In our atmosphere, you get convection with uneven heating. The specific process by which the entropy gradient above created by the different work-week output is evened out could definitely include price adjustments. And those price adjustments must work slowly enough to see the effect of the entropy gradient.<br /><br />Regarding your second question:<br /><br />The answer is yes, but not in a way that we'd normally think about expectations. You'd want e.g the central bank to create expectations of "normal" where everybody thinks differently what normal is. Say half of people expect more than "normal" growth and half expect less. If they started to expect the same thing (everyone expects more than average growth, less than average growth, or exactly equal to average growth), you'd get a negative shock to the economy.<br /><br />"Managing" expectations is making the world safe for a diversity of expectations.<br /><br />ET Jaynes called it dither -- the ability for agents to randomly explore the state space ("dither") increases entropy.<br /><br />Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-20149808419258965802015-08-26T14:01:33.535-07:002015-08-26T14:01:33.535-07:00I just stumbled upon this blog. Just reading this ...I just stumbled upon this blog. Just reading this post, does output decline then because prices can't adjust fast enough? In other words, there is no way to quickly communicate the unexpected surge in demand and so it goes unsatisfied (for instance in your crowded restaurant example). <br /><br />In a similar vein, does accepting the notion presented (coordination -> recession) imply then that the main channel for policy lies in the managing of expectations? <br /><br />very interesting nonetheless.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-45672377585155760322015-08-25T23:06:34.410-07:002015-08-25T23:06:34.410-07:00OK, thanks Jason.OK, thanks Jason.Tom Brownhttp://www.google.comnoreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-73530139207262624772015-08-25T19:19:37.040-07:002015-08-25T19:19:37.040-07:00Thinking of the economy in state P as operating wi...Thinking of the economy in state P as operating with a code optimized for P (like the ATM balances example) is a good analogy. There is a change and we start using distribution Q as an approximation to P. I am not sure how far it can be pushed, though since we are essentially pretending we don't know the microfoundations of the economic model when it is operating with distribution P.<br /><br />Regarding A, B and C:<br /><br />A. Yes, but there are different maximum entropy distributions given different conditions. A partition function is a maximum entropy distribution where you are constrained to an ensemble average of something like energy < x >. A Pareto distribution is maximum entropy given a constraint on < log x >. A uniform distribution is the maximum entropy distribution where x is between [x_min, x_max].<br /><br />B. By realize P, I essentially mean observe P (observe a microstate of agents with work distribution P).<br /><br />C. Yes, there would be a mini-recession going from P to any other distribution. D(P||X) is minimized for X = P.Jason Smithhttps://www.blogger.com/profile/12680061127040420047noreply@blogger.comtag:blogger.com,1999:blog-6837159629100463303.post-21483930577433547532015-08-25T12:25:37.250-07:002015-08-25T12:25:37.250-07:00Also, in your comment above you write:
"Dist...Also, in your comment above you write:<br /><br />"Distribution P is itself likely a bad approximation to the optimal distribution A (uniform is maximum entropy). But D(A||P) = some constant that doesn't matter because we usually realize P."<br /><br />All that makes sense to me, but just to be sure:<br /><br />A). So by "optimal distribution" you mean "maximum entropy" which in turn implies a uniform distribution?<br /><br />B). By "realize P" you mean that P is the actual (non-optimal, non-maximum entropy) distribution, correct?<br /><br />C). Given that P is the equilibrium and we usually "realize P," then if instead of an atypical week with distribution Q we instead had an atypical week with distribution A (i.e. A = {1/7, 1/7, 1/7, 1/7, 1/7, 1/7, 1/7}), we'd still have a "mini-recession" even though the A distribution is lower entropy than P, true? In this case, to measure the size of the recession (bits lost) we'd calculate D(P||A) instead of D(A||P), correct?Tom Brownhttps://www.blogger.com/profile/17654184190478330946noreply@blogger.com