This is quite a counter-intuitive thing. Why should there be more bank balances starting with a 1 than with a 9? Six times more of them, in fact. Why should this be true for the lengths of all the rivers in the world? The technical explanation for this is that these types of real world values are distributed logarithmically. For a more intuitive explanation, an example is probably more helpful.
Let's say you invest $100 in an account that pays 10% annually. This means that your investment will double every 7.3 years. The investment will reach $200 after 7.3 years, so for that entire first 7.3 years the investment's value began with a 1. Now, it will take another 7.3 years to double again. However, this time it's doubling to $400, not $300. The investment was valued in the $100s for the same amount of time it was valued in the $200s and $300s. The point is that the investment is growing at a rate proportional to its own size. It's compounding. The investment only spends 4 years or so in the $200s, 3 years in the $300s, and so on, finally breezing through the $900s in just over a year. Then this repeats for all the 4-digit values: 7.3 years in the $1000s, 4 in the $2000s, etc.
The reason I've been thinking about this topic recently is that it's been mentioned in relation to Bernie Madoff's ponzi scheme. Benford's Law is a good tool for detecting fraudulent data, because people faking such data often don't take it into account. Apparently, Madoff was sophisticated enough to generate numbers that met Benford's Law reasonably well.
As a quick real-world test of this, I thought I'd check the sizes of all the files on my computer's hard drive. The results seem to fit the Law's prediction quite well:
Digit | # Files | % Files | Benford |
1 | 48,295 | 28.6% | 30.1% |
2 | 32,893 | 19.5% | 17.6% |
3 | 23,297 | 13.8% | 12.5% |
4 | 15,925 | 9.4% | 9.7% |
5 | 12,612 | 7.5% | 7.9% |
6 | 10,665 | 6.3% | 6.7% |
7 | 8,438 | 5.0% | 5.8% |
8 | 9,972 | 5.9% | 5.1% |
9 | 6,498 | 3.9% | 4.6% |
Wikipedia Link: Benford's Law
It disturbs me to admit this, but I am completely nerded-out by this post. Completely.
ReplyDeleteNot only nerded-out, but out-nerded as well :).
ReplyDeleteRob...
ReplyDeleteI LOVED this post. I was smiling the whole time I read it. You can be assured that I will be passing it along to someone (whom I think would appreciate it) tonight; giving you full credit of course.
Bestest,
...Dave Aring