Intelligence Analysis

[gusl]

I am interested in formally reconstructing expert reasoning in order to biases. Apparently Keith Devlin, Selmer Bringsjord, and many other people have been working in this area since Sep 11. The area still seems to be scarce though.

The CIA has published an online book on Intelligence Analysis:

Richards J. Heuer, Jr. - Psychology of Intelligence Analysis

Here's an excerpt from the chapter on cognitive biases:

The impact of information on the human mind is only imperfectly related to its true value as evidence.91 Specifically, information that is vivid, concrete, and personal has a greater impact on our thinking than pallid, abstract information that may actually have substantially greater value as evidence. For example:

* Information that people perceive directly, that they hear with their own ears or see with their own eyes, is likely to have greater impact than information received secondhand that may have greater evidential value.

* Case histories and anecdotes will have greater impact than more informative but abstract aggregate or statistical data.

In other words, people are not Bayesians! And it's like they don't even try! Even when we believe others should know better than us, and have no reason to distrust them, we still believe ourselves more... which means that our probability judgements won't converge. I should make a link here from People Disagree Too Much.

Bayesians, as we know, cannot agree to disagree. Much of my struggle with humanity (and with myself!) has to do with accepting such irrationality.

Comments

[bondage-and-tea.livejournal.com]

Funky. Thanks for posting the link that.