Seeing Patterns Where None Exists

Seeing Patterns Where None Exists

I call data dredge studies the “Rorschach tests” of epidemiology, because researchers can pull out characteristics about people in almost unlimited combinations to find all sorts of correlations and conclude just about anything they set out to find. Just like the Rorschach test, seeing patterns where none exists, finding connections that are there but not as strongly as believed, and seeing what one expects to see, are common.

Page 8 of Statistics for Experiments by George Box, Willliam Hunter (my father) and Stu Hunter (no relation) shows a graph of the population (of people) versus the number of storks which shows a high correlation. “Although in this example few would be led to hypothesize that the increase in the number of storks caused the observed increase in population, investigators are sometimes guilty of this kind of mistake in other contexts.” And some might make it in this context 🙂

Related: Illusion of Explanatory DepthIllusions, Optical and OtherTheory of KnowledgeSarah, aged 3, Learns About Soap

17 thoughts on “Seeing Patterns Where None Exists

  1. Pingback: CuriousCat: Mistakes in Experimental Design and Interpretation

  2. Pingback: Curious Cat Management Improvement Blog » Fooled by Randomness

  3. Pingback: Curious Cat » Bigger Impact: 15 to 18 mpg or 50 to 100 mpg?

  4. Pingback: CuriousCat: 500 Year Floods

  5. Pingback: Curious Cat Management Improvement Blog » Does the Data Deluge Make the Scientific Method Obsolete?

  6. Pingback: CuriousCat: How Large Quantities of Information Change Everything

  7. Pingback: Curious Cat Science Blog » Correlation is Not Causation

  8. Pingback: Curious Cat Management Improvement Blog » Friday Fun: Correlation

  9. Pingback: Curious Cat Science and Engineering Blog » Albert Einstein, Marylin Monroe Hybrid Image

  10. Pingback: Curious Cat Science and Engineering Blog » The Value of Displaying Data Well

  11. Pingback: Curious Cat Management Improvement Blog » Communicating with the Visual Display of Data

  12. Pingback: Curious Cat Management Improvement Blog » The CEO is Only One Person

  13. Pingback: Curious Cat Science and Engineering Blog » Statistical Errors in Medical Studies

  14. Pingback: Leanpub Podcast on My Book – Management Matters: Building Enterprise Capability » Curious Cat Management Improvement Blog

  15. Pingback: Stu Hunter Discussing Bill Hunter, Statistics for Experimenters and EVOP » Curious Cat Management Improvement Blog

  16. Pingback: New Site Spam Flags Score from Moz | Improving Your Search Engine Ranking

  17. Pingback: Poorly Stratified Data Leads to Mistakes in Analysis | Curious Cat Management Improvement Blog

Comments are closed.