Seeing Patterns Where None Exists
I call data dredge studies the “Rorschach tests” of epidemiology, because researchers can pull out characteristics about people in almost unlimited combinations to find all sorts of correlations and conclude just about anything they set out to find. Just like the Rorschach test, seeing patterns where none exists, finding connections that are there but not as strongly as believed, and seeing what one expects to see, are common.
Page 8 of Statistics for Experiments by George Box, Willliam Hunter (my father) and Stu Hunter (no relation) shows a graph of the population (of people) versus the number of storks which shows a high correlation. “Although in this example few would be led to hypothesize that the increase in the number of storks caused the observed increase in population, investigators are sometimes guilty of this kind of mistake in other contexts.” And some might make it in this context 🙂
Related: Illusion of Explanatory Depth – Illusions, Optical and Other – Theory of Knowledge – Sarah, aged 3, Learns About Soap

Pingback: CuriousCat: Mistakes in Experimental Design and Interpretation
Pingback: Curious Cat Management Improvement Blog » Fooled by Randomness
Pingback: Curious Cat » Bigger Impact: 15 to 18 mpg or 50 to 100 mpg?
Pingback: CuriousCat: 500 Year Floods
Pingback: Curious Cat Management Improvement Blog » Does the Data Deluge Make the Scientific Method Obsolete?
Pingback: CuriousCat: How Large Quantities of Information Change Everything
Pingback: Curious Cat Science Blog » Correlation is Not Causation
Pingback: Curious Cat Management Improvement Blog » Friday Fun: Correlation
Pingback: Curious Cat Science and Engineering Blog » Albert Einstein, Marylin Monroe Hybrid Image
Pingback: Curious Cat Science and Engineering Blog » The Value of Displaying Data Well
Pingback: Curious Cat Management Improvement Blog » Communicating with the Visual Display of Data
Pingback: Curious Cat Management Improvement Blog » The CEO is Only One Person
Pingback: Curious Cat Science and Engineering Blog » Statistical Errors in Medical Studies
Pingback: Leanpub Podcast on My Book – Management Matters: Building Enterprise Capability » Curious Cat Management Improvement Blog
Pingback: Stu Hunter Discussing Bill Hunter, Statistics for Experimenters and EVOP » Curious Cat Management Improvement Blog
Pingback: New Site Spam Flags Score from Moz | Improving Your Search Engine Ranking
Pingback: Poorly Stratified Data Leads to Mistakes in Analysis | Curious Cat Management Improvement Blog