Problems with meta-analyses

Photo by Pixabay on Unsplash
Meta-analyses are supposed to combine the evidence on a topic from many studies (e.g., does melatonin help sleep?) to produce an answer. Many people even consider them the gold standard for evidence about scientific questions. Unfortunately, taking a weighted average of many different studies sometimes doesn't work because averaging the studies can be meaningless. Suppose a meta-analysis on "meditation for depression" tries to average the results of a one-hour app-based mindfulness medita...
More

Demystifying p-values

Image by davisuko on Unsplash.
There is a tremendous amount of confusion around what a p-value actually is, despite their widespread use in science. Here is my attempt to explain the concept of p-values concisely and clearly (including why they are useful and what often goes wrong with them). — What's a p-value? — If you run a study, then (all else equal, aside from rare edge cases) the lower the p-value, the lower the chance that your results are due to random chance or luck. More precisely: a p-value is the probab...
More