The "Lizardman's Constant" is a fascinating idea from Scott Alexander (Astral Codex Ten). Scott argues that approximately 4% of survey responses on polls/surveys are not sincere - hence why 4% of respondents are found to report believing that lizardmen run the Earth and 5% of atheists say they believe in god, etc.
I'd like to introduce a related idea that can ruin studies: the "Nonsense Factor." As Scott rightly points out, in any study, some respondents do not answer based on their sincere ...
More