Identifying Pseudoscience Bias and Logical Fallacies
Evaluating scientific claims, evidence, bias, and reasoning
Identifying Pseudoscience Bias and Logical Fallacies
Evaluating scientific claims, evidence, bias, and reasoning
Science - Grade 9-12
- 1
A website claims that a bracelet can improve balance and energy because several professional athletes wear it. The site does not provide controlled studies or data. Identify one sign of pseudoscience and one logical fallacy in this claim.
Look for whether the claim depends on evidence or on famous people.
One sign of pseudoscience is the lack of controlled scientific evidence. The logical fallacy is appeal to authority or celebrity endorsement, because athletes wearing the bracelet does not prove that the bracelet causes better balance or energy. - 2
A supplement company advertises, "Our product is 100% natural, so it is completely safe and better than medicine." Explain why this reasoning is flawed.
Poison ivy, arsenic, and some bacteria are natural but can be harmful.
The reasoning is flawed because natural substances are not always safe, and synthetic or medical treatments are not automatically harmful. This is the appeal to nature fallacy, and the company would need reliable safety and effectiveness data to support the claim. - 3
A student says, "My cold went away two days after I started drinking a special herbal tea, so the tea cured my cold." Identify the logical fallacy and explain what other explanation is possible.
The fallacy is post hoc reasoning, which assumes that because one event happened after another, the first event caused the second. The cold may have improved naturally because many colds get better on their own after several days. - 4
A graph in an advertisement shows a product increasing test scores from 82 to 84, but the y-axis starts at 80 instead of 0, making the increase look huge. What kind of bias or misleading presentation is being used?
Compare the visual size of the change to the actual numerical change.
The advertisement is using a misleading graph scale. Starting the y-axis at 80 exaggerates the visual size of a small increase, which can make the product seem more effective than the data actually show. - 5
A researcher tests whether a new plant fertilizer improves growth. She gives the fertilizer only to plants near a sunny window and gives no fertilizer to plants in a darker corner. Why is this a problem, and how could the experiment be improved?
A fair test changes one independent variable at a time.
This is a problem because sunlight is a confounding variable. The plants near the window may grow more because of extra light, not because of the fertilizer. The experiment could be improved by giving both groups the same light, water, soil, and temperature, while changing only the fertilizer. - 6
An article states, "Scientists have not proven that this crystal healing method does not work, so it must work." Identify the fallacy and explain why the claim is not scientific.
The fallacy is appeal to ignorance, because it treats a lack of disproof as proof. A scientific claim needs positive evidence from well-designed studies, not just the absence of evidence against it. - 7
A company reports that 9 out of 10 users felt better after using its product, but the survey included only 10 people who were already fans of the company. Identify two weaknesses in the evidence.
Consider both how many people were surveyed and how they were selected.
One weakness is the very small sample size, which makes the results less reliable. Another weakness is sampling bias, because the participants were already fans and may have been more likely to report positive results. - 8
A headline says, "Eating blueberries prevents cancer," but the study only found that people who ate more blueberries had a slightly lower cancer rate. Explain the difference between correlation and causation in this example.
The study shows a correlation because blueberry consumption and lower cancer rates occurred together. It does not prove causation because other factors, such as exercise, income, medical care, or overall diet, could explain the lower cancer rate. - 9
A social media post claims, "Doctors do not want you to know this simple cure because they make money when you stay sick." Identify the type of reasoning used and explain why it weakens the claim.
Notice whether the statement gives evidence or tries to make the audience suspicious.
The post uses conspiracy reasoning and attacks the motives of doctors instead of providing scientific evidence. This weakens the claim because it tries to create distrust without presenting reliable data that the cure works. - 10
A toothpaste advertisement says, "Everyone is switching to BrightSmile. Join millions of smart people who already know it is the best." Identify the logical fallacy and describe what evidence would be stronger.
The fallacy is bandwagon appeal, because it suggests the toothpaste is best simply because many people use it. Stronger evidence would include controlled comparisons showing that the toothpaste reduces cavities or plaque better than other options. - 11
A blog post rejects a climate study because one of the scientists once made an unrelated mistake in a newspaper interview. The blog does not discuss the study's data or methods. Identify the fallacy.
Ask whether the criticism targets the evidence or the individual.
The fallacy is ad hominem, because the blog attacks the person instead of evaluating the evidence, methods, and conclusions of the study. Scientific claims should be judged by data quality and reproducibility. - 12
A product label includes a seal that says "Scientifically Tested," but the company does not say who tested it, what was measured, or whether the results were peer reviewed. List three questions a skeptical consumer should ask.
A skeptical consumer should ask who conducted the test, what methods and measurements were used, and whether the results were independently replicated or peer reviewed. These questions help determine whether the claim is based on reliable science. - 13
In a trial of a new sleep app, participants knew they were using the new app and reported sleeping better. There was no control group. Explain how the placebo effect could affect the results and name one improvement to the study design.
Expectations can change how people report symptoms or experiences.
The placebo effect could make participants report improvement because they expected the app to help. The study could be improved by using a control group with a similar-looking app and, if possible, blinding participants to which app is being tested. - 14
A chart compares two diets. Diet A has 80 participants and Diet B has 8 participants. Diet B shows slightly greater weight loss. Why should a scientist be cautious when interpreting the result?
A scientist should be cautious because Diet B has a much smaller sample size, so its average may be less reliable and more affected by random variation. A fair comparison needs similar and adequate sample sizes or statistical analysis that accounts for the difference. - 15
A claim says, "If we require vaccines for school, the next step will be forcing every medical treatment on everyone." Identify the logical fallacy and explain why it is weak reasoning.
Look for a claim that jumps from one action to an extreme chain of events.
The fallacy is slippery slope, because it assumes one policy will automatically lead to extreme future outcomes without evidence. It is weak reasoning because each policy can be evaluated separately based on risks, benefits, laws, and evidence.