Join FPOP for the first general body meeting of fall 2015! We will be sharing all the great events we have planned this fall, introducing the e-board to the incoming class and sharing a great lunch! If you are interested in joining the e-board or signing up for a working group this will be a great time to learn more about these positions and ask any questions! Hope to see you there on October 1st!
An Epidemic of Bad Research and Reporting
By: Sarah Kunkle
Original Publication found here: http://thevitalityinstitute.org/an-epidemic-of-bad-research-and-reporting/
Earlier this summer, the popular science and technology blog io9 ran a story that caught the eyes of many: “I Fooled Millions into Thinking Chocolate Helps Weight Loss.” Over the course of the article, John Bohannan, a science journalist, describes his elaborate hoax and laments the state of both nutrition research and science reporting. Unfortunately, this is all too common.
Although the study was real, it was intentionally plagued by methodological and analytical flaws, including an extremely small sample size and large number of measurements that gave the study a greater than 60 percent chance of finding at least one statistically significant result. To address these issues, some journals are considering getting rid of p-values (a measure indicating how likely it is that study results are due to chance) and many do not accept studies with fewer than 30 subjects. Nevertheless, many low quality studies still end up published in peer-reviewed journals.
Nutrition research is particularly vulnerable to biased results because of its dependence on self-reporting. A recent Mayo Clinic Proceedings article argued that memory-based dietary assessment methods were “fundamentally and fatally flawed” and should not be used to inform dietary guidelines. Organizations like the Nutrition Science Initiative are trying to combat these issues by funding more rigorous (and expensive) studies. While the evidence is inconclusive for some nutrition research questions, the 2015 Dietary Guidelines Advisory Committee seems to be a step in the right direction with its emphasis on minimally processed wholesome foods rather than specific nutrients.
In addition to poor quality research, bad reporting further complicates the issue. As Bohannon notes, reporters covering topics such as nutrition or broader scientific research should not merely echo what they read in press releases: “you have to know how to read a scientific paper – and actually bother to do it.” Readers should be especially weary of articles that do not mention sample size and effect size.
Bohannan is not alone in his views. Lancet editor Richard Horton recently published a commentary on bad scientific practices, claiming, “much of the scientific literature, perhaps half, may simply be untrue.” Increased public awareness and transparency are likely to ameliorate the problem. In the meantime, both reporters and readers should be cautious as they digest health headlines – if it sounds too good to be true, it likely is.
How to avoid getting duped by overblown health claims (via Quartz)
|1. Are humans involved?
||If the claims are based on a study done in mice, the results are not necessarily applicable to humans.
|2. What is the sample size?
||Be skeptical of results that involve less than 100 people and fairly skeptical of those that involve less than 1,000 people.
|3. What type of study?
||Study design matters. Systematic reviews, meta-analyses, and randomized controlled trials are generally the most reliable for testing hypotheses.
|4. Is it correlation or causation?
||Relevant to the point above on study design, most health studies draw mere correlations rather than direct causes.
|5. What are the study’s limitations?
||A good health story will not only explain the results, but also discuss the study’s limitations and why you shouldn’t trust the claim fully.
Happy summer FPOP fans!
For the last few years, the Mailman School has hosted the World Economic Forum’s (WEF) young global leaders. This group is comprised of a cohort of future leaders under 40 years old from around the world who serve in the program for 6 years. The goal of the program is to give them the knowledge base and connections to look for and implement innovative solutions for problems solving. By being part of this program, the school introduces these young leaders to public health while usually honing in on one particular public health issue each year.
This year, the public health component will focus on obesity and physical activity. Over the course of the 2-week program, a few of our faculty – including Claire Wang, Andrew Rundle and Heather Greenlee – will lead sessions on these topics, looking at the environmental, social and other risk factors to this issue. The fellows, in turn, will develop proposals for how to address this epidemic. On Friday, July 17th, they will present their proposals to a panel for larger discussion. Included on the panel will be Dean Fried, Steven Newmark, Senior Policy Advisor and Counsel to New York City Mayor Bill de Blasio, Sara Vernon Sterman, VP, Strategic Investments, the Reinvestment Fund, and Radha Agrawal, Founder and CEO, Super Sprowtz – a story-driven nutrition program, which uses entertainment and puppetry to educate kids about healthy eating habits.
WEF would very much like to invite members from our community, especially students, to listen to this discussion. The details for the event are below.
DATE // LOCATION // Friday, July 17 // Faculty House, 64 Morningside Drive
10:45-12:15 // Pitches and presentations
Maria O’Brien: Senior Director of Special Projects with the Dean’s Office // Email: email@example.com