Sunday, 27 June 2021

[PSA] 10 tips for consuming skincare evidence (and how to avoid the hogwash)

Beauty Tips For Body Care
Hi, friends who love skincare. Lately, there have been a number of posts highlighting or discussing research around skincare. Some of the claims in these discussions have been erroneous at best, so I wanted to share some insights that I hope will make all of us more shrewd consumers of evidence. First, a disclaimer: I am NOT a dermatologist and I have no specialized knowledge of skincare whatsoever. However, I am completing a PhD in population health so I do know a thing or two about health research. Here are some tips I've brainstormed that I hope are helpful for all of us who just want to follow the evidence and do right by our lovely faces:​PubMed and Google Scholar are just search engines. Like any search engine, these have more useful results and less useful results. A study appearing on PubMed is NOT a guarantee of quality. I often see posts here that make a claim and then link to PubMed as if the claim is now gospel. Sadly, it typically is not. While these databases are excellent sources of information, they are simply tools. You must do the quality control yourself (or rely on someone you trust).Studies are not all created equal. There are good studies and bad studies. There are good researchers and, well, less good researchers. As a frequent publisher of research and a regular peer reviewer, I can tell you that peer review is also, sadly, no guarantee of quality. Are most researchers acting in good faith to generate accurate and reliable knowledge? Yes. Do people ALWAYS act in good faith? No. Do people often make big mistakes even when doing their best? Absolutely. There are many terrible studies that have gotten through peer reivew.One study tells you very little in most cases. Do not rely on any one study. Typically, a wide body of evidence is needed to generate credible claims. Multiple studies from multiple teams build off of one another to provide some confidence that something is true. This interplay between studies is an important part of the scientific process. It’s how theory is built. Sometimes studies align with one another, and sometimes they contradict. Good scientists are always looking for ways in which they could be wrong. If you’re interested in learning more about why you shouldn’t trust one study, Google the “replication crisis” in social science research. Spoiler: The results of many landmark studies cannot be re-created using the exact method, and sometimes even the exact data. Yikes.Consider generalizability. Studies are deisgned to apply to very specific outcomes in very specific populations. Good studies acknowledge this and explain to whom they can “generalize” the results, and what other information is needed to extend the findings to other groups. Was this study conducted in a community or location similar to yours? Did participants have skin like yours? Even if the findings are persuasive, they still may not apply to your specific situation.Always look for competing interests. Most journals require declaration of interests. Often, this is incredibly informative. Who funded this study? Where else do these researchers get their bread buttered? Researchers are basically self-employed in many circumstances, and often have to raise grant money to fund their own salaries. Consider who they might want to appease, either implicitly or explicitly. Even when conflicts are disclosed and researchers do their absolute best to remain objective, bias may creep into the research process.Be a skeptic of evidence posted on reddit and other social media. People make some wild claims on here, often saying things about research methodologies that sound highly technical (and therefore, seem quite credible), but are often deeply incorrect. Sample size, power, and study design are areas where people tend to make inaccurate claims.Trust a diverse array of experts! I love dermatologists and I have learned so much from them (RanellaMD anyone???). But dermatologists are not necessarily taught to produce or consume research. Many are shrewd readers who stay up on the literature, but some may not, or may simply overlook weaknesses in a study. The point is you should also listen to other experts, like chemists, formulators, aestheticians, or anyone else you trust. This is why LabMuffin is such a great resource in addition to derms. A diverse group of sources is the best way to triangulate information and get the evidence you need.If it sounds too good to be true, it probably is. This helpful idea comes from Bayesian statistics, which suggests that stranger claims must meet a higher standard of evidence to change your prior beliefs. It’s also common sense.Be wary of confirmation bias. In this same vein, be aware of confirmation bias, in which we discount information that goes against what we already believe and seek out sources that affirm our preconceived notions. Try to take in information as objectively as possible; look for rigorous claims that contradict what you already think.Don’t discount your experience. Trust yourself and weigh what you know against new information.I am sure many of you have excellent tips I have missed. In the spirit of science, please weigh in with your own strategies and suggestions. Sorry for the long post. Please go forth, research, and conquer!tl;dr Be a critical consumer of evidence. A link to a study is not enough—demand more!
Girls Blog 2015
Submitted by felixflitwick

No comments:

Post a Comment