Grock Andrew, Jordan Jaime, Zaver Fareen, Colmers-Gray Isabelle N, Krishnan Keeth, Chan Teresa, Thoma Brent, Alexander Charlotte, Alkhalifah Mohammed, Almehlisi Abdulaziz S, Alqahtani Saeed, Anderson Scott, Anderson Shelaina, Andrews Colin, Andruko Jocelyn, Antony Nikytha, Aryal Diptesh, Backus Barbra, Baird Jennifer, Baker Andrew, Batty Sarah, Baylis Jared, Beaumont Braeden, Belcher Chris, Benavides Brent, Benham Michael, Botta Julian, Berger Pelletier Elyse, Bouchard Nicholas, Brazil Victoria, Brumfield Emily, Bryson Anthony, Bunchit Wisarut, Butler Kat, Buzikievich Lindy, Calcara David, Carey Rob, Carrillo Maria Rosa, Carroll Stephen, Lyons Casey, Cassidy Louise, Challen Kirsty, Chan Kathryn, Chaplin Tim, Chatham-Zvelebil Natasha, Chen Eric, Chen Lucy, Chhabra Sushant, Chin Alvin, Chochi Eric, Choudhri Tina, Christensen Jeremy, Connors Kimberly, Coppersmith Veronica, Cosgrove Abby, Costello Gregory, Cullison Kevin, D'Alessandro Andrew, Wit Kerstin, Decock Marie, Delbani Rayan, Denq William, Deutscher Julianna, Devine Brendan, Dorsett Maia, Duda Taylor, Dueweke Justin, Dunphy Teresa, Dyer Sean, Eastley Karthryn T, Edmonds Marcia, Edwards Ken, Ehrman Robert, Elkhalidy Youness, Fedor Preston, Ficiur Brian, Flynn Caley, Fraser Bill, Fu Meagan, Fukakusa James, Funk Eric, Gaco Damjan, Gawlik Viktor, Ghaffarian Kenn, Gharahbaghian Laleh, Griffith Andrew, Griffith Phil, Gronowski Tanner, Grossman Cathy, Gucwa Jaroslaw, Gupta Pawan, Gustafson Alexandra, Guy Andrew, Haas Mary, Haciski Stanislaw, Hajdinjak Emina, Hall Andrew K, Hammock Regina, Hansel Jan, Hart Alexander, Hattin Larissa, Herb Brandon, Hilbert SueLin, Hill Jeff, Hill Jesse, Ho Amy, House Emily, House Nina, Huang Simon York Ming, Huffman James, Inboriboon Charlie, Ireland Alex, Jamal Ali, Jamil Mohammad Ali, Jansen Victor, Jarou Zach, Jia Vivian, Johnston Levi, Kalnow Drew, Kapur Puneet, Kelly Seth, Kelson Kyle, Kent William, Khakhkhar Rishi, Khurana Jaasmit, Kilp Ashley, Knapp Scott, Kohler Sebastian, Kruhlak Ivanna, Lalani Nadim, Lam Samantha, Lank Patrick, Laurie Zander, Lea Kristina, Leber Ernest, Lee Ching-Hsing, Lenes Haakon, Lenora Nilantha, Leontowicz Jesse, Lien Kelly, Lin Michelle, Lin Yingchun, Little Andrew, Liu Harry, Liu Ivy, Liu Steve, Louka Stephanie, Lovell Elise, Lowe David, Lubberdink Ashley, Luc Jessica, Ma Sheng-Hsiang, MacLeod Hugh, Mancuso Nick, Maneshi Anali, May Jesse, Mayo John, McDonnell Mike, McLellan Susan, McQuarrie Carolyn, Mead Therese, Meeuwisse Cory, Meloy Patrick, Menzies Perry, Messman Anne, Miazga Stephen, Mills Logan, Mix Allan, Montag Steve, Moore Brendan, Morgenstern Justin, Mott Sarah, Mukherj P, Mulla Ali, Nandalal Sheena, Nikel Taylor, Nood Julia, Nugent Sean, Oakland Morgan, Oberholzer Werner, Otugo Onyeka, Oyedokun Taofiq Segun, Pardhan Alim, Patel Kinjal, Paterson Quinten, Patocka Catherine, Patterson Christine, Pearlman James, Pelletier-Bui Alexis, Phan Marc, Poonja Zafrina, Powell Aubrey, Premkumar Kamini, Prosen Gregor, Puri Vishal, Quaife Tanis, Raffel Ryan, Raja Ali, Ramunno Randi, Rang Louise, Rannazzisi Suzanne, Regan Shauna, Rezaie Salim R, Ridderikhof Milan, Rogers Vanessa, Roh Christine, Rosenberg Keith, Roure Marina, Rudinsky Sherri, Rudner Joshua, Saleh Adeeb, Sanderson Will, Scheirer Owen, Schofield Paul, Schunk Paul, Schwarz Evan, Shahrabadi Parisa, Shappell Eric, Sheffield Julia, Singh Manpreet, Singson Hector C, Slessor Dave, Smith Sam, Sneath Paula, Sobehart Robert, Spearing Kerry, Stempien James, Sternard Britni, Stratton Tara, Stuart Katherine, Stuntz Bob, Susalla Michael, Sweeney Colleen, Swisher Loice, Swoboda Henry, Syed Shahbaz, Taira Taku, Tambe Nikhil, Tang Richard, Targonsky Elisha, Taylor Alan, Taylor Rachel, Taylor Todd, Ting Paxton, Tiwald Gerhard, Tran Evelyn, Tran Kelvin, Trickovic Jason, Trinquero Paul, Tyagi Aaron, Umana Manrique, Vallance Patrick, Van den Berg Patricia, van Diepen Kelly, Vargas Luis, Verbeek Rene, Viggers Sandra, Vlodaver Zlata, Wagner Matthew, Walji Noorin, Walter Joe, Wan Miranda, Wang Rachel, Wanner Gregory, Warawa Wyatt, Ward Mike, Weekes Jennifer, Weersink Kristen, Weessies Cara, Whalen-Browne Anna, Whiteside Brian, Willis Matthew, Wilmer Jonas, Wong Nelson, Woodcroft Mark, Woods Rob, Yau Lawrence, Yee Jessica, Yeh Calvin, Yurkiw Katherine, Zaver Fareen, Zozula Alexander
Division of Emergency Medicine Greater Los Angeles VA Healthcare System Los Angeles California USA.
David Geffen School of Medicine UCLA Los Angeles California USA.
AEM Educ Train. 2021 May 16;5(3):e10601. doi: 10.1002/aet2.10601. eCollection 2021 Jul.
Free Open-Access Medical education (FOAM) use among residents continues to rise. However, it often lacks quality assurance processes and residents receive little guidance on quality assessment. The Academic Life in Emergency Medicine Approved Instructional Resources tool (AAT) was created for FOAM appraisal by and for expert educators and has demonstrated validity in this context. It has yet to be evaluated in other populations.
We assessed the AAT's usability in a diverse population of practicing emergency medicine (EM) physicians, residents, and medical students; solicited feedback; and developed a revised tool.
As part of the Medical Education Translational Resources: Impact and Quality (METRIQ) study, we recruited medical students, EM residents, and EM attendings to evaluate five FOAM posts with the AAT and provide quantitative and qualitative feedback via an online survey. Two independent analysts performed a qualitative thematic analysis with discrepancies resolved through discussion and negotiated consensus. This analysis informed development of an initial revised AAT, which was then further refined after pilot testing among the author group. The final tool was reassessed for reliability.
Of 330 recruited international participants, 309 completed all ratings. The Best Evidence in Emergency Medicine (BEEM) score was the component most frequently reported as difficult to use. Several themes emerged from the qualitative analysis: for ease of use-understandable, logically structured, concise, and aligned with educational value. Limitations include deviation from questionnaire best practices, validity concerns, and challenges assessing evidence-based medicine. Themes supporting its use include evaluative utility and usability. The author group pilot tested the initial revised AAT, revealing a total score average measure intraclass correlation coefficient (ICC) of moderate reliability (ICC = 0.68, 95% confidence interval [CI] = 0 to 0.962). The final AAT's average measure ICC was 0.88 (95% CI = 0.77 to 0.95).
We developed the final revised AAT from usability feedback. The new score has significantly increased usability, but will need to be reassessed for reliability in a broad population.
住院医师对免费开放获取医学教育（FOAM）的使用持续增加。然而，它往往缺乏质量保证流程，住院医师在质量评估方面几乎没有得到指导。急诊医学学术生活认可教学资源工具（AAT）是由专家教育工作者为FOAM评估而创建的，并且在这种情况下已证明有效。尚未在其他人群中进行评估。
我们评估了AAT在不同的急诊医学（EM）执业医师、住院医师和医学生群体中的可用性；征求反馈意见；并开发了一个修订版工具。
作为医学教育转化资源：影响与质量（METRIQ）研究的一部分，我们招募了医学生、EM住院医师和EM主治医师，让他们使用AAT评估五篇FOAM文章，并通过在线调查提供定量和定性反馈。两名独立分析师进行了定性主题分析，通过讨论和协商达成共识解决差异。该分析为初步修订的AAT的开发提供了信息，然后在作者组中进行试点测试后进一步完善。对最终工具的可靠性进行了重新评估。
在330名招募的国际参与者中，309人完成了所有评分。急诊医学最佳证据（BEEM）评分是最常被报告难以使用的部分。定性分析出现了几个主题：为便于使用——易于理解、逻辑结构合理、简洁且与教育价值一致。局限性包括偏离问卷最佳实践、有效性问题以及评估循证医学的挑战。支持其使用的主题包括评估效用和可用性。作者组对初步修订的AAT进行了试点测试，显示总分平均组内相关系数（ICC）具有中等可靠性（ICC = 0.68，95%置信区间[CI] = 0至0.962）。最终AAT的平均测量ICC为0.88（95% CI = 0.77至0.95）。
我们根据可用性反馈开发了最终修订的AAT。新评分显著提高了可用性，但需要在更广泛的人群中重新评估其可靠性。
