Telemedicine Curriculum Gets High Marks in Pilot Project

February 9, 2022—The STFM Telemedicine Curriculum Pilot Project wrapped up December 31, with more than 1,000 residents and students at 30 medical schools and residency programs completing and evaluating online modules. “Implementation by the pilot sites was outstanding,” said Steven Lin, MD, chair of the STFM Telemedicine Curriculum Task Force and principal investigator for the pilot project. “The data from learners and faculty affirm the quality of the curriculum and provide ideas for future enhancement.”

During the pilot project, which ran from September 1 – December 31, 2021, residents and students were tasked with completing and evaluating five asynchronous modules:

  • Module 1: Intro to Telehealth
  • Module 2: The Telehealth Encounter
  • Module 3: Requirements for Telehealth
  • Module 4: Access and Equity in Telehealth
  • Module 5: Future of Telehealth

Key findings from learner evaluations:

  • Three out of four participants agreed or strongly agreed that they were satisfied and that they gained helpful new knowledge, skills, and/or attitudes.
  • Four out of five participants agreed or strongly agreed that the information was presented effectively, and that it was at the right level for them.
  • The overall experience did not differ significantly between medical students and residents, although students were slightly more likely to report that the information was too advanced, while residents were slightly more likely to report that it was too basic.

At the end of the pilot, site leads (faculty) completed evaluations to provide their perspectives on the curriculum as a whole. Key findings from faculty evaluations:

  • The content is on target. Faculty rated each module on a scale of 1-5 with 1 being poor and 5 being excellent. Modules received mean scores of 3.9 – 4.7. “The Telehealth Encounter” module received the highest ratings.
  • Some modules are too advanced for 1st-year medical students; some are too basic for residents

“I think the results of the pilot project illustrate that these modules are going to fill a need for high-quality, off-the-shelf telemedicine curriculum,” said Rika Bajra, MD, co-investigator. 

A more detailed analysis and results will be submitted for publication.

The telemedicine modules are free for all STFM members. STFM membership is free for medical students and $50 for residents. The modules are also available through a subscription to the Family Medicine Residency Curriculum Resource. In addition to the modules, the STFM Telemedicine Curriculum Task Force aggregated and/or created guidance to help teaching clinicians integrate telemedicine topics into courses, clerkships, and residency curricula.

Pilot Project Sites

Medical Schools:

  • Central Michigan University College of Medicine
  • Edward Via College of Osteopathic Medicine- Carolinas Campus
  • Frank H. Netter MD School of Medicine Quinnipiac University
  • Indiana University School of Medicine
  • Morehouse School of Medicine
  • Northwell Health; Zucker School of Medicine
  • Ohio State University College of Medicine
  • Pacific Northwest University of Health Sciences
  • Touro University College of Osteopathic Medicine
  • University of Missouri-Columbia School of Medicine
  • University of North Texas Health Science Center at Fort Worth - TCOM
  • University of Maryland School of Medicine
  • University of Minnesota Medical School, Duluth Campus
  • University of Washington Department of Family Medicine
  • WMU Homer Stryker M.D. School of Medicine

 

Residency Programs

  • Carle Family Medicine Residency Program
  • Eau Claire Family Medicine Residency Program at Prevea Health Family Medicine
  • Heritage Valley Family Medicine Residency Program
  • LSUHSC Family Medicine Residency Program 
  • Lewis Gale Family and Community Medicine Residency
  • Hanford Residency Program
  • North Country Family and Community Medicine Program
  • Oregon Health & Science University, Portland Program
  • Texoma Medical Center Family Medicine Residency Program
  • University of Iowa Family Medicine and Family Medicine Psychiatry
  • University of Nevada Reno Family Medicine Residency Program
  • UPMC St. Margaret Family Medicine Residency Program
  • VIrtua Family Medicine Residency Program
  • West Kendall Baptist Hospital- Florida International University Family Medicine Residency Program
  • WVU Rural Family Medicine Residency Program

 

Ask a Question
AI Chatbot Tips

Tips for Using STFM's AI Assistant

STFM's AI Assistant is designed to help you find information and answers about Family Medicine education. While it's a powerful tool, getting the best results depends on how you phrase your questions. Here's how to make the most of your interactions:

1. Avoid Ambiguous Language

Be Clear and Specific: Use precise terms and avoid vague words like "it" or "that" without clear references.

Example:
Instead of: "Can you help me with that?"
Try: "Can you help me update our Family Medicine clerkship curriculum?"
Why this is important: Ambiguous language can confuse the AI, leading to irrelevant or unclear responses. Clear references help the chatbot understand exactly what you're asking.

2. Use Specific Terms

Identify the Subject Clearly: Clearly state the subject or area you need information about.

Example:
Instead of: "What resources does STFM provide?"
Try: "I'm a new program coordinator for a Family Medicine clerkship. What STFM resources are available to help me design or update clerkship curricula?"
Why this is better: Providing details about your role ("program coordinator") and your goal ("design or update clerkship curricula") gives the chatbot enough context to offer more targeted information.

3. Don't Assume the AI Knows Everything

Provide Necessary Details:The STFM AI Assistant has been trained on STFM's business and resources. The AI can only use the information you provide or that it has been trained on.

Example:
Instead of: "How can I improve my program?"
Try: "As a program coordinator for a Family Medicine clerkship, what resources does STFM provide to help me improve student engagement and learning outcomes?"
Why this is important: Including relevant details helps the AI understand your specific situation, leading to more accurate and useful responses.

4. Reset if You Change Topics

Clear Chat History When Switching Topics:

If you move to a completely new topic and the chatbot doesn't recognize the change, click the Clear Chat History button and restate your question.
Note: Clearing your chat history removes all previous context from the chatbot's memory.
Why this is important: Resetting ensures the AI does not carry over irrelevant information, which could lead to confusion or inaccurate answers.

5. Provide Enough Context

Include Background Information: The more context you provide, the better the chatbot can understand and respond to your question.

Example:
Instead of: "What are the best practices?"
Try: "In the context of Family Medicine education, what are the best practices for integrating clinical simulations into the curriculum?"
Why this is important: Specific goals, constraints, or preferences allow the AI to tailor its responses to your unique needs.

6. Ask One Question at a Time

Break Down Complex Queries: If you have multiple questions, ask them separately.

Example:
Instead of: "What are the requirements for faculty development, how do I register for conferences, and what grants are available?"
Try: Start with "What are the faculty development requirements for Family Medicine educators?" Then follow up with your other questions after receiving the response.
Why this is important: This approach ensures each question gets full attention and a complete answer.

Examples of Good vs. Bad Prompts

Bad Prompt

"What type of membership is best for me?"

Why it's bad: The AI Chat Assistant has no information about your background or needs.

Good Prompt

"I'm the chair of the Department of Family Medicine at a major university, and I plan to retire next year. I'd like to stay involved with Family Medicine education. What type of membership is best for me?"

Why it's good: The AI Chat Assistant knows your role, your future plans, and your interest in staying involved, enabling it to provide more relevant advice.

Double Check Important Information

While the AI Chat Assistant is a helpful tool, it can still produce inaccurate or incomplete responses. Always verify critical information with reliable sources or colleagues before taking action.

Technical Limitations

The Chat Assistant:

  • Cannot access external websites or open links
  • Cannot process or view images
  • Cannot make changes to STFM systems or process transactions
  • Cannot access real-time information (like your STFM Member Profile information)

STFM AI Assistant
Disclaimer: The STFM Assistant can make mistakes. Check important information.