Publications

News

Call for Applications for an Evaluation Team and Subject Matter Experts for an STFM Competency-Based Medical Education Project

Apply by October 30, 2023

September 28, 2023—The ACGME Family Medicine Program Requirements that went into effect in July 2023 require programs to ensure residents demonstrate competence. The ACGME FM-RC has indicated that programs will need to show they are assessing competence, and the American Board of Family Medicine will require program directors attest to individual resident competence.

STFM is launching a new project to help family medicine residency programs meet the new requirements and is seeking:

1. Members with knowledge and expertise in competency-based medical education (CBME) to partner with members of the STFM CBME Task Force to provide faculty development to help family medicine residency programs make the transition to CBME. Faculty development will be delivered through in-person and virtual events. Travel will be reimbursed for in-person training, and nominal stipends may be provided.

To apply, send a 1-3 page letter of interest to Mary Theobald at mltheobald@stfm.org. Include:

  • Your name and contact information, including your program or institution
  • Why you're interested
  • A list of CMBE training you've received, including self-study
  • A list of any recent CBME presentations or papers
  • Any preference for virtual vs in-person delivery of faculty development

 

2. An Evaluator or Evaluation Team: This individual or team will lead the evaluation of a pilot project to test and refine CBME resources. They will form the evaluation plan, take the lead in survey development, be the principal investigator for the IRB, and lead the dissemination of results. 

About the Pilot Project:
Program directors and residency coordinators from up to 25 residency programs will participate in the pilot, which will include in-person and virtual training and implementation of a mobile app, an Individualized Learning Plan, other assessments identified by the STFM CBME Task Force, and STFM-directed strategies for learning portfolios. The resources will be implemented during the 2024-2025 academic year.

This will be an IRB-approved study to measure the effectiveness of the training, the mobile app, the assessments, the digital individualized learning plans, and the portfolio strategies. Participants will be required to complete pre-, mid- and post-pilot surveys, reporting on:

  • Their confidence in delivering competency-based assessment
  • The number of app-based assessments per resident
  • Program directors’ confidence in attesting to resident competence, based on the assessment methods used
  • Satisfaction with the mobile app, the assessments, and the individualized learning plans

$10,000 is available for project evaluation and dissemination.

To apply, send a 1-3 page letter of interest and qualifications to Mary Theobald at mltheobald@stfm.org.

This project is supported by a grant from the American Board of Family Medicine Foundation.

Ask a Question
AI Chatbot Tips

Tips for Using STFM's AI Assistant

STFM's AI Assistant is designed to help you find information and answers about Family Medicine education. While it's a powerful tool, getting the best results depends on how you phrase your questions. Here's how to make the most of your interactions:

1. Avoid Ambiguous Language

Be Clear and Specific: Use precise terms and avoid vague words like "it" or "that" without clear references.

Example:
Instead of: "Can you help me with that?"
Try: "Can you help me update our Family Medicine clerkship curriculum?"
Why this is important: Ambiguous language can confuse the AI, leading to irrelevant or unclear responses. Clear references help the chatbot understand exactly what you're asking.

2. Use Specific Terms

Identify the Subject Clearly: Clearly state the subject or area you need information about.

Example:
Instead of: "What resources does STFM provide?"
Try: "I'm a new program coordinator for a Family Medicine clerkship. What STFM resources are available to help me design or update clerkship curricula?"
Why this is better: Providing details about your role ("program coordinator") and your goal ("design or update clerkship curricula") gives the chatbot enough context to offer more targeted information.

3. Don't Assume the AI Knows Everything

Provide Necessary Details:The STFM AI Assistant has been trained on STFM's business and resources. The AI can only use the information you provide or that it has been trained on.

Example:
Instead of: "How can I improve my program?"
Try: "As a program coordinator for a Family Medicine clerkship, what resources does STFM provide to help me improve student engagement and learning outcomes?"
Why this is important: Including relevant details helps the AI understand your specific situation, leading to more accurate and useful responses.

4. Reset if You Change Topics

Clear Chat History When Switching Topics:

If you move to a completely new topic and the chatbot doesn't recognize the change, click the Clear Chat History button and restate your question.
Note: Clearing your chat history removes all previous context from the chatbot's memory.
Why this is important: Resetting ensures the AI does not carry over irrelevant information, which could lead to confusion or inaccurate answers.

5. Provide Enough Context

Include Background Information: The more context you provide, the better the chatbot can understand and respond to your question.

Example:
Instead of: "What are the best practices?"
Try: "In the context of Family Medicine education, what are the best practices for integrating clinical simulations into the curriculum?"
Why this is important: Specific goals, constraints, or preferences allow the AI to tailor its responses to your unique needs.

6. Ask One Question at a Time

Break Down Complex Queries: If you have multiple questions, ask them separately.

Example:
Instead of: "What are the requirements for faculty development, how do I register for conferences, and what grants are available?"
Try: Start with "What are the faculty development requirements for Family Medicine educators?" Then follow up with your other questions after receiving the response.
Why this is important: This approach ensures each question gets full attention and a complete answer.

Examples of Good vs. Bad Prompts

Bad Prompt

"What type of membership is best for me?"

Why it's bad: The AI Chat Assistant has no information about your background or needs.

Good Prompt

"I'm the chair of the Department of Family Medicine at a major university, and I plan to retire next year. I'd like to stay involved with Family Medicine education. What type of membership is best for me?"

Why it's good: The AI Chat Assistant knows your role, your future plans, and your interest in staying involved, enabling it to provide more relevant advice.

Double Check Important Information

While the AI Chat Assistant is a helpful tool, it can still produce inaccurate or incomplete responses. Always verify critical information with reliable sources or colleagues before taking action.

Technical Limitations

The Chat Assistant:

  • Cannot access external websites or open links
  • Cannot process or view images
  • Cannot make changes to STFM systems or process transactions
  • Cannot access real-time information (like your STFM Member Profile information)

STFM AI Assistant
Disclaimer: The STFM Assistant can make mistakes. Check important information.