Other Publications

Education Columns

Developing Tools to Assess Interprofessional Practice Behaviors in Outpatient Family Medicine Settings

Stephanie White, DO, and David Dickter, PhD

Interprofessional teams are increasingly used in ambulatory primary care practices. This has created a growing need for tools to assess interprofessional practice behaviors. While general competencies exist for interprofessional education and practice, current interprofessional assessment tools focus primarily on attitudes and general competencies that apply across health care teams or teams in general.1 “Collaborate as a member of an interprofessional team” is one of thirteen core Entrustable Professional Activities (EPAs) the Association of American Medical Colleges (AAMC) expects all graduating medical students to be able to perform without direct supervision by the time they begin residency.2 There is a shortage of measures to assess overall clinic performance in the outpatient setting and specifically in ambulatory family medicine. To meet these needs, Western University of Health Sciences has developed an assessment tool for family medicine providers that is adaptable for multiple professions who participate in outpatient family medicine practice.

Development of this assessment tool was a multi-step process. Focus groups and individual interviews with physicians, physician assistants, nurses/nurse practitioners, and medical assistants were conducted to generate lists of behaviors and practices that facilitate or impede team based care. The aim was to capture some of the very specific behaviors seen on a day to day basis in the clinic but also to measure broader skills and behaviors exemplified by members of the clinical hierarchy. For example, to describe measures of a previously undefined “community building” skill, the focus group discussions on this topic emphasized the value of being connected and integrated into the team both professionally and personally. Clinicians who failed to connect in this way tended to struggle in other domains of teamwork and mutual respect. When focus group lists were finalized, the content was sorted into themes or categories, and behavior-based items and a rating scale of observed frequency of each item were developed. The assessment tool was piloted on a working team of family medicine professionals; this resulted in further revisions in the tool for the purpose of clarity and brevity. The rubric was categorized using the four competencies of the Interprofessional Education Collaborative (IPEC)3 and organized around a progressive skill set in interprofessional practice. Performance levels are described as “Emerging, Developing, Mastering and Exemplary/Leader.” After an additional iteration, the tool was condensed into a clear and pragmatic performance rubric.

This assessment tool is currently being studied and tested across multiple institutions and will likely undergo further revision to most effectively assess interprofessionalism, enhance team dynamics, support emerging members of the team, and most importantly, improve patient outcomes. The goal is to develop a validated instrument that effectively measures one’s ability to practice outpatient Family Medicine as a member of an interprofessional team. This rubric can be can be adapted in full or in part by others to design tools to assess the interprofessional practice behaviors of their specific discipline.

References

  1. Canadian Health Collaborative. An inventory of quantitative tools measuring interprofessional education and collaborative practice outcomes. August 2012. https://rcrc.brandeis.edu/pdfs/Canadian%20Interprofessional%20Health%20Collaborative%20report.pdf
  2. Association of American Medical Colleges. Core Entrustable Professional Activities for entering residency: Curriculum developers’ guide; 2014. Available from https://ipecollaborative.org/uploads/IPEC-2016-Updated-Core-Competencies-Report__final_release_.pdf
  3. Interprofessional Education Collaborative Expert Panel. Core Competencies for Interprofessional Collaborative Practice: Report of an Expert Panel. 2011. http://www.aacn.nche.edu/education-resources/ipecreport.pdf
Ask a Question
AI Chatbot Tips

Tips for Using STFM's AI Assistant

STFM's AI Assistant is designed to help you find information and answers about Family Medicine education. While it's a powerful tool, getting the best results depends on how you phrase your questions. Here's how to make the most of your interactions:

1. Avoid Ambiguous Language

Be Clear and Specific: Use precise terms and avoid vague words like "it" or "that" without clear references.

Example:
Instead of: "Can you help me with that?"
Try: "Can you help me update our Family Medicine clerkship curriculum?"
Why this is important: Ambiguous language can confuse the AI, leading to irrelevant or unclear responses. Clear references help the chatbot understand exactly what you're asking.

2. Use Specific Terms

Identify the Subject Clearly: Clearly state the subject or area you need information about.

Example:
Instead of: "What resources does STFM provide?"
Try: "I'm a new program coordinator for a Family Medicine clerkship. What STFM resources are available to help me design or update clerkship curricula?"
Why this is better: Providing details about your role ("program coordinator") and your goal ("design or update clerkship curricula") gives the chatbot enough context to offer more targeted information.

3. Don't Assume the AI Knows Everything

Provide Necessary Details:The STFM AI Assistant has been trained on STFM's business and resources. The AI can only use the information you provide or that it has been trained on.

Example:
Instead of: "How can I improve my program?"
Try: "As a program coordinator for a Family Medicine clerkship, what resources does STFM provide to help me improve student engagement and learning outcomes?"
Why this is important: Including relevant details helps the AI understand your specific situation, leading to more accurate and useful responses.

4. Reset if You Change Topics

Clear Chat History When Switching Topics:

If you move to a completely new topic and the chatbot doesn't recognize the change, click the Clear Chat History button and restate your question.
Note: Clearing your chat history removes all previous context from the chatbot's memory.
Why this is important: Resetting ensures the AI does not carry over irrelevant information, which could lead to confusion or inaccurate answers.

5. Provide Enough Context

Include Background Information: The more context you provide, the better the chatbot can understand and respond to your question.

Example:
Instead of: "What are the best practices?"
Try: "In the context of Family Medicine education, what are the best practices for integrating clinical simulations into the curriculum?"
Why this is important: Specific goals, constraints, or preferences allow the AI to tailor its responses to your unique needs.

6. Ask One Question at a Time

Break Down Complex Queries: If you have multiple questions, ask them separately.

Example:
Instead of: "What are the requirements for faculty development, how do I register for conferences, and what grants are available?"
Try: Start with "What are the faculty development requirements for Family Medicine educators?" Then follow up with your other questions after receiving the response.
Why this is important: This approach ensures each question gets full attention and a complete answer.

Examples of Good vs. Bad Prompts

Bad Prompt

"What type of membership is best for me?"

Why it's bad: The AI Chat Assistant has no information about your background or needs.

Good Prompt

"I'm the chair of the Department of Family Medicine at a major university, and I plan to retire next year. I'd like to stay involved with Family Medicine education. What type of membership is best for me?"

Why it's good: The AI Chat Assistant knows your role, your future plans, and your interest in staying involved, enabling it to provide more relevant advice.

Double Check Important Information

While the AI Chat Assistant is a helpful tool, it can still produce inaccurate or incomplete responses. Always verify critical information with reliable sources or colleagues before taking action.

Technical Limitations

The Chat Assistant:

  • Cannot access external websites or open links
  • Cannot process or view images
  • Cannot make changes to STFM systems or process transactions
  • Cannot access real-time information (like your STFM Member Profile information)

STFM AI Assistant
Disclaimer: The STFM Assistant can make mistakes. Check important information.