Research

CAFM Educational Research Alliance (CERA)

Sample Peer-Review Feedback

For a study entitled: "Professional Boundaries: How do family medicine residency programs teach and model an ethical framework for patient care?"

Reviewer 1:

Patient Physician Relationship seems to be the issue of interest based on your background information, which is good. At this time, however, your research question and Objectives seem to broadly address professionalism without narrowing to this specific question of Patient Physician Relationship. It is mentioned in one objective and not mentioned in many of the actual questions. I think if the background was left the same and the question/objectives were rewritten to allow the survey questions to only address the relationship part of professionalism, it might provide valuable information. At this point, it seems too broad to gather the information.

Reviewer 2:

"Doctor-patient boundaries" is a very important topic for family medicine residency programs!  Your proposal is not yet ready for prime time, but I encourage you to resubmit.  Here is my feedback.  Introduction - this is very well-argued, and your citations are spot-on.  Aims and hypotheses - These should match your survey questions perfectly, but they don't.  I note you include questions about (a) curriculum and (b) policies, so edit your research questions to address both; right now the research questions address only curriculum. Your hypotheses are merely descriptive, that is, it appears that you simply plan to "count" responses to survey questions (these types of hypotheses are considered "weak" because one cannot test them).  Can you think of correlations with these curricula or policies?  For example, what might influence a residency program to have specific policies in place? Perhaps the program director's own behavior - does he or she treat family members, friends, employees?  Are rules less stringent in small communities? Good hypotheses will predict correlations between variables.  Finally - the survey questions. As I said above, you appear to focus on curriculum and policies. I picture about 3-4 questions with "check all that apply" response. "Does your program's Professionalism curriculum address issues regarding physician-patient boundaries? (check all that apply): a. prohibiting sexual relationships between doctors and patients; b. discouraging medical care for self or family members; c. discouraging medical care for co-workers or employees; etc." You could use a parallel questions for clinic policies. Also include a question regarding the mode of teaching - didactics, mentoring, rolemodeling, etc. In general, CERA does not 'like' check-all-that-apply questions, but if your survey had only 3-4 questions, hm... maybe...  If you decide to re-apply, ask CERA for a mentor to help you with the application. We do that! 

 

Reviewer 3:

This is an interesting question. The hypotheses are mostly descriptive. Strongly hypotheses would result in a stronger proposal. The questions also need significant work and there is no attempt at an analysis plan.

 

 

Additional Required Preparation:

☐ Become familiar with the CERA data repository 

Highly Recommended Readings for CERA Mentors:

10 Tips for Building Effective Surveys

Survey Questions 101: Do You Make These 7 Mistakes?

FAQs About CERA Data 

Creating a Centralized Infrastructure to Facilitate Medical Education Research

 

 

Contact Us

 

11400 Tomahawk Creek Parkway

Leawood, KS 66211

(800) 274-7928

stfmoffice@stfm.org 

 

 

Ask a Question
AI Chatbot Tips

Tips for Using STFM's AI Assistant

STFM's AI Assistant is designed to help you find information and answers about Family Medicine education. While it's a powerful tool, getting the best results depends on how you phrase your questions. Here's how to make the most of your interactions:

1. Avoid Ambiguous Language

Be Clear and Specific: Use precise terms and avoid vague words like "it" or "that" without clear references.

Example:
Instead of: "Can you help me with that?"
Try: "Can you help me update our Family Medicine clerkship curriculum?"
Why this is important: Ambiguous language can confuse the AI, leading to irrelevant or unclear responses. Clear references help the chatbot understand exactly what you're asking.

2. Use Specific Terms

Identify the Subject Clearly: Clearly state the subject or area you need information about.

Example:
Instead of: "What resources does STFM provide?"
Try: "I'm a new program coordinator for a Family Medicine clerkship. What STFM resources are available to help me design or update clerkship curricula?"
Why this is better: Providing details about your role ("program coordinator") and your goal ("design or update clerkship curricula") gives the chatbot enough context to offer more targeted information.

3. Don't Assume the AI Knows Everything

Provide Necessary Details:The STFM AI Assistant has been trained on STFM's business and resources. The AI can only use the information you provide or that it has been trained on.

Example:
Instead of: "How can I improve my program?"
Try: "As a program coordinator for a Family Medicine clerkship, what resources does STFM provide to help me improve student engagement and learning outcomes?"
Why this is important: Including relevant details helps the AI understand your specific situation, leading to more accurate and useful responses.

4. Reset if You Change Topics

Clear Chat History When Switching Topics:

If you move to a completely new topic and the chatbot doesn't recognize the change, click the Clear Chat History button and restate your question.
Note: Clearing your chat history removes all previous context from the chatbot's memory.
Why this is important: Resetting ensures the AI does not carry over irrelevant information, which could lead to confusion or inaccurate answers.

5. Provide Enough Context

Include Background Information: The more context you provide, the better the chatbot can understand and respond to your question.

Example:
Instead of: "What are the best practices?"
Try: "In the context of Family Medicine education, what are the best practices for integrating clinical simulations into the curriculum?"
Why this is important: Specific goals, constraints, or preferences allow the AI to tailor its responses to your unique needs.

6. Ask One Question at a Time

Break Down Complex Queries: If you have multiple questions, ask them separately.

Example:
Instead of: "What are the requirements for faculty development, how do I register for conferences, and what grants are available?"
Try: Start with "What are the faculty development requirements for Family Medicine educators?" Then follow up with your other questions after receiving the response.
Why this is important: This approach ensures each question gets full attention and a complete answer.

Examples of Good vs. Bad Prompts

Bad Prompt

"What type of membership is best for me?"

Why it's bad: The AI Chat Assistant has no information about your background or needs.

Good Prompt

"I'm the chair of the Department of Family Medicine at a major university, and I plan to retire next year. I'd like to stay involved with Family Medicine education. What type of membership is best for me?"

Why it's good: The AI Chat Assistant knows your role, your future plans, and your interest in staying involved, enabling it to provide more relevant advice.

Double Check Important Information

While the AI Chat Assistant is a helpful tool, it can still produce inaccurate or incomplete responses. Always verify critical information with reliable sources or colleagues before taking action.

Technical Limitations

The Chat Assistant:

  • Cannot access external websites or open links
  • Cannot process or view images
  • Cannot make changes to STFM systems or process transactions
  • Cannot access real-time information (like your STFM Member Profile information)

STFM AI Assistant
Disclaimer: The STFM Assistant can make mistakes. Check important information.