Healthcare Practitioner

Description:

Role Responsibilities
 

• Write and refine prompts to guide model behavior in healthcare scenarios.
• Evaluate LLM-generated responses to healthcare queries for accuracy, reasoning, clarity, and completeness.
• Conduct fact-checking of medical claims using trusted public sources and authoritative references.
• Annotate model responses by identifying strengths, areas of improvement, and factual inaccuracies.
• Assess tone, completeness, and appropriateness of responses for real-world healthcare use.
• Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
   

Qualifications

Must-Have
 

• 5+ years of real-world professional experience in Healthcare, supported by an associated expert degree (e.g., MD, DO, RN, NP, PA, PharmD, MPH, or equivalent).
• Experience in one or more of the following sub-domains: General Clinical Care, Specialty Medicine or Surgery, Diagnostics, Imaging & Laboratory Medicine, Public Health, Healthcare Systems & Administration.
• Significant experience using large language models (LLMs).
• Excellent writing communication skills for complex medical topics.
• Strong attention to detail and comfort in evaluating clinical reasoning and medical explanations.