AI Medical Data Specialist (Prompt Engineering)

Wisedocs is on a mission to make it easy and accessible for companies in the insurance, legal, and medical sectors to quickly understand medical documents using AI. Every week, we process hundreds of thousands of pages, saving our customers countless hours of manual effort and helping them streamline medical claim processing. 

As we continue to grow, we are excited to add a AI Medical Data Specialist to our incredible Machine Learning team. In this role, you will play a crucial role in evaluating and testing the outputs of AI models, particularly those related to extracted and summarized data. You will work closely with our engineering and product teams to ensure that the outputs of our machine learning models meet both technical and clinical standards. Your insights and feedback will drive improvements in our systems and ensure that our products deliver exceptional value to healthcare providers and their patients. 

*This role is hybrid for Ontario based candidates (~50% office based), and remote based for US candidates

Key Responsibilities: 

• Prompt and Model Testing: Test AI-generated outputs, focusing on medical prompts and machine learning models used in healthcare applications. 

• Feedback Loop: Analyze AI output for accuracy, relevance, and clinical validity. Provide detailed feedback to the engineering team to enhance prompt performance and model behavior. 

• Standard Operating Procedures (SOPs): Write, maintain, and update detailed SOPs for medical prompt engineering and testing, ensuring consistency and quality in prompt creation and validation. 

• Collaboration with Engineering: Work closely with the engineering team to troubleshoot, refine, and optimize machine learning models based on feedback from prompt testing and evaluation. 

• Quality Assurance: Ensure that the AI-generated responses align with clinical guidelines, best practices, and healthcare regulations. 

• Data Analysis: Assist in analyzing medical data sets and model outputs to evaluate the performance of AI models in clinical contexts. 

• Documentation: Document all testing procedures, outcomes, and improvements. Create user-friendly guides and best practice documents for prompt testing and optimization. 

• Continuous Improvement: Actively participate in the iterative process of improving prompt accuracy, functionality, and overall system performance in collaboration with cross-functional teams. 
• other projects and duties as assigned

Qualifications: 

• Medical Background: A degree in medicine, nursing, medical informatics, or a related field, or significant hands-on clinical experience. 
• Previous nurse or paralegal background is a great asset

• Experience with AI/ML: Familiarity with AI, machine learning models, and prompt engineering, especially in healthcare or clinical settings. 

• Testing and Quality Assurance: Experience with testing and evaluating technology solutions, particularly in the healthcare or technology space. 

• Desire to learn and grow your skillset! 

• SOP Writing: Experience writing clear, concise, and detailed Standard Operating Procedures (SOPs) and documentation. 

• Communication Skills: Excellent written and verbal communication skills, with the ability to deliver technical feedback in a clear and constructive manner. 

• Attention to Detail: Strong attention to detail, particularly when reviewing AI outputs for clinical accuracy and relevance. 

• Problem-Solving: Ability to identify issues, propose solutions, and collaborate with engineering teams to resolve challenges. 

Preferred Qualifications: 

• Familiarity with Healthcare Regulations: Knowledge of HIPAA, medical privacy laws, and healthcare compliance standards. 

• Technical Skills: Experience with data analysis tools, basic coding (Python, R, etc.) and SQL 

• Experience in Medical AI: Previous work with AI models in a medical context, such as AI-powered medical documentation systems, diagnostic tools, or virtual health assistants. 

What We Offer

• A remote model for US based employees, hybrid model for Ontario based employees
• Comprehensive health, vision and dental coverage
• Immersive learning and development opportunities with fast career growth potential
• Regular company events
• Paid Time Off and Paid Sick Days
• Casual dress code
• Employee referral bonuses
• Tuition assistance
• Recognition programs and much more