Annotation QA Lead (Quality Lead)
QA Lead owns annotation quality: define gold standards, run audits, measure IAA, lead remediation and training for annotator panels. Critical to maintain high dataset reliability.
Responsibilities
Core responsibilities
- Design QA processes, gold datasets and adjudication workflows.
- Monitor IAA, gold check pass rates and annotator drift.
- Coach annotators and run calibration sessions.
- Author/update annotation guidelines; work with clients on edge cases.
Qualifications
Skills & experience
- Must: strong analytical skills, prior QC/annotation experience.
- Preferable: familiarity with inter-rater stats and dataset QA tooling.
- Nice-to-have: domain knowledge for specialized datasets.
Recommended Jobs
Director, Portfolio Program Management
Company Description AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We striv…
Assistant Manager
Job Description Job Description Company Overview Our talented team members have been delivering exceptional service to guests for almost 60 years. We reached our premier status by recognizing …
Sales Representative
GFI Digital, Inc. is currently searching for outside Sales Representative candidates to add to our award-winning sales team. If you are ready to start a new career, or have been in the sales industry…
Full Time Endocrinology Job IL
One of the largest, most advanced & financially successful hospital systems located in a beautiful riverfront community in Central Illinois, is looking to add an Endocrinologist. This top-level group…
PREP COOK (FULL TIME)
We are hiring immediately for full time COOK SUPERVISOR positions. Location : Northwestern Lake Forest Hospital - 1000 North Westmoreland Road, Lake Forest, IL 60045. Note: online applicati…
Full Time Family Practice Job Chicago, IL
An accomplished & collegial group of physicians has outpatient Family Medicine openings in Chicago Heights, Tinley Park, and Olympia Fields, IL . This group of doctors strongly embraces the philoso…
Customer Service Rep - 1602 S Galena Ave
Job Description CSR's need to be outgoing, polite and self-motivated. Job Duties include: Answering phones, Greeting carry out customers, misc. cleaning, cutting pizzas, making pizza, sandw…
Executive Assistant
We are looking for a proactive team player who enjoys working in a dynamic environment and has a passion for helping others. Strong attention to detail and excellent communication skills in English (w…
Sales Representative - English and Chinese Required (H-1B Sponsorship)
Job Description Job Description Benefits: ~401(k) matching ~ Bonus based on performance ~ Company car ~ Company parties ~ Competitive salary ~ Employee discounts ~ Flexible schedule…
Registered Nurse Inpatient-Delnor Surgical unit Full Time Nights - Sign on Bonus
Job Description Job Description Company Description At Northwestern Medicine, every patient interaction makes a difference in cultivating a positive workplace. This patient-first approach is…