(US) QA Auditor (Sampling, Quality Gates, Release Readiness)
Actively Reviewing the ApplicationsCodvo.ai
On-site
Posted 2 weeks ago
•
Apply by June 18, 2026
Job Description
QA Auditor (Sampling, Quality Gates, Release Readiness) - USA
JD: QA Auditor — Surgical Video Annotation (Sampling, Quality Gates, Release Readiness)
Location: USA | Type: Full-time
Reports to: Quality Lead / Program Lead
Role goal: Protect dataset quality at scale by running sampling-based audits, enforcing quality gates, and ensuring every dataset release is audit-ready and meets acceptance thresholds.
About Us
At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.
Responsibilities
Execute sampling plans (stratified by label type, difficulty, site/surgeon/device, model confidence) for ongoing QA and release audits.
Audit annotations against guidelines + ontology; score defects using standardized rubrics (severity, type, root cause).
Run and validate quality gates prior to release:
completeness/coverage checks
schema/constraint checks (illegal combinations, temporal consistency, boundary rules)
defect density and rework thresholds
Generate rework tickets with precise instructions; track closure and verify fixes.
Partner with Annotation Lead to drive calibration actions (training refreshers, guideline clarifications, examples library).
Maintain QA dashboards: defect rate, rework %, gate pass rate, audit cycle time, top error patterns by annotator/team/label type.
Support release readiness: ensure required artifacts are complete for the Evidence Pack (QA results, sampling logs, sign-offs).
Escalate systematic issues to Adjudication/Clinical Review (definition gaps, ambiguous classes, recurring edge cases).
Deliverables (what you produce weekly)
QA audit reports (sample size, findings, severity distribution, root-cause categories)
Gate status + release checklist sign-off recommendations
Rework queue and closure verification
Trend insights and corrective action plan (top 3 issues + fixes)
Requirements
3–7+ years in data QA / annotation QA / operations quality; experience auditing labeled datasets (video preferred).
Strong command of sampling-based QA: stratified sampling, acceptance thresholds, and audit scoring.
High attention to detail; comfortable reading and enforcing detailed SOPs/guidelines.
Strong documentation skills; can write clear defect descriptions and rework instructions.
Comfortable with dashboards/spreadsheets; basic metric literacy (defect density, rework, throughput).
Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.
Quick Tip
Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.
Related Similar Jobs
View All
Team Member IS Risk
YES BANK
Audit
CI/CD Pipelines
Penetration Testing
+9
Recruiter - Entry Level
Lensa
India
Full-Time
Communication
Sales
Networking
+21
Threat Intelligence
National Payments Corporation Of India (NPCI)
India
Full-Time
Risk Management
Dashboards
Digital Risk
Category Manager
Spencer's Retail
India
Full-Time
Sales
Google Sheets
Dashboards
Manager-HR
Navsoft
India
Full-Time
Communication
HR Policies
Leadership
+25
Quick Apply
Upload your resume to apply for this position