II.
Workflow overview
Reference · liveworkflow:underwriting-model-validation
Underwriting Model Validation overview
Validates the statistical and machine-learning models used in insurance underwriting -- back-testing loss-ratio predictions against actual experience, evaluating model discrimination and calibration metrics (AUC, Brier score), running regulatory-mandated adverse-impact analyses across protected classes, reviewing feature-importance stability for concept drift, and comparing challenger models against incumbent production models. Produces model validation reports, regulatory compliance documentation, and champion-challenger comparison summaries. Excludes model development and retraining.
Attributes
displayName
Underwriting Model Validation
workflowKind
governance
triggerType
scheduled
typicalCadence
quarterly
complexity
cross-team
description
Validates the statistical and machine-learning models used in insurance
underwriting -- back-testing loss-ratio predictions against actual
experience, evaluating model discrimination and calibration metrics
(AUC, Brier score), running regulatory-mandated adverse-impact analyses
across protected classes, reviewing feature-importance stability for
concept drift, and comparing challenger models against incumbent
production models. Produces model validation reports, regulatory
compliance documentation, and champion-challenger comparison summaries.
Excludes model development and retraining.
Outgoing edges
applies_to_domain2
- domain:insurance·DomainInsurance
- domain:data-science·DomainData Science
involves_role3
- role:ml-engineer·RoleMachine Learning Engineer
- role:data-scientist·RoleData Scientist
- role:security-reviewer·RoleSecurity Reviewer
performed_by_org_unit2
- org-unit:ml-team·OrgUnitML Team
- org-unit:compliance-team·OrgUnitCompliance Team
requires_skill_area2
- skill-area:ml-fine-tuning·SkillAreaML Fine-Tuning
- skill-area:eval-driven-development·SkillAreaEval-Driven LLM Development
triggers_responsibility2
- responsibility:ai-safety-guardrails·Responsibility
- responsibility:review-architecture-changes·ResponsibilityReview architecture changes
Incoming edges
None.