Scale AI launches enterprise model customization with NVIDIA, citing insurance-call gains
Its insurance copilot improved accuracy and cut running costs in synthetic-call tests. Real-call evaluation and safeguards remain unfinished.
Loading page…
Its insurance copilot improved accuracy and cut running costs in synthetic-call tests. Real-call evaluation and safeguards remain unfinished.
Listen to this story
Scale Post-Training gives companies a way to adapt open-weight models to specific workflows, measure them against existing systems, and run them on their own infrastructure. In Scale’s synthetic French roadside-assistance calls, post-training raised fact-extraction accuracy to 93.8% from 76.1% for base Nemotron, while costing less per query than the insurer’s production model. The results are not deployment proof: real-call use still needs legal approval, live-workflow latency testing remains, and a guardrail for policy-violating promises is unfinished.
Scale opened the service on October 15, 2026, alongside a collaboration with NVIDIA; it can adapt models including NVIDIA’s Nemotron 3.5 Super VL.
For fact extraction, Scale reports costs of $3 per 1,000 queries versus $12.10 for the insurer’s production model.
A lower reasoning setting cut fact-extraction response time from 26 to 11 seconds and cost to $1.80 per 1,000 queries, with accuracy falling to 91.9%.
Scale AI opened its enterprise model-customization service on October 15, 2026, alongside a collaboration with NVIDIA. Its insurance example shows both the promise and the remaining work: Scale says specialized training improved accuracy and cut running costs, but the French-language call copilot has been evaluated on synthetic conversations and is not yet in production.
The offering, Scale Post-Training, adapts existing open-weight models—including NVIDIA’s Nemotron 3.5 Super VL—for particular business jobs. Scale measures a customer’s current system, develops task-specific training and evaluation data, then tests successive versions within the intended workflow. The models can run inside a company’s own infrastructure.
The unnamed insurer’s copilot is designed to help representatives as French-language calls unfold. Scale’s technical case study separates the work into three tasks, evaluated individually:
Legal approval is required before the insurer’s call data can be used for training, so Scale generated French conversations from sampled facts and policy scenarios. Scoring requires complete matches: all three extracted fields must be right, and coverage recommendations fail if even one benefit is missing or extra.
Scale first trained each task on successful reasoning and tool-use examples generated by the model. It then used reinforcement learning, rewarding answers that exactly matched verified results. Training compute cost about $890 for fact extraction and $230 for coverage recommendations.
Scale puts fact-extraction running costs at about $3 per 1,000 queries, versus $12.10 for the production model. Coverage recommendations cost about $1.40 per 1,000 queries, compared with $4.80.
A lower reasoning setting offered another tradeoff. Fact-extraction accuracy fell to 91.9%, while cost dropped to $1.80 per 1,000 queries and response time fell from 26 seconds to 11. Scale still plans to measure latency inside the live workflow and evaluate approved real calls before deployment.
The promise-checking guardrail also remains unfinished. Violations occur in only about 4% of checks in Scale’s evaluation. The guardrail must catch those cases without raising false alerts on the rest—a separate challenge from extracting facts or choosing benefits correctly.
Loading discussion...
Join the conversation
Explain which mistake would worry you more during a roadside-assistance call.
Be the first to share a perspective or an experience.
Reader comments
Newest comments first. Replies stay oldest first.