Multiverse Instructors Say AI Review of Every Class Is Causing Stress

The company says managers make all performance decisions. Instructors say the system’s constant scrutiny is changing how they teach.

By 3 min read
Multiverse Instructors Say AI Review of Every Class Is Causing Stress
Multiverse Instructors Say AI Review of Every Class Is Causing Stress

Listen to this story

The audio brief

About 1:32
0:001:32
Read transcript
Multiverse now uses AI to review every instructor session, replacing manager observations that might happen only about once a month. The system, called Compass, analyzes class transcripts and flags possible teaching concerns for managers to check. That wider coverage is meant to help the company spot problems sooner and tailor support. But instructors told The Guardian that constant scrutiny is making them anxious—and can change what happens in class. Compass looks for issues such as unclear task instructions, repeated filler, or a slow response when a connection is disrupted. Its guidance says one or two hedging phrases alone should not count against an instructor; the system should look for a repeated pattern. Still, instructors said managers questioned them about apparent digressions that were actually answers to students’ questions. One said trying to avoid flags made it harder to focus on listening. Multiverse says managers review the findings and make all performance decisions. The AI can recommend that a person review a session, but it cannot decide anyone’s job. The reports also weren’t initially visible to instructors: managers tested them in August, and instructors were introduced to Compass in September. Multiverse said instructors would be able to see the same reports in October. The timing matters: Ofsted found shortcomings in parts of the company’s provision in February, while praising its instructors as skilled and effective. The open question is whether giving instructors access—and keeping a manager between a flag and any action—can make frequent review useful rather than distracting.

Story brief

3 key points

Multiverse has expanded Compass from occasional manager observations to reviews of every instructor session, using class transcripts to assign risk statuses and confidence scores and flag concerns for human review. The company says managers—not AI—decide whether to act, and instructors were due to gain access to reports in October, after managers tested them in August. Staff accounts of anxiety and cases where...

  1. 01

    Compass checks transcripts for unclear task instructions, repeated filler, and slow responses to connection disruptions; guidance says one or two hedging phrases alone should not,

  2. 02

    Instructors told the Guardian that managers questioned suspected digressions that were actually answers to students’ questions; one said avoiding flags distracted from listening.

  3. 03

    Ofsted found shortcomings in several areas of Multiverse’s provision in February, while praising its instructors as skilled and effective.

A teacher answering a student’s question may now have to wonder whether an AI will call it a digression. Multiverse instructors told the Guardian that a new system reviewing their online classes has left them anxious and feeling continuously watched. The company says the tool spots possible problems for managers to check, not verdicts on teachers’ performance.

A wider view, or a longer watch?

Multiverse calls the tool Compass. It reviews sessions against the company’s teaching framework and combines its findings with learner feedback. Managers receive a review pointing to possible quality risks; instructors are meant to receive suggested areas for development. Multiverse argues that a monthly manager observation offered too narrow a view to catch emerging problems or tailor support. Its new approach greatly increases the amount of teaching examined.

What the system notices

The system analyzes transcripts of online classes, assigns instructors a risk status and confidence score, and writes comments for managers. According to the Guardian, its checks can flag unclear task instructions, repeated filler phrases and a slow response to a disrupted connection. Guidance described by the paper tells the AI not to fail a teacher for one or two hedging phrases; it should look for a repeated pattern across the transcript.

That distinction may matter less to an instructor who has to explain a flag. Teachers told the Guardian that managers had questioned suspected digressions that were actually answers to students’ questions. One said the need to avoid being marked down pulled attention away from listening to learners. The accounts show how even a flag meant for human review can affect a class before any formal performance decision is made.

The human decision does not end the dispute

Multiverse says delivery managers check Compass’s findings against what they know and decide whether to act. Performance management rests on human observation, it says, and the tool makes no decisions about anyone’s job. In its response to the Guardian, the company said the most consequential action the system can take is to recommend that a person review a session. That is a limit on the AI’s authority, not on how often it assesses instructors’ work.

Several instructors described sleep disruption, anxiety and a sense of continuous scrutiny. One told the Guardian they were waking in the night; another said they felt they had to watch their words rather than focus on the lesson. These are staff accounts of the tool’s effects, not a finding that every instructor has had the same experience. They challenge the company’s claim that broader review will produce better, more personalized feedback.

Who gets to see the assessment

Access is another point of friction. Multiverse says managers tested Compass reports in August, then introduced the tool to instructors in September. In September, only managers could see Compass reports; Multiverse plans to show instructors the same information in October. The company says it communicated the introduction in advance. An instructor writing for the Guardian said staff had been kept in the dark while the system was developed and could not yet inspect its analysis.

Multiverse trains workers in AI and digital skills, making teaching quality a substantial concern for the company. In February, UK education inspector Ofsted found shortcomings in several areas of its provision but praised its instructors as skilled and effective. Compass is intended to catch quality problems sooner than occasional observations could. Whether access to the reports and manager checks can make that process useful to the people being reviewed remains unsettled.

Sources

  1. multiverse.ioHow we're using AI to invest in coach development | Multiverse
  2. theguardian.comTeachers at Euan Blair firm report ‘horrendous stress’ after AI used to rate their work

Loading discussion...

YOUR READING SPACE

Notifications