Cohere adds video-moment search to Compass, seeking design partners
Video Intelligence is designed to retrieve spoken and visual evidence from recordings. Access starts with design partners, and its benchmark lead is company-reported.
Listen to this story
The audio brief
Story brief
3 key pointsCohere is inviting design partners to test Video Intelligence in Compass, a video-search capability introduced November 16, 2026, before any general-availability announcement. It searches speech and visual content, selects relevant timestamps at query time, and can retrieve related documents from the same permission-controlled index. Cohere reports leading seven video-embedding rivals across 11 datasets, but the results are company-reported and enterprise knowledge accounted for only 85 queries, making partner testing on real company footage a key next validation step.
- 01
The evaluation covered 11,133 queries, but counts were uneven: 9,801 across five public benchmarks and 85 for enterprise knowledge.
- 02
Cohere reports a 4.4-point average nDCG@10 lead over its strongest alternative, with different rivals leading by domain.
- 03
Design partners can test their own footage in Cohere-managed cloud or their own environment and work with Cohere engineers.
A question about a recorded meeting could return the relevant exchange, its transcript and a related document—not just a video file. That is the aim of Video Intelligence in Compass, which Cohere introduced on November 16, 2026. The company is recruiting design partners to test the capability rather than announcing general availability.
Finding the moment, not just the recording
Cohere says Compass searches both what people say and what appears on screen, including slides, charts and demonstrations. The distinction matters in its examples: a presenter’s spoken description may differ from the chart behind them, while understanding a sports incident may require following a sequence rather than recognizing one frame.
Rather than searching only predefined clips, Compass determines the relevant start and end times when a query arrives. That targets a second problem beyond finding the right recording: returning enough footage to answer the question without leaving the user to scrub through an unnecessarily long segment.
Each result links to the original footage, with timestamps, a transcript and a visual description so users can check the source. Cohere says one search can also retrieve a matching document page, slide or spreadsheet sheet. Video and documents share an index, with permissions controlling which material each user can retrieve.
The intended users include developers building search applications and AI agents that retrieve company information before answering. Cohere also points to its Compass MCP server, a connection through which compatible agents can access retrieval tools. Its proposed uses span several kinds of video library:
- Meetings and research: locate decisions, forecasts or commitments in recorded discussions, presentations, earnings calls and analyst briefings.
- Education and training: retrieve a particular explanation, demonstration or procedure from lectures, onboarding recordings and training libraries.
- Sports and media: search for plays, players, camera angles or visible brands to support footage discovery, highlights and sponsor reporting.
- Legal and compliance: find statements or disclosures and return clips with transcripts and visual context for reviewers to check.
Cohere evaluated retrieval across 11 datasets, combining public benchmarks with internal enterprise video datasets.
A company-reported lead, with different rivals by domain
Cohere compared Compass against seven video embedding models, which turn video into representations used for search. It reports first place across the evaluation suite, averaging 4.4 points above the strongest alternative. The measure, nDCG@10, scores how well a search system ranks relevant material within its first ten results. These are Cohere’s results, not an independent validation.
The closest competitor changed with the material. Cohere reports a 4.8-point lead over Amazon Nova 2 across five public benchmarks. On soccer footage, its lead over Gemini Embedding 2 was 5.1 points; on the MultiVENT 2.0 news benchmark, it was 5.0 points. Enterprise knowledge produced a smaller, 2.0-point lead over Qwen3-VL Embedding 8B.
The query counts also varied sharply. Five public benchmarks contributed 9,801 queries, compared with 790 for news, 247 for sports and 85 for enterprise knowledge. The enterprise portion covered meetings, lectures and workplace-safety training—material directly relevant to the business uses Cohere is pitching.
For organizations interested in testing that fit, the design-partner invitation offers deployment in Cohere’s managed cloud or their own environment. Partners can evaluate their own footage and queries, work directly with Cohere’s engineering team and help shape the product’s development.
Sources
- cohere.comIntroducing Video Intelligence in Compass | Cohere
Reader comments
Newest comments first. Replies stay oldest first.