Modelspublished

Runway’s Solaris Generates App Interfaces Frame by Frame, but It Isn’t Ready for Public Use

The experimental system shifts the interface from a prebuilt program to continuously generated pixels. That could create more adaptive software, but it also leaves text, accuracy, long sessions and accessibility unresolved.

By 3 min read
Runway’s Solaris Generates App Interfaces Frame by Frame, but It Isn’t Ready for Public Use
Runway’s Solaris Generates App Interfaces Frame by Frame, but It Isn’t Ready for Public Use

Listen to this story

The audio brief

About 1:38
0:001:38
Read transcript
Runway is testing Solaris, an AI system that generates an app interface frame by frame as a person clicks, drags, or types. Instead of loading screens and behaviors built in advance, Solaris treats the visual scene itself as the application, continuously rendering what appears next. Runway introduced Solaris on August 31 as the first system in its Interface World Models family. It builds on the company’s Gen-4.5 video model and GWM-1 world model. A separate language model interprets the user’s request and decides how the scene should change; Solaris then renders that response one frame at a time. Runway says autoregressive generation, step distillation, and self-training make this fast enough for real-time rendering at 720p. The early results are notable, but limited. In a Runway-run study of 250 people and nearly 7,500 pairwise judgments, Solaris beat a coded Claude Opus 5 interface in 61 percent of instruction-following comparisons and 71 percent of comparisons about natural interaction. Runway also tested it against GPT-4o, Gemini 2.5 Pro, and Fable 5 using visual-similarity measures. None of that is independent production evidence. The bigger issue is readiness. Text can be unstable, outputs can be inaccurate, long sessions can become inconsistent, and accessibility-API support is incomplete. Solaris is not public, and there are no released weights, code, or API details. Runway is taking early-access requests and working with launch partners. The key question is whether generated visuals can become reliable, accessible software—not just convincing interactive video.

Story brief

3 key points

Runway is positioning Solaris as an experimental alternative to conventional software interfaces: a language model determines changes while a world model renders each response as video-like frames. Early tests found it preferable to a coded Claude Opus 5 interface in 61% of instruction-following comparisons and 71% of natural-interaction comparisons. However, Solaris is not publicly available, lacks released...

  1. 01

    The evaluation involved 250 participants and nearly 7,500 pairwise judgments, but was run by Runway rather than an independent evaluator.

  2. 02

    Solaris belongs to Runway’s Interface World Models family and builds on Gen-4.5 and GWM-1.

  3. 03

    Known limitations include unstable text rendering, inaccurate outputs, inconsistent long interactions, and incomplete accessibility-API support.

Runway is testing a different boundary for software: instead of opening a prebuilt interface, a user would interact with a screen that is generated anew as they click, drag or type. Its newly introduced Solaris model renders those interfaces frame by frame, making the visual scene itself the application rather than a display sitting above conventional interface code.

Runway introduced Solaris on August 31 as the first member of what it calls its Interface World Models family. The system is built on the company’s Gen-4.5 video model and GWM-1 world model, extending video generation toward a use case where the output must respond continuously to a person’s actions.

An interface rendered instead of implemented

Solaris does not use an intermediate code representation to produce the interface. It generates visual frames sequentially, and actions such as clicks and drags condition what appears next. That is a meaningful architectural change from an interface whose screens and behaviors have been defined before a user arrives.

The division of labor matters. A separate language model interprets the request, decides how a scene should change and steers the renderer. Solaris then creates the visual response one frame at a time. Runway says autoregressive generation, step distillation and self-training make that loop fast enough for real-time rendering at 720p.

Runway’s user-study result
61%Instruction following

In Runway’s study, 250 participants made nearly 7,500 pairwise judgments. Solaris was preferred over a coded result based on Claude Opus 5 in 61% of instruction-following comparisons.

71%Natural interaction

The same study found Solaris preferred in 71% of comparisons over the coded result when participants judged whether the interaction felt natural.

The evidence is promising, but company-run

Runway evaluated Solaris in a reconstruction benchmark against GPT-4o, Gemini 2.5 Pro and Fable 5, using SSIM and DINOv3 similarity measures. The company also compared the system with a coded Claude Opus 5 result in its user study. Those tests support a case for visual fidelity and interaction quality, but they are Runway’s own evaluations rather than independent production evidence.

Four problems that cut against production use

  • Text rendering remains unstable, a direct problem for interfaces that depend on clear, persistent labels and information.
  • The system can produce inaccuracies, so a visually convincing interface is not necessarily grounded in correct information.
  • Consistency across long interactions is still a stated limitation, even though Solaris is intended to react over a continuing session.
  • Accessibility support is incomplete, including integration with accessibility APIs used by assistive technology.

A research system, not a software platform

Solaris is not publicly available. Runway is accepting early-access requests and working with launch partners, but it has released no code, model weights or API details. The immediate question is therefore not whether developers can substitute Solaris for a web stack today, but whether its visual interaction can hold up once these reliability and access constraints are addressed.

For now, Solaris is best understood as a wager that an interface can be generated like an interactive video rather than authored as fixed screens. It establishes a technical direction—one where a language model chooses the next behavior and a world model renders it—but Runway’s own limits show how far that direction remains from dependable everyday software.

Sources

  1. runway.comRunway News | Introducing Solaris
  2. indianexpress.comRunway unveils Solaris, an AI model that generates interactive app interfaces