ZeroModels Releases 118 Keras 3 Model Families Across Three Backends

The library packages converted pretrained weights behind a shared interface, aiming to let developers change Keras backends without rewriting model-facing code.

By 2 min read
ZeroModels Releases 118 Keras 3 Model Families Across Three Backends
ZeroModels Releases 118 Keras 3 Model Families Across Three Backends

Listen to this story

The audio brief

About 1:41
0:001:41
Read transcript
ZeroModels has released 118 pretrained model families in Keras 3, with one interface designed to run across JAX, PyTorch, and TensorFlow. The practical pitch is portability: developers can change the backend without rewriting the code that calls the model. The catalog covers vision, language, multimodal, and speech, including DETR for object detection, SegFormer for segmentation, Depth Anything V2 for depth estimation, SAM 3 for promptable masks, Whisper for speech recognition, and language models such as Qwen3, Gemma 4, GLM-5, and GPT-OSS. ZeroModels says these implementations are pure Keras 3, so Transformers and PyTorch are not required at runtime, even though many of the original models come from those ecosystems. Its main loader, called from_weights, can retrieve a preconverted Keras repository, convert an upstream checkpoint, load a Hugging Face repository using an “hf:” prefix, or create the architecture with random initialization. The project also pairs each model with its processor, aiming to keep settings like image resolution and normalization aligned with the checkpoint. There is a hardware angle too. Weight-only quantization supports int8, int4, fp8, and MXFP4. ZeroModels says GPT-OSS 120B can stay near 66 gigabytes in MXFP4, versus roughly 130 gigabytes after fp32 expansion. But those memory figures come from the project, not independent testing. The key constraint to watch is whether this interface portability translates into equally portable, practical deployment.

Story brief

3 key points

ZeroModels has launched a Keras 3 catalog covering 118 pretrained model families, with a single code path intended to work across JAX, PyTorch, and TensorFlow. The library spans vision, language, multimodal, and speech, and can load converted weights, upstream checkpoints, Hugging Face repositories, or uninitialized architectures. It also adds weight-only quantization, including MXFP4 for GPT-OSS 120B. That...

  1. 01

    The `from_weights` loader supports preconverted repositories, upstream checkpoint conversion, `hf:` sources, and randomly initialized architectures.

  2. 02

    Catalog examples include DETR, SegFormer, Depth Anything V2, SAM 3, Whisper, Qwen3, Gemma 4, GLM-5, and GPT-OSS.

  3. 03

    ZeroModels says GPT-OSS 120B can stay near 66 GB in MXFP4 versus roughly 130 GB after fp32 expansion.

ZeroModels has released with 118 pretrained model families implemented in Keras 3, giving developers one model interface across JAX, PyTorch, and TensorFlow. The new library’s central promise is portability: it says a project can change its Keras backend without rewriting model code.

The catalog spans vision, language, multimodal, and speech tasks. Listed families include DETR for object detection, SegFormer for segmentation, Depth Anything V2 for depth estimation, SAM 3 for promptable masks, Whisper for speech recognition, and language-model families including Qwen3, Gemma 4, GLM-5, and GPT-OSS.

ZeroModels describes its implementations as pure Keras 3 and says neither Transformers nor PyTorch is required at runtime. That separates the library from the original runtime stacks used by many of the model families it converts, while leaving the same Keras-facing code available across its three supported backends.

One loader, several routes to weights

Its main entry point is called from_weights. The API can load a preconverted Keras repository, convert an upstream checkpoint from a bare variant name, or load a compatible Hugging Face repository through an hf: prefix. It can also construct an architecture without loading weights, which gives developers a route to start from a randomly initialized model.

Preconverted weights are hosted through the zeromodels organization on the Hugging Face Hub. The documentation uses the same identifier for a model and its processor, and says that pairing keeps a processor’s resolution and normalization settings aligned with the checkpoint it loads.

SegFormer segmentation output over a street corner at dusk
ZeroModels includes SegFormer among its vision-model families, with a documented segmentation result over a street scene. Source: imvision12.github.io.

Portability does not erase hardware limits

The library also offers weight-only int8, int4, fp8, and MXFP4 quantization through the same loading call. For GPT-OSS 120B, ZeroModels says its mixture-of-experts weights can remain packed in MXFP4 and be dequantized during use, keeping the model near 66 GB instead of roughly 130 GB for an fp32 expansion. Those are project-provided memory figures, not an independent measure of deployment requirements.

Sources

  1. imvision12.github.ioZeroModels: 100+ model families with pretrained weights, implemented in Keras 3 and ready to run with any backend. Between this and KerasHub, that's a very extensive range of found

Loading discussion...