WAMJETWAMJET

A Harness for World Action Model Acceleration

Equipping coding agents to develop acceleration strategies tailored to different WAMs and GPU architectures.

Le Chen1, Lixin Liu2,✉, Jan Schneider1, Zeju Qiu1, Simon Guist1, Bernhard Schölkopf1, Dieter Büchler1,3

1Max Planck Institute for Intelligent Systems 2The Chinese University of Hong Kong 3Johannes Kepler University Linz ✉Corresponding author

  1. The bottleneck World Action Models (WAMs) leverage pretrained video foundation models for robot manipulation, but their large backbones and video-action co-prediction are expensive. Although existing acceleration techniques offer many ways to reduce this cost, selecting and composing them requires substantial engineering for each model and hardware platform.
  2. The harness We present WAMJET, an agentic harness that accelerates WAM inference by equipping coding agents with reusable optimization guidance and measurement and validation tools. The agent profiles inference, modifies targeted code, validates effects, and iteratively refines the acceleration stack as bottlenecks shift, while preserving action quality.
  3. The speedup Across seven WAMs, three coding agents, and two GPU architectures, WAMJET speeds up every WAM we tested, including a 9.95× lossless speedup on LingBot-VA over its upstream implementation. Approximation and hardware-aware optimization yield additional latency reductions, with comparable success rates.

Hand-tuning every WAM does not scale

Accelerating WAM inference is not a one-time optimization. It requires a recipe that composes techniques for a specific model, hardware platform, and task, and the best recipe for one WAM may not transfer directly to another.

Manual optimization requires coordination across kernel experts, model authors, and robotics engineers, and can take days to weeks for each model-GPU pair. A coding agent alone may stop at generic fixes, such as prompt caching or CUDA graphs, leaving deeper optimization opportunities unexplored.

A Manual optimization kernel expert model author robotics engineer Domain experts coordinate across groups model × GPU × workload Read profiles Identify the bottleneck Rewrite the code Apply domain knowledge Benchmark and validate Check speed and behavior Days to weeks per instance; repeated expert effort for each deployment B Coding agent alone >_ Prompt + repository Generic acceleration, limited depth Text-prompt caching Replay a CUDA graph … and usually stops here without looking at: actual code path: wrappers, syncs, redundant K-V work GPU architecture: Hopper vs. Blackwell kernels, FP8 / NVFP4 equivalent checks, stateful and task checks Deeper opportunities can remain unexplored; optimization depth varies from run to run C Agent + WAMJET Reusable guidance for each WAM and target GPU WAMs GPU architectures Coding agents FastWAM DreamZero OpenWAM H100 B200 Sol Astra Opus WAMs × GPU architectures × Coding agents WAMJET optimization guidance + tools Faster setup and checkpoint loading Staged checkpoints and device/meta initialization when applicable Code analysis and equivalent rewrites Profile bottlenecks, reuse conditioning, pack QKV, repair graphs Architecture-aware optimization GPU-specific kernels, memory layouts, and permitted FP8/NVFP4 Measure, check, and repeat Latency, output and state checks, with task checks for approximations An acceleration stack tailored to the deployment

Scroll sideways for all three panels →

(A) Manual optimization repeats expert effort for every deployment. (B) An agent alone stops at generic acceleration. (C) WAMJET gives the agent guidance and tools tailored to each WAM and target GPU.

A bottleneck-driven loop

The agent first reduces startup cost, then profiles a single inference call and targets the bottleneck. Each candidate is validated, and each accepted change becomes the new baseline. The agent then re-profiles the updated implementation and moves on to the next bottleneck.

  • Lossless techniques first: compilation, fusion, CUDA Graphs, reuse, kernel tuning.
  • Approximate techniques only when permitted, such as quantization matched to the GPU.
  • The loop continues within the available budget, rather than stopping at the first win.
lossless changes go straight to validation kept → re-profile from the accepted stack · repeat within the budget 0 Fast startup Checkpoint loading Meta-device init Prepared checkpoints Compile caches reused Load time Before 77 s WAMJET 17 s 1 Profile bottlenecks Latency profile per inference call Attention cond. K/V Syncs VAE 2 Lossless acceleration Compile + kernel fusion Fix graph breaks Drop host sync points Unroll loops, branches Fuse norm & residual CUDA Graphs, pack QKV 3 Approximate acceleration Architecture-aware quantization H100 → FP8 B200 → NVFP4 / MXFP8 when permitted 4 Validate & retain Gates: pass or revert Numerical drift ≤ tol. State checks Paired task evaluation Latency output

Scroll sideways for the full loop →

LingBot-VA · H100 · GPT-6-astra

5,323.6 ms per call

Upstream: 5,323.6 ms

1.00× faster than upstream
0 of 16 changes kept · round 1

Lossless only
    Round 1 and Round 2 mark the results after one and two WAMJET rounds. For lossless only runs, step 3 (approximation) is skipped. DreamZero on B200 and OpenWAM on B200 allow both lossless and approximate optimizations. Step gain compares each row with the previous row. Total speedup compares the current row with upstream. Step 0 shows the reduction in startup time.

    Where WAM latency hides

    WAMJET's guidance helps agents identify where time is spent. Pick a latency source to see a schematic CPU/GPU timeline before and after the optimization, along with the code change behind it.

    Reduce launch overhead with CUDA Graphs

    Lossless

    Schematic CPU/GPU timeline

    CPU GPU compute Data movement Waiting

    Python pseudocode

    BEFORE

    AFTER

    Timelines are schematic: they show the shape of each fix, not measurements.

    Every agent goes further with WAMJET

    Our first experiment gives three coding agents the same four WAMs on an H100, with and without WAMJET, and allows only lossless changes. R1 is one round of WAMJET optimization; R2 continues for a second round and is the reported result.

    Speedup = upstream latency / candidate latency, measured on H100. The upstream line sits at 1×. Hover a dot for its latency.
    Exact latencies per agent and round
    • 12 of 12 agent-WAM pairs end faster with WAMJET than the same agent without it.
    • A second round helps in every pair: R2 beats R1 all 12 times.
    • The largest gain is 9.95× on LingBot-VA with GPT-6-astra; the same agent reaches 5.51× without WAMJET.

    Each kept change behind the GPT-6-astra results is in the loop replay above.

    Quantization recipes follow the GPU

    When approximation is permitted, the agent applies quantization on top of the lossless optimizations and selects formats natively supported by the GPU. We test DreamZero[1] and Cosmos3-Nano-Policy-DROID[5] on Hopper (H100) and Blackwell (B200).

    Model H100 recipe B200 recipe
    DreamZero Dynamic FP8 NVFP4 feed-forward projections; dynamic FP8 for the remaining linears
    Cosmos3-Nano-Policy-DROID Dynamic FP8 MXFP8 projections with dynamic activation scaling
    Weights and their scales are prepared once; activation scales are recomputed on every call. GEMMs accumulate in higher precision and return BF16.

    Faster must not mean worse. We report the success rate on a RoboLab[6] subset of 20 tasks with 10 episodes per task. Task performance remains comparable to upstream.

    Configuration DreamZero Success Rate Cosmos3-Nano-Policy-DROID Success Rate
    Upstream 25.0% 43.0%
    WAMJET lossless 24.0% 47.0%
    WAMJET approximate FP8 26.0% 45.5%
    WAMJET approximate Blackwell formats 25.0% NVFP4 + FP8 44.5% MXFP8

    Room left in already-optimized SOTA WAMs

    OpenWAM

    OpenWAM[7], released on September 7, 2026, reports state-of-the-art results on several robot benchmarks and already incorporates several inference optimizations, such as the PyTorch compiler and velocity cache. We let WAMJET-guided GPT-6-astra optimize it on a B200 and evaluate on full LIBERO[8] and full LIBERO-plus[9].

    Configuration Latency (lower is better) Speedup LIBERO LIBERO-plus
    Upstream BF16
    87.25 ms
    1.00× 98.95% 69.27%
    WAMJET lossless BF16
    32.69 ms
    2.67× 99.10% 69.24%
    WAMJET approximate FP8
    31.70 ms
    2.75× 99.25% 69.30%

    Long-WAM

    Long-WAM[10], released on October 7, 2026, is another state-of-the-art WAM. It already incorporates NVFP4 quantization, CUDA Graphs, compilation, denoising-invariant reuse, and GEMM/VAE tuning. We use its V4/A4 configuration and let WAMJET-guided GPT-6-astra optimize it on a B200.

    Configuration Latency (lower is better) Speedup
    Upstream (V4/A4)
    108.92 ms
    1.00×
    WAMJET lossless
    43.32 ms
    2.51×

    On OpenWAM, the guided agent identifies substantial acceleration opportunities in an already highly optimized inference pipeline, achieving a 2.67× speedup while preserving action quality. On Long-WAM, WAMJET reduces latency from 108.92 ms to 43.32 ms, a further 2.51× speedup over the highly optimized upstream implementation.

    Run WAMJET on your own WAM

    To use WAMJET with your coding agent, start by installing its tools:

    git clone https://github.com/liulixinkerry/WAMJET.git
    cd WAMJET
    python -m pip install -e '.[numerics]'

    Then start your coding agent in the repository and launch a campaign with the example prompts, replacing the placeholders with your paths and campaign ID:

    Citation

    @article{chen2026wamjet,
      title={WAMJET: A Harness for World Action Model Acceleration},
      author={Chen, Le and Liu, Lixin and Schneider, Jan and Qiu, Zeju and Guist, Simon and Sch{\"o}lkopf, Bernhard and B{\"u}chler, Dieter},
      journal={arXiv preprint arXiv:2610.03797},
      year={2026}
    }

    References

    1. S. Ye et al. World action models are zero-shot policies. arXiv:2602.15922, 2026.
    2. T. Yuan, Z. Dong, Y. Liu, and H. Zhao. Fast-WAM: Do world action models need test-time future imagination? arXiv:2603.16666, 2026.
    3. L. Li et al. Causal world modeling for robot control. arXiv:2601.21998, 2026.
    4. M. J. Kim et al. Cosmos Policy: Fine-tuning video models for visuomotor control and planning. arXiv:2601.16163, 2026.
    5. N. Agarwal et al. Cosmos 3: Omnimodal world models for physical AI. arXiv:2606.02800, 2026.
    6. X. Yang et al. RoboLab: A high-fidelity simulation benchmark for analysis of task generalist policies. Proceedings of Robotics: Science and Systems, Sydney, Australia, July 2026.
    7. Y. Wang et al. OpenWAM: An open, modular exploration towards systematic world-action model pretraining. arXiv:2609.07398, 2026.
    8. B. Liu et al. LIBERO: Benchmarking knowledge transfer for lifelong robot learning. Advances in Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track, 2023.
    9. S. Fei et al. LIBERO-Plus: In-depth Robustness analysis of vision-language-action models. arXiv:2510.13626, 2025.
    10. W. Huang et al. Long-WAM: Scaling the Context of World-Action Models. arXiv:2610.10528, 2026.