#sparse MoE
reddit.com · ⭐️ 8/10 · 2026-07-08
LingBot-Video is a 13B parameter sparse-MoE video diffusion transformer (1.4B active) that has been post-trained with reinforcement learning using six rewards, including a physical-plausibility reward, and supports action-conditioned world model prediction for robot rollouts. This work advances video generation and world modeling by combining sparse MoE for efficiency, RL post-training for improved plausibility, and open release of weights and code, making it a strong candidate for robotics and video synthesis research. The model uses a DeepSeek-V3-style sparse MoE with 128 experts and top-8 routing, achieving top average performance on RBench but ranking second on general text-to-video. The physical-plausibility reward is judged by a VLM, which raises concerns about reward hacking despite adding real-video negatives.