#model optimization

Taobao’s MNN team has reportedly open-sourced MNN-Pocket-0.3B, an approximately 300-million-parameter model designed to run fully offline on phones. The release includes separate versions for pretraining, post-training, and on-device deployment, with an INT4 deployment file said to be 173 MB and a target peak memory below 300 MB. The team reportedly used a 28-layer structure, cut the vocabulary from 151K to 64K, and claims average decoding of about 350 token/s on an iPhone 18 Pro, against a target of more than 200 token/s. Those speed and memory figures are source claims from a brief secondary report and have not been independently verified.