AIDC
← 返回全部动态
vLLM 官方博客(网页)规则精选09月15日 00:00

vLLM x Novita AI: Chord, Faster INT4 MoE for Kimi K2.x. Up to 1.3x on H200, 2.15x on Untuned B300

Novita AI has open-sourced Chord, a high-performance W4A16 MoE CUDA kernel for Kimi K2.x serving shapes, with a Humming-compatible indexed path and grouped SM90

阅读 vLLM 官方博客(网页) 原文 ↗