ByteDance Seed and Tsinghua AIR Introduces CUDA Agent: A Large-Scale Agentic RL System for CUDA Kernel Generation

ByteDance Seed and Tsinghua AIR developed CUDA Agent, a reinforcement learning system that trains a large language model to generate GPU kernels outperforming torch.compile. It achieves a 98.8% correctness pass rate and doubles the speed of compiled kernels on a 250-task benchmark. The system uses a proprietary 23B-parameter model and a complex GPU-based sandbox environment, with partial resources publicly available for adoption.