Researchers decode NVIDIA SASS control code optimize kernels

arxiv.org1 min read

Researchers present the first systematic study of an unexplored control-code field in NVIDIA's native GPU ISA across architectures from Volta to Blackwell. Using instruction-level microbenchmarks, they show that the field controls barrier exemption and programmable warp priority. A developed post-compilation binary optimizer accelerates representative kernels by up to 31.9 percent and end-to-end LLM inference by up to 3.6 percent. Open article →