NVIDIA NVFP4

NVFP4 is NVIDIA's 4-bit floating-point data format and low-precision quantization recipe for AI training and inference, introduced with the NVIDIA Blackwell architecture and implemented in NVIDIA software such as Transformer Engine. It uses E2M1 4-bit values with hierarchical scaling to reduce model memory and quantization error.