NVIDIA compresses material textures into 30% less memory
NVIDIA Research has developed a novel neural compression technique, 'Random-Access Neural Compression of Material Textures,' designed to address increasing storage and memory demands in photorealistic rendering by compressing multiple material textures and their mipmap chains together using a small neural network. This method allows for on-demand, real-time decompression with random access, providing 4x higher resolution (16X texels) using 30% less memory compared to traditional GPU texture formats, with image quality superior to AVIF and JPEG XL. The research was accepted to Siggraph 2023.
Key Takeaways
- The method compresses multiple material textures and their mipmap chains together with a small neural network.
- NVIDIA says the approach delivers 16X more texels, or 4x higher resolution, than BC high texture formats.
- The paper reports 30% less memory use than traditional GPU texture formats.
- The system supports on-demand, real-time decompression with random access similar to GPU block texture compression.
- NVIDIA says its custom training implementation runs more than 10x faster than general frameworks like PyTorch.
Why It Matters
For photorealistic rendering pipelines, the immediate gain is less texture memory pressure without giving up random access or real-time decompression. That matters because the paper combines disk and memory compression in a way that still fits GPU-style workflows, while targeting material textures and mipmap chains rather than isolated images. The competitive benchmark is explicit: NVIDIA says quality is better than AVIF and JPEG XL, and the method was accepted to SIGGRAPH 2023. Next to watch is the paper’s image viewer and whether the reported 16X texel density holds across texture comparisons.
Read full article at research.nvidia.com