GitHub

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

AWQ search for accurate quantization. Pre-computed AWQ model zoo for LLMs (LLaMA-1&2, OPT, Vicuna, LLaVA; load to generate quantized weights). Memory-efficient 4-bit Linear in PyTorch. Efficient CUDA ...
GitHub

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

AWQ search for accurate quantization. Pre-computed AWQ model zoo for LLMs (LLaMA, OPT, Vicuna, LLaVA; load to generate quantized weights). Memory-efficient 4-bit Linear in PyTorch. Efficient CUDA ...
IEEE

RefQSR: Reference-Based Quantization for Image Super-Resolution Networks

Abstract: Single image super-resolution (SISR) aims to reconstruct a high-resolution image from its low-resolution observation. Recent deep learning-based SISR models show high performance at the ...
IEEE

GausiQ: Generalized Automatic Hybrid-Precision Quantization for MIMO Detection

Abstract: Automatic quantization generates efficient hybrid precision quantization schemes without manual effort, offering a promising approach for developing hardware-friendly MIMO detectors. However ...