Compression

NAACL24 Slides

In this paper we study the impact of quantization on model confidence

When Quantization Affects Confidence of Large Language Models?

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis posuere tellus ac convallis placerat. Proin tincidunt magna sed ex sollicitudin condimentum.