why are the fp16 baseline perplexity values little different?

[shahaamirbader]

why are the ppl values in Table 11 for llama 2 7B, Llama-2-13b, and Llama 3 8B different from the generally reported values such as those in the QuaRot paper?

Your table 11 shows the following
Llama-2-7b 5.12
Llama-2-13b 4.57
Llama-3-8b 5.54

Where as in the paper like IntactKV Table 7, and several other papers, the values are as follows
Llama-2-7b 5.48
Llama-2-13b 4.89
Llama-3-8B 6.15