Computing Power Basics / TOKEN WIKI
There is a difference between the theoretical peak value of
FLOPS / floating point computing power
In one sentence
FLOPS represents the number of floating point operations per second, which is often used to describe computing performance under specific precision and conditions.
Why it matters
Numbers with different precisions, sparse conditions and statistical calibers cannot be directly compared horizontally.
Practical considerations
verifies FP32, BF16, FP16 or lower precision calibers and differentiates between peak and actual mission performance. Can
FAQ
PFLOPS and Token/s be directly converted?
No, the model structure, sequence length, hardware and implementation will all affect the conversion relationship.
