amd
/

Meta-Llama-3.1-8B-Instruct-FP8-KV

Model card Files Files and versions Community

luow-amd commited on 19 days ago

Commit

287bcf3

•

1 Parent(s): 3aa66e3

Update README.md (#7)

- Update README.md (443db7d7e0072a441f36e856ce50fc25c1d4542a)

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,7 +5,7 @@ license: llama3.1
 - ## Introduction
   This model was created by applying [Quark](https://quark.docs.amd.com/latest/index.html) with calibration samples from Pile dataset.
 - ## Quantization Stragegy
-  - ***Quantized Layers***：All linear layers excluding "lm_head"
   - ***Weight***: FP8 symmetric per-tensor
   - ***Activation***: FP8 symmetric per-tensor
   - ***KV Cache***: FP8 symmetric  per-tensor

 - ## Introduction
   This model was created by applying [Quark](https://quark.docs.amd.com/latest/index.html) with calibration samples from Pile dataset.
 - ## Quantization Stragegy
+  - ***Quantized Layers***: All linear layers excluding "lm_head"
   - ***Weight***: FP8 symmetric per-tensor
   - ***Activation***: FP8 symmetric per-tensor
   - ***KV Cache***: FP8 symmetric  per-tensor