Commit
•
6132c4b
1
Parent(s):
de47017
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
I tried making groupsize 16 but that did not end well so I went with 32g. FYI I can run this with full context on my A6000.
|
| 2 |
|
| 3 |
```
|
| 4 |
-
65B
|
| 5 |
wikitext2 3.5319948196411133 (stock 16bit)
|
| 6 |
wikitext2 3.610668182373047 (32g)
|
| 7 |
wikitext2 3.650667667388916 (16g)
|
|
|
|
| 1 |
I tried making groupsize 16 but that did not end well so I went with 32g. FYI I can run this with full context on my A6000.
|
| 2 |
|
| 3 |
```
|
| 4 |
+
65B (act-order true-sequential groupsize)
|
| 5 |
wikitext2 3.5319948196411133 (stock 16bit)
|
| 6 |
wikitext2 3.610668182373047 (32g)
|
| 7 |
wikitext2 3.650667667388916 (16g)
|