qwerrwe / src

Commit History

Update doc for grad_accu and add validation tests for batch size
3c71c8d

Nanobit commited on

fix batch size calculation
5a631b3

winglian commited on

fix packing so that concatenated sequences reset the attention
9b8585d

winglian commited on

Merge pull request #124 from OpenAccess-AI-Collective/xformers-fix
2d0ba3b
unverified

winglian commited on

Merge pull request #120 from OpenAccess-AI-Collective/model-from-path
c7021e1
unverified

winglian commited on

don't worry about dupes
c56818b

winglian commited on

Update src/axolotl/monkeypatch/llama_attn_hijack_xformers.py
1076bcb
unverified

winglian Nanobit commited on

Update src/axolotl/monkeypatch/llama_attn_hijack_xformers.py
2daa683
unverified

winglian Nanobit commited on

remove unused import and update readme
e3c494c

winglian commited on

black formatting
ad0ea6a

winglian commited on

copy xformers attn from ooba since we removed dep on alpaca_lora_4bit
6cb2310

winglian commited on

add support for gradient accumulation steps
3aad5f3

winglian commited on

fix up tokenizer config, isort fix
39a208c

winglian commited on

split up llama model loading so config can be loaded from base config and models can be loaded from a path
2520ecd

winglian commited on

Fix incorrect rebase
594e72b

Nanobit commited on

Fix sharegpt prompt
25eeeeb

Nanobit commited on

fix relative path for fixtures
cfcc549

winglian commited on

Fix security issue or ignore false positives
a1f9850

Nanobit commited on

Update src/axolotl/prompt_strategies/alpaca_instruct.py
c17dae6

Nanobit winglian commited on

Apply isort then black
37293dc

Nanobit commited on

Fix mypy typing
e9650d3

Nanobit commited on

Fix unsupported operand type(s) for |
be22551

Nanobit commited on

Black formatting
b832a0a

Nanobit commited on

Refactor duplicate code between Prompter and Pygmalion
8e46c0f

Nanobit commited on

Lint wandb
9c6750a

Nanobit commited on

Lint validation
c2dbf2c

Nanobit commited on

Lint tokenization
e6b57de

Nanobit commited on

Lint schedulers
fe1f4c4

Nanobit commited on

Lint dict
633ff21

Nanobit commited on

Lint prompt_tokenizers
5d86137

Nanobit commited on

Lint pygmalion
01c8a33

Nanobit commited on

Lint creative_acr
1645a4d

Nanobit commited on

Lint alpaca_instruct
145b060

Nanobit commited on

Lint alpaca_chat
8cc0aad

Nanobit commited on

Lint datasets
6abb7f6

Nanobit commited on

Lint convert.py
de2406c

Nanobit commited on

Lint trainer.py
ddb86ea

Nanobit commited on

Lint models.py
f4e5d86

Nanobit commited on

Remove fixme disable
69722ae

Nanobit commited on

Remove disable too many arg
5658717

Nanobit commited on

Remove disable
e8717d3

Nanobit commited on

Lint callbacks.py
5062eca

Nanobit commited on

Lint prompters.py
cb4f0e9

Nanobit commited on

Refactor
4c0eddb

Nanobit commited on

Lint flash_attn.py
1c60c10

Nanobit commited on

Fix lint
903ea30

Nanobit commited on

Fix data.py lint
cb7cd34

Nanobit commited on

Lint and format
392dfd9

Nanobit commited on

fix relative path for fixtures
e65aeed

winglian commited on

refactor conversation plucking in sharegpt
21c8e2d

winglian commited on