Commit History

Update doc for grad_accu and add validation tests for batch size
3c71c8d

Nanobit commited on

Merge pull request #134 from OpenAccess-AI-Collective/gas-batch-fix
a6f5e5e
unverified

winglian commited on

fix batch size calculation
5a631b3

winglian commited on

Merge pull request #130 from OpenAccess-AI-Collective/gas
f94dd62
unverified

winglian commited on

Merge pull request #131 from OpenAccess-AI-Collective/fix-packing-mask
5079753
unverified

winglian commited on

don't worry about duplicate code here
0136f51

winglian commited on

fix packing so that concatenated sequences reset the attention
9b8585d

winglian commited on

Merge pull request #129 from OpenAccess-AI-Collective/builder-badge
8eb5811
unverified

winglian commited on

Fix base builder, missing tags
e0011fd

winglian commited on

Merge pull request #127 from OpenAccess-AI-Collective/py310-docker-runpod
6e9e987
unverified

winglian commited on

swap batch size for gradient accumulation steps to decouple from num gpu
c2a0792

winglian commited on

add badge info to readme
b267d24

winglian commited on

Add files via upload
5c3f5db
unverified

winglian commited on

add py310 support from base image
e3d0374

winglian commited on

Merge pull request #119 from NanoCode012/feat/update-inference
fac4600
unverified

Nanobit commited on

Increase max_new_tokens
33d4017
unverified

Nanobit winglian commited on

Merge pull request #114 from OpenAccess-AI-Collective/accelerate-dep
dcb03d6
unverified

winglian commited on

Merge pull request #118 from NanoCode012/feat/torch-readme
0e4be62
unverified

Nanobit commited on

Update README.md
bdc4bd7
unverified

Nanobit commited on

Merge pull request #124 from OpenAccess-AI-Collective/xformers-fix
2d0ba3b
unverified

winglian commited on

Merge pull request #120 from OpenAccess-AI-Collective/model-from-path
c7021e1
unverified

winglian commited on

don't worry about dupes
c56818b

winglian commited on

update readme for SDP
2675fb7

winglian commited on

Update src/axolotl/monkeypatch/llama_attn_hijack_xformers.py
1076bcb
unverified

winglian Nanobit commited on

Update src/axolotl/monkeypatch/llama_attn_hijack_xformers.py
2daa683
unverified

winglian Nanobit commited on

remove unused import and update readme
e3c494c

winglian commited on

black formatting
ad0ea6a

winglian commited on

Merge pull request #123 from OpenAccess-AI-Collective/bas-batch
876edd8
unverified

winglian commited on

copy xformers attn from ooba since we removed dep on alpaca_lora_4bit
6cb2310

winglian commited on

black formatting
6fa40bf

winglian commited on

add support for gradient accumulation steps
3aad5f3

winglian commited on

fix up tokenizer config, isort fix
39a208c

winglian commited on

split up llama model loading so config can be loaded from base config and models can be loaded from a path
2520ecd

winglian commited on

define python version (3.10) explicitly as string in yaml
c5b0af1

winglian commited on

Feat: Swap to GenerationConfig
988aeb9

Nanobit commited on

FIx(readme): Fix torch missing from readme
cf61f14

Nanobit commited on

Merge pull request #115 from OpenAccess-AI-Collective/docker-version-fixes
0abcd71
unverified

winglian commited on

py310, fix cuda arg in deepspeed
c43c5c8

winglian commited on

Add accelerate dep
36ec6e1

winglian commited on

add release draft template for gh
13b8093

winglian commited on

Merge pull request #108 from OpenAccess-AI-Collective/docker-gptq
bbc5bc5
unverified

winglian commited on

Merge pull request #105 from viktoriussuwandi/viktoriussuwandi-patch
4df9da7
unverified

winglian commited on

Merge pull request #106 from fearnworks/qlora-openllama-3b-example
2531ea2
unverified

winglian commited on

Merge pull request #98 from NanoCode012/feat/pre-commit
01a75fd
unverified

winglian commited on

Fix pre-commit for rebased files
b81c97f

Nanobit commited on

Fix incorrect rebase
594e72b

Nanobit commited on

Fix sharegpt prompt
25eeeeb

Nanobit commited on

fix relative path for fixtures
cfcc549

winglian commited on

Fix security issue or ignore false positives
a1f9850

Nanobit commited on

Add bandit
83d2920

Nanobit commited on