qwerrwe / requirements.txt

Commit History

flash attn pip install (#426)
cf66547
unverified

mhenrichsen Ubuntu mhenrichsen Mads Henrichsen winglian commited on

remove extra accelearate in requirements (#430)
82e111a
unverified

winglian commited on

Attention mask and position id fixes for packing (#285)
2bb0b78
unverified

winglian commited on

Merge pull request #355 from tmm1/bitsandbytes-fixes
35c8b90
unverified

tmm1 commited on

bump to latest bitsandbytes release with major bug fixes
fce40aa

tmm1 commited on

use newer pynvml package
9c31410

tmm1 commited on

log GPU memory usage
e303d64

tmm1 commited on

pin accelerate so it works with llama2 (#330)
6c9a87c
unverified

winglian commited on

latest HEAD of accelerate causes 0 loss immediately w FSDP (#321)
9f69c4d
unverified

winglian commited on

add hf_transfer to requirements for faster hf upload
6dd2e7d

winglian commited on

Update requirements.txt
273b3a3
unverified

Teknium commited on

add support for opimum bettertransformers
1edc30c

winglian commited on

Add accelerate dep
36ec6e1

winglian commited on

Move black to dev requirements
1bf1f59

Nanobit commited on

Convert attrdict to addict
bdfe7c9

Nanobit commited on

update docker to compile latest bnb to properly support qlora
312b8d5

winglian commited on

Update requirements.txt
7e81ca7
unverified

winglian Nanobit commited on

integrate qlora? maybe?
3b4d055

winglian commited on

update entrypoint and force min accelerate
fa8bd14

winglian commited on

Fix BNB OOM by pinning version
fe582df
unverified

Nanobit commited on

docker layer caching, build w axolotl from base build
990bec6

winglian commited on

cleanup empty lines, tweak env for runpod setup
7753cde

winglian commited on

quickstart instructions for starting from runpod (#5)
0a472e1
unverified

winglian commited on

fix install to work with latest alpaca lora 4bit
4131183

winglian commited on

4bit quantized support (wip)
77fca25

winglian commited on

helpful info output
937f44f

winglian commited on

various bugfixes
80b2ed2

winglian commited on

config chooser, update readme instructions, device config, llama flash attention, debug out the labels, fix config key checks, other bugfixes
f2a2029

winglian commited on

WIP for axolotl trainer
ce24f5e

winglian commited on