qwerrwe / examples

Commit History

Merge pull request #132 from utensil/falcon-7b-qlora
c8242de
unverified

Nanobit commited on

Trim trailing whitespace
79a8f52
unverified

utensil commited on

Default `wandb_project` to empty as suggested
a52f481
unverified

utensil Nanobit commited on

Default micro_batch_size to 1 for a safer start
c9c0503
unverified

utensil commited on

Add comments/alternatives for falcon-qlora configs
ca11ae9
unverified

utensil commited on

falcon + qlora + xformer mbs 40 gas 2 on A6000
fb3d40f
unverified

utensil commited on

Create config-7b-qlora.yml
72bf8aa
unverified

utensil commited on

swap batch size for gradient accumulation steps to decouple from num gpu
c2a0792

winglian commited on

Merge pull request #105 from viktoriussuwandi/viktoriussuwandi-patch
4df9da7
unverified

winglian commited on

Merge pull request #106 from fearnworks/qlora-openllama-3b-example
2531ea2
unverified

winglian commited on

Lint and format
392dfd9

Nanobit commited on

Update examples/qlora-openllama-3b/README.md
6cee881
unverified

jphillips winglian commited on

Add Readme, Clean up comments
ac85c0e

jpfearnworks commited on

Add qlora-openllama-3b example
370d057

jpfearnworks commited on

Update wandb_log_model on config.yml
15e57ba
unverified

Viktorius Suwandi commited on

Update wandb_log_model on config-3b.yml
4eb68ac
unverified

Viktorius Suwandi commited on

Update wandb_log_model on config.yml
fad06be
unverified

Viktorius Suwandi commited on

Merge branch 'main' into refactor/rename-4b-to-gptq
147241c
unverified

winglian commited on

sane starter defaults and add lora
157420d

winglian commited on

add example for falcoln support
d5f944c

winglian commited on

refactor(example): rename 4bit-lora-7b by gptq-lora-7b
7cf07fc

Thytu commited on

refactor(param): rename load_4bit config param by gptq
dd00657

Thytu commited on

Disable formers for QuickStart config
7956093
unverified

Nanobit commited on

pr comments addressed
98b1bce

winglian commited on

fix tokenizer loading, got openllama 3b working
e396654

winglian commited on

fixes w/ example for super basic lora starter
a5d739b

winglian commited on

support for replit lm
8c2f3cb

winglian commited on

fix config for parity with previous change
165da58

winglian commited on

not everyone has bf16 available
df9c508

winglian commited on

add 4bit lora 7b
7967cd1

winglian commited on

push up redpajama 3b example
02c5983

winglian commited on

add support for trust_remote_code for mpt models
a125693

winglian commited on