qwerrwe / examples /falcon

Commit History

Add wandb_entity to wandb options, update example configs, update README (#361)
7019509
unverified

Morgan McGuire Morgan McGuire winglian commited on

config fixes
9a58e99

winglian commited on

Trim trailing whitespace
79a8f52
unverified

utensil commited on

Default `wandb_project` to empty as suggested
a52f481
unverified

utensil Nanobit commited on

Default micro_batch_size to 1 for a safer start
c9c0503
unverified

utensil commited on

Add comments/alternatives for falcon-qlora configs
ca11ae9
unverified

utensil commited on

falcon + qlora + xformer mbs 40 gas 2 on A6000
fb3d40f
unverified

utensil commited on

Create config-7b-qlora.yml
72bf8aa
unverified

utensil commited on

Lint and format
392dfd9

Nanobit commited on

sane starter defaults and add lora
157420d

winglian commited on

add example for falcoln support
d5f944c

winglian commited on