Commit History

fixes for alpaca w chatml, and don't include attention_mask w mistral for flash attention (#728)
3553172
unverified

winglian commited on

Merge pull request #224 from OpenAccess-AI-Collective/system-prompt-data
f150c02
unverified

winglian commited on

push intermediate model checkpoints to hub
612aabd

winglian commited on

initial wip to get sys prompt from dataset
8d20e0a

winglian commited on

bugfix for potential off by one
7925ddc

winglian commited on

update alpaca_chat prompts for instructions to explainn the conversation
4b43a66

winglian commited on

fix camel ai, add guanaco/oasst mapping for sharegpt
59bb219

winglian commited on

new prompters, misc fixes for output dir missing using fsdp, and changing max seq len
4ac9e25

winglian commited on

Apply isort then black
37293dc

Nanobit commited on

Lint alpaca_chat
8cc0aad

Nanobit commited on

apply black formatting
ce34d64

winglian commited on

fix enum pass as value
fb100a9

winglian commited on

Add qa style data for alpaca instructions, fix one_cycle scheduler
3a50377

winglian commited on

tokenization fixes
4ea9a66

winglian commited on