Hugging Face's logo

Spaces:
Dovakiins
/
qwerrwe
Build error

App Files Community
qwerrwe / scripts /finetune.py

Commit History

Merge pull request #92 from OpenAccess-AI-Collective/flash-optimum
16bb627
unverified

winglian commited on

chore: Refactor inf_kwargs out
dc77c8e

Nanobit commited on

Merge branch 'main' into flash-optimum
fd2c981
unverified

winglian commited on

Merge pull request #177 from NanoCode012/fix/landmark-patch
8002ffb
unverified

winglian commited on

Merge pull request #159 from AngainorDev/patch-1
8e568bb
unverified

Nanobit commited on

Fix strict and Lint
b565ecf

Angainor commited on

Fix set mem_id for inference and refactor
974dc00

Nanobit commited on

Set mem cache args on inference
572d114

Nanobit commited on

fix formatting
958da70

winglian commited on

pass a prompt in from stdin for inference
c4e4f81

winglian commited on

Update scripts/finetune.py
759e867
unverified

winglian Nanobit commited on

address PR feedback
0c6f928

winglian commited on

add streaming dataset support for pretraining datasets
eea2731

winglian commited on

more tweaks to do pre-training with bettertransformers
1210dc8

winglian commited on

experimental expansion of ctx len
488a67d

winglian commited on

add flash attn context for efficient training and attempt setting model to train mode:
8792199

winglian commited on

add support for opimum bettertransformers
1edc30c

winglian commited on

Merge branch 'main' into patch-1
79e2a6f
unverified

Angainor Development commited on

Remove explicit definition of cfg.inference
c250898
unverified

Angainor Development commited on

formatting for linter
f36e227
unverified

winglian commited on

Add streaming inference & fix stopping at EOS
fec6bcc

Glavin001 commited on

Feed cfg.inference
bd3b537
unverified

Angainor Development commited on

Set matmul tf32
52765ac

Nanobit commited on

new prompters, misc fixes for output dir missing using fsdp, and changing max seq len
4ac9e25

winglian commited on

fix device map
74ebbf4

winglian commited on

fix batch size calculation
5a631b3

winglian commited on

Merge pull request #119 from NanoCode012/feat/update-inference
fac4600
unverified

Nanobit commited on

Increase max_new_tokens
33d4017
unverified

Nanobit winglian commited on

Merge pull request #120 from OpenAccess-AI-Collective/model-from-path
c7021e1
unverified

winglian commited on

black formatting
6fa40bf

winglian commited on

add support for gradient accumulation steps
3aad5f3

winglian commited on

fix up tokenizer config, isort fix
39a208c

winglian commited on

Feat: Swap to GenerationConfig
988aeb9

Nanobit commited on

Fix security issue or ignore false positives
a1f9850

Nanobit commited on

Apply isort then black
37293dc

Nanobit commited on

Lint finetune.py
82971e1

Nanobit commited on

Lint and format
392dfd9

Nanobit commited on

bnb fixes
21f17cc

winglian commited on

refactor: fix previous refactors
56f9ca5

Nanobit commited on

Refactor to use DictDefault instead
8bd7a49

Nanobit commited on

Fix load error
93acb64

Nanobit commited on

Convert attrdict to addict
bdfe7c9

Nanobit commited on

move list not in list logic to fn
cc67862

winglian commited on

load the tokenizer seperately from the model
32e6fe9

winglian commited on

add logging and make sure model unloads to float16
a5bf838

winglian commited on

remove un-needed code, add validation
1f5d83e

winglian commited on

Update scripts/finetune.py
3457810
unverified

winglian Nanobit commited on

Update scripts/finetune.py for logging
ae1719d
unverified

winglian Nanobit commited on

optionally be able to specify alpaca or chat style prompts
1d5ab84

winglian commited on

add alpaca multiple choice instruct dataset support
b46bc02

winglian commited on