qwerrwe / README.md

Commit History

Support device_map=sequential & max_memory config parameters (#903)
992e742
unverified

Bryan Thornbury winglian commited on

Feat(wandb): Refactor to be more flexible (#767)
a1da39c
unverified

Nanobit commited on

feature: loss watchdog for terminating training runs that are failing (#899)
58ec8b1
unverified

user735 Karl-Johan Alm commited on

Feat: Add Qwen (#894)
1115c50
unverified

Nanobit commited on

Feat: Add warmup_ratio (#893)
fb12895
unverified

Nanobit commited on

chore(doc): Add info on changing role in sharegpt (#886)
9fc29e0
unverified

Nanobit commited on

Install from git url (#874)
ddf8150
unverified

marksaroufim commited on

try #2: pin hf transformers and accelerate to latest release, don't reinstall pytorch (#867)
0de1457
unverified

winglian commited on

Feat: Add dataset loading from S3, GCS (#765)
3cc67d2
unverified

Nanobit commited on

allow overriding of model_config parameters from the YML (#853)
1bc1186
unverified

winglian commited on

make docker command more robust (#861)
8a8d1c4
unverified

winglian commited on

lint fix that didn't get caught by linter (#866)
332984d
unverified

winglian commited on

Docs: add instructions to 1-click launching on public clouds (#862)
b33c1d5
unverified

zongheng commited on

chore(doc): Separate section on runpod (#860)
501b4d1
unverified

Nanobit commited on

feat(doc): add more info on train_on_split (#855)
306fe19
unverified

Nanobit commited on

Feat: Added Gradio support (#812)
738a057
unverified

stillerman commited on

update table for rwkv4 support, fix process count for dataset (#822)
cdc71f7
unverified

winglian commited on

fix eval_steps to be a sane default (#797)
8b79ff0
unverified

winglian commited on

Add docker advanced instruction to README (#792)
2e71ff0
unverified

gordicaleksa commited on

Create preprocess CLI (#785)
e50ab07
unverified

casperhansen commited on

chore(readme): Improve documentation on conversation field (#782)
20aa4b5
unverified

Nanobit commited on

Fix: Cannot tokenize with bf16 and on cpu (#766)
afedc47
unverified

Nanobit commited on

add to docs (#703)
a21935f
unverified

winglian commited on

Clarify custom format example (#729)
e1b214c
unverified

casperhansen commited on

add noisy embedding (#721)
3bd9528
unverified

Maxime Maxime commited on

fix(doc): update default doc according to arg (#714)
5855dde
unverified

Nanobit commited on

fix(doc): Add note on inference w sample packing (#712)
11c48c5
unverified

Nanobit commited on

Update README with some explanations (#700)
77c84e0
unverified

seungduk commited on

refactor to set eval_batch_size earlier if unset, so we can warn if mismatched (#662)
2642cae
unverified

winglian commited on

Make dataset_processes configurable (#651)
9ec2077
unverified

corbt commited on

Fix bug when using pretokenized datasets (#652)
590d603
unverified

ich commited on

add support for defined train split (#654)
409ca0f
unverified

winglian commited on

Feat: Add example for Mistral (#644)
eb41f76
unverified

Nanobit commited on

Warn users to login to HuggingFace (#645)
85b0be2
unverified

Napuh commited on

skip some flash attn patches unless explicitly enabled (#643)
895f0a0
unverified

winglian commited on

use fastchat conversations template (#578)
e7d3e2d
unverified

winglian commited on

Feat: Add support for upstream FA2 (#626)
19a600a
unverified

Nanobit commited on

Added quotes to the pip install -e command to fix an incompatibility with shells that do glob expansion like zsh (#632)
5e5296a
unverified

Fernando Tarin Morales commited on

Feat(doc): Add eval_sample_packing to doc (#625)
67b9888
unverified

Nanobit commited on

update README w deepspeed info (#605)
c25ba79
unverified

winglian commited on

Feat(data): Allow loading local csv and text (#594)
00dce35
unverified

Nanobit commited on

Feat(doc): Add features to doc (#583)
3a2edc8
unverified

Nanobit commited on

support custom field for completion from yml (#580)
f7a2263
unverified

winglian commited on

update support matrix with btlm and phi (#579)
a5a625f
unverified

winglian commited on

refactor scripts/finetune.py into new cli modules (#550)
861ceca
unverified

winglian Nanobit commited on

let hf trainer handle torch compile (#516)
a4e1bb6
unverified

winglian tmm1 commited on

Add training callback to send predictions to WandB table (#521)
5b67ea9
unverified

Glavin001 commited on

document that packaging needs to be installed before flash-attn (#559)
9845c5e
unverified

winglian commited on

ergonomic update to optimizer config doc (#548)
6d57f2f
unverified

The Objective Dad commited on