Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
Dovakiins
/
qwerrwe
like
0
Build error
App
Files
Files
Community
5fe30b1
qwerrwe
100 contributors
History:
868 commits
tmm1
use flash_attn xentropy when available (#525)
5fe30b1
unverified
about 1 year ago
.github
recast loralayer, norm, lmhead + embed token weights per original qlora (#393)
about 1 year ago
deepspeed
set zero3 optimizer betas to auto so they inherit from HF trainer config (#507)
about 1 year ago
docker
remove --force-reinstall from Dockerfile to ensure correct pytorch version (#492)
about 1 year ago
examples
pad_to_worst_case_seq_len boolean, for testing memory limits (#498)
about 1 year ago
image
Add files via upload
over 1 year ago
scripts
move is_llama_derived_model into normalize_config (#524)
about 1 year ago
src
use flash_attn xentropy when available (#525)
about 1 year ago
tests
fix test fixture b/c hf trainer tokenization changed (#464)
about 1 year ago
.bandit
38 Bytes
Add bandit
over 1 year ago
.editorconfig
186 Bytes
WIP for axolotl trainer
over 1 year ago
.flake8
88 Bytes
Update ignores
over 1 year ago
.gitattributes
49 Bytes
make it work with pythia in the cloud
over 1 year ago
.gitignore
3.11 kB
Lint and format
over 1 year ago
.isort.cfg
25 Bytes
Add isort
over 1 year ago
.mypy.ini
616 Bytes
black formatting
over 1 year ago
.pre-commit-config.yaml
896 Bytes
better py3 support w pre-commit
about 1 year ago
.pylintrc
603 Bytes
Ignore too-many-instance-attributes
over 1 year ago
FAQS.md
648 Bytes
Update FAQS.md
over 1 year ago
LICENSE
11.4 kB
add apache 2.0 license
about 1 year ago
README.md
24.3 kB
Fix(doc): Inform Windows users to use WSL/docker (#518)
about 1 year ago
TODO.md
262 Bytes
fdsp config dict fix, todo list, add torchdistx support
over 1 year ago
docker-compose.yaml
479 Bytes
added docker-compose file
over 1 year ago
requirements-dev.txt
22 Bytes
Add mypy
over 1 year ago
requirements-tests.txt
7 Bytes
use requirements file for tests
over 1 year ago
requirements.txt
500 Bytes
add eval benchmark callback (#441)
about 1 year ago
setup.py
1.23 kB
recast loralayer, norm, lmhead + embed token weights per original qlora (#393)
about 1 year ago
