FAQs
- Can you train StableLM with this? Yes, but only with a single GPU atm. Multi GPU support is coming soon! Just waiting on this PR
- Will this work with Deepspeed? That's still a WIP, but setting
export ACCELERATE_USE_DEEPSPEED=trueshould work in some cases