UCLA-AGI

/

Gemma-2-9B-It-SPPO-Iter3

like 110

@christopherthompson81 We are experiencing some generation issues with Gemma-2-27B-It and vllm. We saw similar issues reported in this discussion: https://huggingface.co/google/gemma-2-27b-it/discussions/10

We are planning to do 27B as soon as a stable release of transformers and vllm generation on Gemma-2-27B-It is available.

Hey there,

Any word on the 27B? The 9B is absolutely phenomenal, I can't wait to see what you do with 27 :)

@christopherthompson81 We are experiencing some generation issues with Gemma-2-27B-It and vllm. We saw similar issues reported in this discussion: https://huggingface.co/google/gemma-2-27b-it/discussions/10

We are planning to do 27B as soon as a stable release of transformers and vllm generation on Gemma-2-27B-It is available.

Any updates? I love the sppo model for Gemma 2 9b, been waiting for any decent 27b finetunes to take the spot as my favorite model

@christopherthompson81 We are experiencing some generation issues with Gemma-2-27B-It and vllm. We saw similar issues reported in this discussion: https://huggingface.co/google/gemma-2-27b-it/discussions/10

We are planning to do 27B as soon as a stable release of transformers and vllm generation on Gemma-2-27B-It is available.

Hi! gemma27B is already working well on vllm with a 4k context length, and sglang supports 8k. Should we wait for the SPPO 27B version?