microsoft

/

Florence-2-large

like 1.1k

So I wanted to test just the Vision encoder on downstream tasks and downloaded the modelfile, than I notices I cant load the model in strict mode because "norms.weight", "norms.bias" are missing from the checkpoint. I am wondering if this is intentional, with 4048 parameters in total missing (beeing reset) I would guess this degrades the performance when using frozen weights for distilation, while they could be relearned when finetuning.