Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,16 @@ tags:
|
|
| 11 |
- 4bit
|
| 12 |
base_model: THUDM/glm-4v-9b
|
| 13 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
## Usage
|
| 15 |
This model is quantized using [AutoGPTQ](https://github.com/AutoGPTQ/AutoGPTQ) for [THUDM/glm-4v-9b](https://huggingface.co/THUDM/glm-4v-9b).
|
| 16 |
|
|
@@ -178,25 +188,3 @@ for example in dataset['single']:
|
|
| 178 |
|
| 179 |
# break
|
| 180 |
```
|
| 181 |
-
|
| 182 |
-
### metrics
|
| 183 |
-
(to be released later)
|
| 184 |
-
|
| 185 |
-
|
| 186 |
-
|
| 187 |
-
| | **MMBench-EN-Test** | **MMBench-CN-Test** | **SEEDBench_IMG** |
|
| 188 |
-
|-------------------------|---------------------|---------------------|-------------------|
|
| 189 |
-
| | 英文综合 | 中文综合 | 综合能力 |
|
| 190 |
-
| **GPT-4o, 20240513** | 83.4 | 82.1 | 77.1 |
|
| 191 |
-
| **GPT-4v, 20240409** | 81 | 80.2 | 73 |
|
| 192 |
-
| **GPT-4v, 20231106** | 77 | 74.4 | 72.3 |
|
| 193 |
-
| **InternVL-Chat-V1.5** | 82.3 | 80.7 | 75.2 |
|
| 194 |
-
| **LlaVA-Next-Yi-34B** | 81.1 | 79 | 75.7 |
|
| 195 |
-
| **Step-1V** | 80.7 | 79.9 | 70.3 |
|
| 196 |
-
| **MiniCPM-Llama3-V2.5** | 77.6 | 73.8 | 72.3 |
|
| 197 |
-
| **Qwen-VL-Max** | 77.6 | 75.7 | 72.7 |
|
| 198 |
-
| **GeminiProVision** | 73.6 | 74.3 | 70.7 |
|
| 199 |
-
| **Claude-3V Opus** | 63.3 | 59.2 | 64 |
|
| 200 |
-
| **GLM-4v-9B** | 81.1 | 79.4 | 76.8 |
|
| 201 |
-
| **GLM-4v-9B-gptq-4bit** | 81.1 | 80.94 | 76.4 |
|
| 202 |
-
|
|
|
|
| 11 |
- 4bit
|
| 12 |
base_model: THUDM/glm-4v-9b
|
| 13 |
---
|
| 14 |
+
|
| 15 |
+
### metrics
|
| 16 |
+
|
| 17 |
+
| | **MMBench-EN-Test** | **MMBench-CN-Test** | **SEEDBench_IMG** |
|
| 18 |
+
|-------------------------|---------------------|---------------------|-------------------|
|
| 19 |
+
| | 英文综合 | 中文综合 | 综合能力 |
|
| 20 |
+
| **GLM-4v-9B** | 81.9 | 81.9 | - |
|
| 21 |
+
| **GLM-4v-9B-gptq-4bit** | 81.1 | 80.94 | 76.4 |
|
| 22 |
+
|
| 23 |
+
|
| 24 |
## Usage
|
| 25 |
This model is quantized using [AutoGPTQ](https://github.com/AutoGPTQ/AutoGPTQ) for [THUDM/glm-4v-9b](https://huggingface.co/THUDM/glm-4v-9b).
|
| 26 |
|
|
|
|
| 188 |
|
| 189 |
# break
|
| 190 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|