tuanio commited on
Commit
9d0fbd2
β€’
1 Parent(s): 28a8a91

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -6,6 +6,21 @@ language:
6
  - vi
7
  ---
8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  - Training script:
10
  ```bash
11
  moe_mode="sparse"
 
6
  - vi
7
  ---
8
 
9
+ - Deploying Gradio: Going to MoE-LLaVA serving tutorial and follow, or quickly, can use πŸ‘‡πŸ‘‡πŸ‘‡
10
+ ```bash
11
+ deepspeed --include localhost:0 moellava/serve/gradio_web_server.py \
12
+ --model-path="tuanio/moe-llava-qwen1.5-0.5b-vista_reason_conv-1ep"
13
+ ```
14
+
15
+ Or CLI:
16
+ ```bash
17
+ deepspeed --include localhost:0 moellava/serve/cli.py \
18
+ --model-path "tuanio/moe-llava-qwen1.5-0.5b-vista_reason_conv-1ep" \
19
+ --image-file "data/llm_data/coco2017/train2017/000000391895.jpg"
20
+ ```
21
+
22
+ ---
23
+
24
  - Training script:
25
  ```bash
26
  moe_mode="sparse"