Spaces:

rasyosef
/

phi-2-chat

Running

rasyosef commited on Aug 11

Commit

276c17b

•

1 Parent(s): 8c7aab7

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -14,7 +14,7 @@ checkpoint = "rasyosef/phi-2-instruct-v0.1"
 tokenizer = AutoTokenizer.from_pretrained(checkpoint)
 model = AutoModelForCausalLM.from_pretrained(
     checkpoint,
-    torch_dtype=torch.float16,
     device_map=DEVICE
   )

 tokenizer = AutoTokenizer.from_pretrained(checkpoint)
 model = AutoModelForCausalLM.from_pretrained(
     checkpoint,
+    torch_dtype=torch.float32,
     device_map=DEVICE
   )