Hugging Face's logo

h2oai
/
h2ogpt-oig-oasst1-falcon-40b

Text Generation
Transformers
PyTorch
English
RefinedWeb
gpt
llm
large language model
open-source
custom_code
text-generation-inference
Model card Files Community
arnocandel commited on
Commit
e5c47f9
•
1 Parent(s): f20866a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -59,7 +59,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
59
 
60
  tokenizer = AutoTokenizer.from_pretrained("h2oai/h2ogpt-oig-oasst1-falcon-40b", padding_side="left")
61
  model = AutoModelForCausalLM.from_pretrained("h2oai/h2ogpt-oig-oasst1-falcon-40b", torch_dtype=torch.bfloat16, device_map="auto")
62
- generate_text = H2OTextGenerationPipeline(model=model, tokenizer=tokenizer)
63
 
64
  res = generate_text("Why is drinking water so healthy?", max_new_tokens=100)
65
  print(res[0]["generated_text"])
 
59
 
60
  tokenizer = AutoTokenizer.from_pretrained("h2oai/h2ogpt-oig-oasst1-falcon-40b", padding_side="left")
61
  model = AutoModelForCausalLM.from_pretrained("h2oai/h2ogpt-oig-oasst1-falcon-40b", torch_dtype=torch.bfloat16, device_map="auto")
62
+ generate_text = H2OTextGenerationPipeline(model=model, tokenizer=tokenizer, prompt_type="human_bot")
63
 
64
  res = generate_text("Why is drinking water so healthy?", max_new_tokens=100)
65
  print(res[0]["generated_text"])