Initial

README.md

@@ -1,3 +1,50 @@
 ---
 license: mit
 ---
+This is a llama-13B based model that has been converted with GPTQ to 4bit quantized model.
+
+Base Model: GPT4-x-Alpaca full fine tune by Chavinlo -> https://huggingface.co/chavinlo/gpt4-x-alpaca  
+LORA fine tune using the Roleplay Instruct from GPT4 generated dataset -> https://github.com/teknium1/GPTeacher/tree/main/Roleplay  
+LORA Adapter Only: https://huggingface.co/ZeusLabs/gpt4-x-alpaca-rp-lora - The v2 one -
+
+Merged LORA to the model. 
+
+FYI Latest HF Transformers generates BROKEN generations. 
+Try this instead if your generations are terrible (first uninstall transformers): pip install git+https://github.com/huggingface/transformers@9eae4aa57650c1dbe1becd4e0979f6ad1e572ac0
+More info and possible alternative solutions in these github issues.  
+https://github.com/tloen/alpaca-lora/issues/279#issuecomment-1514725886  
+https://github.com/oobabooga/text-generation-webui/issues/931#issuecomment-1516215250  
+
+Instructions simply using alpaca format are likely to be of lower quality. If you want pure general instruct capability I reccomend GPT-4-X-Alpaca (the base model of this) - 
+The model responds well to giving it a roleplay task in the preprompt, and the actual conversation in the "### Input: " field.
+
+For a better idea of prompting it for roleplay, check out the roleplay discord bot code I made here: https://github.com/teknium1/alpaca-roleplay-discordbot
+Here is an example:
+```
+### Instruction:
+Role play as character that is described in the following lines. You always stay in character.
+{"Your name is " + name + "." if name else ""}
+{"Your backstory and history are: " + background if background else ""}
+{"Your personality is: " + personality if personality else ""}
+{"Your current circumstances and situation are: " + circumstances if circumstances else ""}
+{"Your common greetings are: " + common_greeting if common_greeting else ""}
+Remember, you always stay on character. You are the character described above.
+{past_dialogue_formatted}
+{chat_history if chat_history else "Chatbot: Hello!"}
+
+Always speak with new and unique messages that haven't been said in the chat history.
+
+Respond to this message as your character would:
+### Input:
+{text}
+### Response:
+{name}:
+
+```
+
+---
+tags:
+- llama
+- alpaca
+- gpt4
+---