Resultado da Busca
Pygmalion AI. An open-source project dedicated to creating large language models for chat and role-play purposes.
- PygmalionAI Blog
PygmalionAI Blog. Updates and notes on our models, training,...
- PygmalionAI Blog
Open Source Conversational AI Research. PygmalionAI has 13 repositories available. Follow their code on GitHub.
PygmalionAI is a company that develops open-source models inspired from the Character.AI model for chat, role-play, adventure, and more. Learn about their history, vision, and contributors on their website.
So much for an unfiltered and uncensored AI chatbot site. Keep your money people.
- Model Description
- Training Data
- Training Procedure
- Intended Use
- Known Issues
Pymalion 6B is a proof-of-concept dialogue model based on EleutherAI's GPT-J-6B. Warning: This model is NOT suitable for use by minors. It willoutput X-rated content under certain circumstances.
The fine-tuning dataset consisted of 56MB of dialogue data gathered from multiple sources, which includes both real andpartially machine-generated conversations.
Model weights were initialized from the uft-6b ConvoGPT model made available in this commit. The model was then further fine-tuned on ~48.5 million tokens for ~5k steps on 4 NVIDIA A40s using DeepSpeed.
The easy way
We provide a notebook with a Gradio UI for playing around with the model without having to manually format inputs. This notebook can be found here.
The manual way
The model can be used as a regular text generation model, but it'll perform best if the input prompt adheres to the following format: Where [CHARACTER] is, as you can probably guess, the name of the character you want the model to portray, should be used verbatim as a delimiter token to separate persona and scenario data from the dialogue, and [DIALOGUE HISTORY]is chat history so the model can have some conversational context to draw from. Ideally it'll be pairs of messages like: Apar...
We haven't played around with the model enough to enumerate them. Feel free to give us some feedback!
PygmalionAI is a project to create large language models (LLMs) that can chat and role-play like humans. Learn more about the team, the models, and the HuggingFace link.
