trl-internal-testing/dummy-GPT2-correct-vocab
OpenAI
from transformers import AutoTokenizer, GPT2Config, GPT2LMHeadModel config = GPT2Config(n_positions=512, n_embd=32, n_layer=5, n_head=4, n_inner=37, pad_token_id=1023, is_decoder=True) model = GPT2LMHeadModel(config) tokenizer = AutoTokenizer.from_pretrained("openai-community/gpt2") model_id = "trl-internal-testing/dummy-GPT2-correct-vocab" model.push_to_hub(model_id) tokenizer.chat_template = "{% for message in messages %}{% if message['role'] == 'user' %}{{ ' ' }}{% endif %}{{ message['content'] }}{% if not loop.last %}{{ ' ' }}{% endif %}{% endfor %}{{ eos_token }}" tokenizer.push_to_hub(model_id) config.push_to_hub(model_id)
Parameters
2M
Modality
text->text
License
open_weights
Open source
Yes
Open trl-internal-testing/dummy-GPT2-correct-vocab in AIniverse
Compare versions, read real ratings, save to your stack.
Open in App