README.md

---
license: mit
base_model: openai-community/gpt2
---
# Null-GPT2

## Description

This is a GPT2 Model, but only with the architecture, no pre-trained weights, biases, attention, etc.

This is useful for researchers who want to play with training the model (not tuning).

Generated via the github repo [Model Architecture Generator](https://github.com/ivanhe123/Model-Architecture-Generator)

## Use
First go into the directory of the model,
```
git clone https://github.com/ivanhe123/Model-Architecture-Generator
```

```
python -m randomnize_params -in "./NullGPT2" -out path_model_out
```

path_model_out is just the output path of the newly randomnized model.