# Create a new model from scratch

**URL:** <https://discuss.huggingface.co/t/create-a-new-model-from-scratch/48004>\
**Category:** Intermediate\
**Created:** [July 25, 2023, 5:12am UTC](https://discuss.huggingface.co/t/create-a-new-model-from-scratch/48004 "2023-07-25T05:12:01Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![JackBAI](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/jackbai/32/17827_2.png) [@JackBAI](https://discuss.huggingface.co/u/JackBAI)\
**Post date:** [July 25, 2023, 5:12am UTC](https://discuss.huggingface.co/t/create-a-new-model-from-scratch/48004/1 "2023-07-25T05:12:01Z")

</div>

I’m trying to create a new model based on RoBERTa. I created a new folder in `transformers/src/transformers/model`, modified the files from RoBERTa and put them inside the folder. However, it’s showing `OSError: <model> does not appear to have a file named config.json. Checkout 'https://huggingface.co/<model>/main' for available files`. How to resolve this issue?

I’m also wondering there are any practical guide to add a new model into transformers. [How to add a model to 🤗 Transformers?](https://huggingface.co/docs/transformers/add_new_model) makes it too complex and [Create a custom architecture](https://huggingface.co/docs/transformers/create_a_model) doesn’t provide good insights.

Looking forward to your help!
