Hugging Face GGUF model

We support Hugging Face GGUF models. You can create a new Hugging Face GGUF model by adding a model from Hugging Face Hub and downloading the GGUF file.

To create a new Hugging Face GGUF model, follow these steps:

• Go to Model page by clicking the “Model” button on the bottom left toolbar.
• Click the “New Model” button, and click the “New Hugging Face GGUF Model” button.
• Paste the Hugging Face model URL.
• Click “Create” button.