oobabooga with Sugoi LLM 14B/32B

Download Required Files

1. Download Sugoi14B or Sugoi32B model files in GGUF format.
2. Download and install oobabooga from: https://github.com/oobabooga/text-generation-webui

Model Placement

1. Move the downloaded model files to oobabooga's model folder.
2. Suggested folder structure:

text-generation-webui
└── user_data
    └── models
        └── sugoi14b.gguf

Loading the Model

• After placing it in the models folder, sugoi model will appear in the list of available models within oobabooga.
• Select and load the model.

Running the Model

• Model will run locally on: http://localhost:5000
• Accessible via OpenAI-compatible APIs