Note: All model files below must be downloaded via the LM Downloader client. If you do not have the client, Download >>>
| Name | Size | Target Dir |
|---|---|---|
| Qwen3-8B-Q4_K_M.gguf | 5.03 GB | text_encoders |
| Qwen3-8B-Q5_0.gguf | 5.72 GB | text_encoders |
| Qwen3-8B-Q5_K_M.gguf | 5.85 GB | text_encoders |
| Qwen3-8B-Q6_K.gguf | 6.73 GB | text_encoders |
| Qwen3-8B-Q8_0.gguf | 8.71 GB | text_encoders |