Qwen2.5-VL-7B-Instruct-GGUF
Note: All model files below must be downloaded via the LM Downloader client. If you do not have the client, Download >>>
Qwen2.5-VL-7B-Instruct is a vision-language model from the Qwen2.5-VL series developed by Alibaba, with 7 billion parameters. This model has excellent visual understanding capabilities. It can accurately recognize common objects and is proficient in analyzing texts, charts, and other content in images. It supports visual localization in multiple formats, capable of pinpointing objects by generating bounding boxes or points and outputting coordinates and attributes. It can also provide structured outputs for invoice and table data, making it suitable for financial and commercial fields. It has good multilingual support, understanding texts in various languages. With a context length of up to 128k tokens, it can generate long texts of up to 8k tokens. It has achieved remarkable results in multiple benchmark tests, such as scoring 58.6 in the MMMU test and 95.7 in the DocVQA test, demonstrating its strong visual understanding and processing abilities.
| Name | Size | Target Dir |
|---|---|---|
| Qwen2.5-VL-7B-Instruct-UD-IQ1_S.gguf | 2.07 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-IQ1_M.gguf | 2.20 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-IQ2_XXS.gguf | 2.40 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-IQ2_M.gguf | 2.86 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q2_K.gguf | 3.02 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q2_K_L.gguf | 3.14 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-IQ3_XXS.gguf | 3.17 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-Q2_K_XL.gguf | 3.24 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q3_K_S.gguf | 3.49 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q3_K_M.gguf | 3.81 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-Q3_K_XL.gguf | 4.00 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-IQ4_XS.gguf | 4.24 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-IQ4_NL.gguf | 4.44 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q4_0.gguf | 4.44 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q4_K_S.gguf | 4.46 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q4_K_M.gguf | 4.68 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-Q4_K_XL.gguf | 4.79 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q4_1.gguf | 4.87 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q5_K_S.gguf | 5.32 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q5_K_M.gguf | 5.44 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-Q5_K_XL.gguf | 5.46 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q6_K.gguf | 6.25 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-Q6_K_XL.gguf | 6.96 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-Q8_0.gguf | 8.10 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-UD-Q8_K_XL.gguf | 10.19 GB | text_encoders |
| Qwen2.5-VL-7B-Instruct-BF16.gguf | 15.24 GB | text_encoders |