Model Details
Full Model IDQwen/Qwen2.5-7B-Instruct-AWQ
Pipeline / Tasktext-generation
Librarytransformers
Downloads (all-time)3.9M
Likes51
Last Modified10/9/2024
Author / OrgQwen
PrivateNo — public
⚡ Quick Usage (Python)
Using the 🤗 Transformers library. Install with pip install transformers
from transformers import pipeline
# Load the model
pipe = pipeline("text-generation", model="Qwen/Qwen2.5-7B-Instruct-AWQ")
# Run inference
result = pipe("Your input here")
print(result)🏷️ Tags
transformerssafetensorsqwen2text-generationchatconversationalenarxiv:2309.00071arxiv:2407.10671base_model:Qwen/Qwen2.5-7B-Instructbase_model:quantized:Qwen/Qwen2.5-7B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bitawqregion:us
More Text Generation Models
See all →🚀 Use This Model
Access model files, inference API, and full documentation on Hugging Face.
Open on Hugging Face →Browse Model Files ↗← Browse All Models✍️ Task: Text Generation
This model is designed for the Text Generation task. Explore more models for this use case.
All Text Generation Models →📊 Popularity
⬇ Downloads3.9M
❤️ Community Likes51
🛠️ Requirements
- →Install: pip install transformers
- →Python 3.8+ recommended for Transformers.
- →GPU (CUDA) speeds up inference significantly.
- →Use model.half() for fp16 on limited VRAM.