gemma-4-e4b-it-8bit

Model Details

⚡ Quick Usage (Python)

Using the 🤗 Transformers library. Install with pip install transformers

from transformers import pipeline

# Load the model
pipe = pipeline("any-to-any", model="mlx-community/gemma-4-e4b-it-8bit")

# Run inference
result = pipe("Your input here")
print(result)

🏷️ Tags

🚀 Use This Model

Access model files, inference API, and full documentation on Hugging Face.

🤖 Task: any-to-any

This model is designed for the any-to-any task. Explore more models for this use case.

📊 Popularity

🛠️ Requirements

• →Install: pip install mlx
• →Python 3.8+ recommended for Transformers.
• →GPU (CUDA) speeds up inference significantly.
• →Use model.half() for fp16 on limited VRAM.

🔗 Quick Links