Overview
About this model
Llama-3.1-8B-Instruct is a large language model served on EcoHash for chat, reasoning, and text generation through an OpenAI-compatible API.
View model card on HuggingFaceSpecifications
Model details
- Provider
- Meta
- Modality
- Language
- Context length
- 131.1K tokens
- Max output
- 8.2K tokens
- Pricing
- $0.10 in · $0.10 out / 1M
Modalities: text → text
API
Call it in code
One OpenAI-compatible API. Swap the model id and you're done.
from openai import OpenAI
client = OpenAI(
base_url="https://api.ecohash.com/v1",
api_key="YOUR_API_KEY",
)
response = client.chat.completions.create(
model="llama-3.1-8b-instruct",
messages=[{"role": "user", "content": "Hello!"}],
stream=True,
)More models