Cerebras (LLM)

Cerebras (LLM)

Use Cerebras as the LLM (dialogue + reasoning) provider.

Setup

  • Set CEREBRAS_API_KEY
# .env
CEREBRAS_API_KEY=...

Example

from siphon.plugins import cerebras

llm = cerebras.LLM(
    model="llama3.1-70b",
)

Common options

  • model (default: llama3.1-8b)
  • api_key (default: None)
  • base_url (default: https://api.cerebras.ai/v1)
  • temperature (default: 0.3)
  • parallel_tool_calls (default: True)