Together (LLM)

Use Together as the LLM (dialogue + reasoning) provider.

Setup

• Set TOGETHER_API_KEY

# .env
TOGETHER_API_KEY=...

Example

from siphon.plugins import together

llm = together.LLM(
    model="meta-llama/Llama-3.1-70B-Instruct-Turbo",
)

Common options

• model (default: meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo)
• base_url (default: https://api.together.xyz/v1)
• api_key (default: None)
• temperature (default: 0.3)
• parallel_tool_calls (default: True)