Fireworks

The Fireworks model provides access to Fireworks’ language models.

Parameters

Parameter	Type	Default	Description
id	str	"accounts/fireworks/models/llama-v3p1-405b-instruct"	The id of the Fireworks model to use
name	str	"Fireworks"	The name of the model
provider	str	"Fireworks"	The provider of the model
api_key	Optional[str]	None	The API key for Fireworks (defaults to FIREWORKS_API_KEY env var)
base_url	str	"https://api.fireworks.ai/inference/v1"	The base URL for the Fireworks API
retries	int	0	Number of retries to attempt before raising a ModelProviderError
delay_between_retries	int	1	Delay between retries, in seconds
exponential_backoff	bool	False	If True, the delay between retries is doubled each time

Fireworks extends the OpenAI-compatible interface and supports most parameters from OpenAI.