language model services skeleton

This commit is contained in:
Mike Bird 2024-03-13 12:49:29 -04:00
parent 614e9623a5
commit 01bc8235c5
1 changed files with 22 additions and 4 deletions

View File

@ -3,7 +3,25 @@ title: "Language Model"
description: "The LLM that powers your 01"
---
- Llamafile (Local)
- Llamaedge (Local)
- Hosted Models (explains that we use litellm, you can pass in many different model flags to this)
- Add more (placeholder, we will add instructions soon)
## Llamafile
Llamafile is cool!
## Llamaedge
Llamaedge is also cool!
## Hosted Models
01OS leverages liteLLM which supports [many hosted models](https://docs.litellm.ai/docs/providers/).
To select your providers
```bash
# Set the LLM service
poetry run 01 --llm-service openai
```
## Other Models
More instructions coming soon!