language model services skeleton
This commit is contained in:
parent
614e9623a5
commit
01bc8235c5
|
@ -3,7 +3,25 @@ title: "Language Model"
|
|||
description: "The LLM that powers your 01"
|
||||
---
|
||||
|
||||
- Llamafile (Local)
|
||||
- Llamaedge (Local)
|
||||
- Hosted Models (explains that we use litellm, you can pass in many different model flags to this)
|
||||
- Add more (placeholder, we will add instructions soon)
|
||||
## Llamafile
|
||||
|
||||
Llamafile is cool!
|
||||
|
||||
## Llamaedge
|
||||
|
||||
Llamaedge is also cool!
|
||||
|
||||
## Hosted Models
|
||||
|
||||
01OS leverages liteLLM which supports [many hosted models](https://docs.litellm.ai/docs/providers/).
|
||||
|
||||
To select your providers
|
||||
|
||||
```bash
|
||||
# Set the LLM service
|
||||
poetry run 01 --llm-service openai
|
||||
```
|
||||
|
||||
## Other Models
|
||||
|
||||
More instructions coming soon!
|
||||
|
|
Loading…
Reference in New Issue