language model services skeleton
This commit is contained in:
parent
614e9623a5
commit
01bc8235c5
|
@ -3,7 +3,25 @@ title: "Language Model"
|
||||||
description: "The LLM that powers your 01"
|
description: "The LLM that powers your 01"
|
||||||
---
|
---
|
||||||
|
|
||||||
- Llamafile (Local)
|
## Llamafile
|
||||||
- Llamaedge (Local)
|
|
||||||
- Hosted Models (explains that we use litellm, you can pass in many different model flags to this)
|
Llamafile is cool!
|
||||||
- Add more (placeholder, we will add instructions soon)
|
|
||||||
|
## Llamaedge
|
||||||
|
|
||||||
|
Llamaedge is also cool!
|
||||||
|
|
||||||
|
## Hosted Models
|
||||||
|
|
||||||
|
01OS leverages liteLLM which supports [many hosted models](https://docs.litellm.ai/docs/providers/).
|
||||||
|
|
||||||
|
To select your providers
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Set the LLM service
|
||||||
|
poetry run 01 --llm-service openai
|
||||||
|
```
|
||||||
|
|
||||||
|
## Other Models
|
||||||
|
|
||||||
|
More instructions coming soon!
|
||||||
|
|
Loading…
Reference in New Issue