Commit Graph

867 Commits

Author SHA1 Message Date
Ben Xu f6c13a13bd send multimodal message on startup of multimodal agent 2024-12-09 13:35:55 -08:00
Ben Xu 2f53be05db update livekit server and profile docs 2024-12-09 13:34:44 -08:00
Ben Xu 37198d85f5 Merge branch 'main' of https://github.com/benxu3/01 2024-11-26 12:13:55 -08:00
Ben Xu 76f0847a98 fix dependency issues 2024-11-26 12:11:24 -08:00
Ben Xu de2a7cb129 add token in qr 2024-11-26 12:11:13 -08:00
ben 1720b783ce
LiveKit Pipeline Agent (#4)
* init processors

* fix image append for chat messages

* add pre tts cb

* stash non-functional worker changes

* add complete flag parsing worker

* stash worker changes

* update worker.py to handle message context correctly

* draft worker -- currently mismanages chat ctx

* stash draft delta changes

* working worker on push to talk happy path

* final working worker on push to talk

* refactor append image

* updated video frame processing

* rm text processor

* working draft main

* draft working poetry
2024-11-25 20:10:16 -08:00
killian befddaf205 Cartesia 2024-11-01 16:48:12 -07:00
killian a5b6948c9c Multimodal code execution 2024-10-23 19:32:19 -07:00
killian 521242c36d
Multimodal doc 2024-10-16 17:08:02 -07:00
killian 207ec088b4
Merge pull request #309 from benxu3/livekit-realtime
add realtime livekit multimodal worker
2024-10-02 15:53:22 -07:00
Ben Xu 21e04c18fe isolate instruction update 2024-10-02 17:52:31 -04:00
Ben Xu 35b1c5caa2 Revert "update instructions"
This reverts commit 9c145d0209.
2024-10-02 17:51:32 -04:00
Ben Xu 9c145d0209 update instructions 2024-10-02 17:42:19 -04:00
Ben Xu 121e67e896 Revert "process custom flags on worker"
This reverts commit 12efc95688.
2024-10-02 17:34:53 -04:00
Ben Xu 5810db4692 init livekit quickstart multimodal worker 2024-10-02 17:32:33 -04:00
killian 63cc2a2f01
Merge pull request #308 from benxu3/01-app
replace old rn app with 01-app
2024-09-23 12:02:16 -07:00
Ben Xu a8fd80d390 updated submodule to track main branch 2024-09-23 14:33:04 -04:00
Ben Xu 551e28a9d6 update 01-app submodule 2024-09-23 14:30:50 -04:00
Ben Xu 15ab78a3aa replace old rn app with 01-app 2024-09-23 14:12:24 -04:00
Ben Xu 12efc95688 process custom flags on worker 2024-09-23 14:08:35 -04:00
killian 197417a65b Default tts to elevenlabs 2024-09-18 13:51:28 -07:00
killian 393d127540 Turn off debugging 2024-09-18 13:47:55 -07:00
killian b3ebbabcf1 Change tts and stt from profiles for app, set context mode to be True at the start 2024-09-18 13:46:47 -07:00
killian 81242d8568 Change tts and stt from profiles for app, set context mode to be True at the start 2024-09-18 13:15:00 -07:00
killian 1bb2a725ed Docs update 2024-09-11 22:16:36 -07:00
killian da0e9f1718 Docs update 2024-09-11 22:11:05 -07:00
killian 5b7aa1a55f Docs update 2024-09-11 22:04:05 -07:00
killian f75afcdf6f Docs update 2024-09-11 21:58:42 -07:00
killian c78c458122 Docs update 2024-09-11 21:26:15 -07:00
killian df011c2d87 Docs update 2024-09-11 20:26:37 -07:00
killian 091ef585e5 Docs update 2024-09-11 20:24:32 -07:00
killian e1fd36c0bc Docs update 2024-09-11 20:22:16 -07:00
killian ec00cd0617 ESP32 docs fix 2024-09-09 16:39:47 -07:00
killian a0d1e7038b `01.1` 2024-09-09 12:02:03 -07:00
killian 888743c368
Merge pull request #301 from OpenInterpreter/manufacturing-report
Manufacturing report
2024-09-06 12:17:35 -07:00
killian 9f77cf99a3
Merge branch 'main' into manufacturing-report 2024-09-06 11:29:40 -07:00
killian 7c091b3e6c
Merge pull request #300 from OpenInterpreter/docs-edit
Docs edit
2024-09-06 09:30:00 -07:00
killian 4aec113c41 `01.1` (Later Tonight) 2024-09-05 12:57:06 -07:00
Mike Bird fad65dadc2 Add troubleshooting guide for app stuck on 'Starting...' screen and clarify external device connection requirements in FAQ. 2024-09-05 12:40:04 -04:00
Mike Bird 76b8dc8cc3 Update docs/software/installation.mdx to point to correct run instructions (/software/server/introduction) 2024-09-05 12:12:42 -04:00
Mike Bird 1468a92980 Enhance Livekit server documentation to include additional features, QR code generation command, and exposure options via ngrok. 2024-09-05 11:58:31 -04:00
Mike Bird c6e7be04a0 Modify server documentation to correct Livekit Server's URL for better navigation. 2024-09-05 11:51:24 -04:00
killian 1839cc6e74 Better default profile, better QR 2024-09-05 00:00:25 -07:00
killian a4aae849d0 Updated OI 2024-09-04 23:54:08 -07:00
killian f4d9cd39e7 OpenAI TTS and worker retry logic 2024-09-04 23:52:11 -07:00
killian 927fba85a6 OpenAI TTS 2024-09-04 15:02:32 -07:00
Mike Bird c718593142 duplicate privacy policy to ensure reference doesn't break 2024-09-04 15:55:56 -04:00
killian b4e8cfc6ab Meet URL 2024-09-04 09:38:39 -07:00
Mike Bird f9cf17a571 Update mobile download documentation to include iOS and Android sections. 2024-09-03 14:34:28 -04:00
Mike Bird 23568a966f Reorganize and add documentation for mobile apps, including a new community-built native iOS app and updated instructions for React Native apps. 2024-09-03 14:33:12 -04:00