Commit Graph

23 Commits

Author SHA1 Message Date
Ben Xu 4e77a5792f remove duplicate fnc_ctx declaration 2024-12-09 14:19:13 -08:00
Ben Xu 8f6d5fdac7 remove assistant fnc 2024-12-09 14:16:04 -08:00
Ben Xu 178ffc83bd update logging with debug env variable 2024-12-09 13:37:36 -08:00
Ben Xu 07672f498b add voice assistant state communication and clear chat context 2024-12-09 13:37:19 -08:00
Ben Xu f6c13a13bd send multimodal message on startup of multimodal agent 2024-12-09 13:35:55 -08:00
ben 1720b783ce
LiveKit Pipeline Agent (#4)
* init processors

* fix image append for chat messages

* add pre tts cb

* stash non-functional worker changes

* add complete flag parsing worker

* stash worker changes

* update worker.py to handle message context correctly

* draft worker -- currently mismanages chat ctx

* stash draft delta changes

* working worker on push to talk happy path

* final working worker on push to talk

* refactor append image

* updated video frame processing

* rm text processor

* working draft main

* draft working poetry
2024-11-25 20:10:16 -08:00
killian befddaf205 Cartesia 2024-11-01 16:48:12 -07:00
killian a5b6948c9c Multimodal code execution 2024-10-23 19:32:19 -07:00
Ben Xu 21e04c18fe isolate instruction update 2024-10-02 17:52:31 -04:00
Ben Xu 35b1c5caa2 Revert "update instructions"
This reverts commit 9c145d0209.
2024-10-02 17:51:32 -04:00
Ben Xu 9c145d0209 update instructions 2024-10-02 17:42:19 -04:00
Ben Xu 121e67e896 Revert "process custom flags on worker"
This reverts commit 12efc95688.
2024-10-02 17:34:53 -04:00
Ben Xu 5810db4692 init livekit quickstart multimodal worker 2024-10-02 17:32:33 -04:00
Ben Xu 12efc95688 process custom flags on worker 2024-09-23 14:08:35 -04:00
killian 393d127540 Turn off debugging 2024-09-18 13:47:55 -07:00
killian b3ebbabcf1 Change tts and stt from profiles for app, set context mode to be True at the start 2024-09-18 13:46:47 -07:00
killian 81242d8568 Change tts and stt from profiles for app, set context mode to be True at the start 2024-09-18 13:15:00 -07:00
killian a0d1e7038b `01.1` 2024-09-09 12:02:03 -07:00
killian f4d9cd39e7 OpenAI TTS and worker retry logic 2024-09-04 23:52:11 -07:00
killian 927fba85a6 OpenAI TTS 2024-09-04 15:02:32 -07:00
killian bb53f9f81f Change worker to be a python file 2024-09-01 21:21:29 -07:00
killian 6fb71dde41 Docs changes, minor fixes 2024-08-31 15:04:42 -07:00
killian a7f381cb36 01.1 2024-08-25 17:51:22 -07:00