Commit Graph

223 Commits

Author SHA1 Message Date
Ben Xu ab8055e0de draft main cli 2025-01-01 03:51:46 -05:00
Ben Xu f989731c08 move tts and stt to 9001 and 9002 2024-12-30 19:54:49 -05:00
Ben Xu 7207add614 run worker in dev mode 2024-12-30 15:57:44 -05:00
Ben Xu 3f6ba52a0e add meet flag and better error handling 2024-12-30 15:27:23 -05:00
Ben Xu f68f83c6ba update local and default profile 2024-12-30 15:26:36 -05:00
Ben Xu 4c271b19a7 remove separate transcriptions 2024-12-30 15:26:15 -05:00
Ben Xu 6110e70430 add local stt & tts, add anticipation logic, remove video context accumulation 2024-12-30 15:25:55 -05:00
Ben Xu bd6f530be7 replace hosted livekit meet with local meet link 2024-12-30 15:23:35 -05:00
Ben Xu 6084e2591a refactor logging outside logic 2024-12-30 15:17:40 -05:00
Ben Xu 095b704da4 add basic interrupt logic 2024-12-30 15:12:43 -05:00
Ben Xu 4e77a5792f remove duplicate fnc_ctx declaration 2024-12-09 14:19:13 -08:00
Ben Xu 8f6d5fdac7 remove assistant fnc 2024-12-09 14:16:04 -08:00
Ben Xu cedda9662e use participant token in meet_url 2024-12-09 14:12:56 -08:00
Ben Xu ba2813d716 upgrade interpreter and livekit agents 2024-12-09 13:38:37 -08:00
Ben Xu bba33db0c6 update server to use new interpreter 2024-12-09 13:38:15 -08:00
Ben Xu c2de04ab63 update profiles to be compatible with new interpreter 2024-12-09 13:37:50 -08:00
Ben Xu 178ffc83bd update logging with debug env variable 2024-12-09 13:37:36 -08:00
Ben Xu 07672f498b add voice assistant state communication and clear chat context 2024-12-09 13:37:19 -08:00
Ben Xu f6c13a13bd send multimodal message on startup of multimodal agent 2024-12-09 13:35:55 -08:00
Ben Xu 37198d85f5 Merge branch 'main' of https://github.com/benxu3/01 2024-11-26 12:13:55 -08:00
Ben Xu 76f0847a98 fix dependency issues 2024-11-26 12:11:24 -08:00
Ben Xu de2a7cb129 add token in qr 2024-11-26 12:11:13 -08:00
ben 1720b783ce
LiveKit Pipeline Agent (#4)
* init processors

* fix image append for chat messages

* add pre tts cb

* stash non-functional worker changes

* add complete flag parsing worker

* stash worker changes

* update worker.py to handle message context correctly

* draft worker -- currently mismanages chat ctx

* stash draft delta changes

* working worker on push to talk happy path

* final working worker on push to talk

* refactor append image

* updated video frame processing

* rm text processor

* working draft main

* draft working poetry
2024-11-25 20:10:16 -08:00
killian befddaf205 Cartesia 2024-11-01 16:48:12 -07:00
killian a5b6948c9c Multimodal code execution 2024-10-23 19:32:19 -07:00
killian 207ec088b4
Merge pull request #309 from benxu3/livekit-realtime
add realtime livekit multimodal worker
2024-10-02 15:53:22 -07:00
Ben Xu 21e04c18fe isolate instruction update 2024-10-02 17:52:31 -04:00
Ben Xu 35b1c5caa2 Revert "update instructions"
This reverts commit 9c145d0209.
2024-10-02 17:51:32 -04:00
Ben Xu 9c145d0209 update instructions 2024-10-02 17:42:19 -04:00
Ben Xu 121e67e896 Revert "process custom flags on worker"
This reverts commit 12efc95688.
2024-10-02 17:34:53 -04:00
Ben Xu 5810db4692 init livekit quickstart multimodal worker 2024-10-02 17:32:33 -04:00
Ben Xu 551e28a9d6 update 01-app submodule 2024-09-23 14:30:50 -04:00
Ben Xu 15ab78a3aa replace old rn app with 01-app 2024-09-23 14:12:24 -04:00
Ben Xu 12efc95688 process custom flags on worker 2024-09-23 14:08:35 -04:00
killian 197417a65b Default tts to elevenlabs 2024-09-18 13:51:28 -07:00
killian 393d127540 Turn off debugging 2024-09-18 13:47:55 -07:00
killian b3ebbabcf1 Change tts and stt from profiles for app, set context mode to be True at the start 2024-09-18 13:46:47 -07:00
killian 81242d8568 Change tts and stt from profiles for app, set context mode to be True at the start 2024-09-18 13:15:00 -07:00
killian a0d1e7038b `01.1` 2024-09-09 12:02:03 -07:00
killian 4aec113c41 `01.1` (Later Tonight) 2024-09-05 12:57:06 -07:00
killian 1839cc6e74 Better default profile, better QR 2024-09-05 00:00:25 -07:00
killian a4aae849d0 Updated OI 2024-09-04 23:54:08 -07:00
killian f4d9cd39e7 OpenAI TTS and worker retry logic 2024-09-04 23:52:11 -07:00
killian 927fba85a6 OpenAI TTS 2024-09-04 15:02:32 -07:00
killian b4e8cfc6ab Meet URL 2024-09-04 09:38:39 -07:00
killian bb53f9f81f Change worker to be a python file 2024-09-01 21:21:29 -07:00
killian 6fb71dde41 Docs changes, minor fixes 2024-08-31 15:04:42 -07:00
killian 51c8206c57 Fixing auth 2024-08-28 10:45:43 -07:00
killian 36f765c4d1 Bumped OI and fixed auth 2024-08-28 08:55:39 -07:00
killian c1c3c377e2 01.1 2024-08-25 17:51:43 -07:00