Voice Engine & WebRTC Portal
Yulya features a bi-directional, ultra-low latency voice architecture combining Discord's native Opus audio pipeline with an out-of-band WebRTC microphone portal and Google Gemini Live.
βοΈ Voice Architecture Overview
Standard Discord voice bots suffer from high latency and robotic speech pauses because they transcribe audio via Whisper, wait for an LLM text response, and generate speech via separate TTS. Yulya eliminates this delay through Native Multimodal Audio Streaming:
Users can naturally interrupt Yulya while she is speaking. The engine dynamically halts audio playback the instant user speech is detected.
Streams directly at 48kHz, 2-channel stereo using PyAV and Discord's native Opus encoder for crystal-clear clarity.
Enables zero-packet-loss audio input and browser-based screen sharing via our secure portal at /mic.
π£οΈ The 4 Voice Accents
Whenever you summon Yulya with /join or /join_pro,
you can optionally specify an accent parameter:
| Accent Choice | Tone & Characteristics | Best For |
|---|---|---|
| Achernar (Soft) Default |
Warm, gentle, natural cadence with comforting conversational warmth. | Casual voice hangouts, study sessions, and one-on-one chats. |
| Autonoe (Bright) | High-energy, crisp, upbeat delivery with clear pronunciation. | Gaming lobbies, hype commentary, and active party channels. |
| Callirrhoe (Easy-going) | Relaxed, laid-back timbre with effortless cadence. | Late-night podcasts, chill discussions, and ambient background listening. |
| Sulafat (Warm) | Deep, resonant, expressive and articulate tone. | Storytelling, technical explanations, and serious debates. |
ποΈ Voice & Studio Commands
Yulya provides distinct voice join modes and browser-integrated workspace tools depending on your hardware, network, and creative goals:
| Command | Model | Vision | Web Audio | Description |
|---|---|---|---|---|
/join |
Gemini 3 Flash Live | β 720p HD | β | Discord audio mode + 720p HD Screen Share vision (1 FPS with smart frame diffing). Yulya joins your active voice channel, talks via Discord Opus, and watches your shared screen in real-time. |
/join_pro |
Gemini 3.8 Live | β 720p HD | β | [PRO] Gemini 3.8 Live flagship engine + Discord voice + 720p HD Screen Share visual commentary with ultra-low latency and smart frame diffing. |
/studio |
Gemini 3.8 Live + Flash Cascade | β 720p HD | β | Launches Yulya Studio in your browser. Build, preview, and play HTML5 Canvas games with conversational duplex audio and real-time screen share coding assistance. |
/leave |
β | β | β | Safely disconnects Yulya from voice, frees PyAV memory, and terminates live WebSocket connections. |
π€ WebRTC Microphone Portal & Screen Share (/mic)
When you execute any voice join command, Yulya generates a personalized, secure link for each participant:
https://discord.yulya.me/mic?token=<ephemeral-crypto-token>
Key Features of the Mic Portal:
- Zero-Install Mobile & PC: Open the link in Chrome, Safari, or Edge on your phone or computer. Keep it open in the background while playing games.
- High-Fidelity 16kHz PCM: Direct in-browser microphone capture without packet loss or jitter.
- 15-Minute Ephemeral Security: Microphone tokens are signed with cryptographic salts and automatically expire 15 minutes after session termination.
Smart Screen Share Architecture (720p HD @ 1 FPS):
Screen sharing to AI has been re-engineered for ultra-low bandwidth consumption, zero lag, and instant responsiveness:
- 720p HD at 1 FPS: Screens are captured and downsampled to 1280x720p at 1 frame per secondβthe ideal visual sweet spot for Gemini Live visual comprehension without saturating network buffers.
- Client-Side Frame Diffing (Motion Detection): The browser compares consecutive frames using a fast
Uint32Arraypixel-stride analysis. If the screen has not changed (e.g., reading code or paused in a game), redundant frame uploads are completely skipped. - Raw Binary JPEG Blobs: Captured frames are transmitted directly as binary JPEG byte arrays over WebSockets instead of Base64 text strings, eliminating 33% encoding overhead and saving CPU.
- 5-Second Safety Heartbeat: If the screen remains static for 5 seconds, an automatic refresh frame is sent so Gemini Live never loses awareness of your open windows.
- Tab Visibility Awareness: Frame capture automatically suspends when your browser tab is minimized or hidden in the background.