Verified Bot v2.4.0
Home Dashboard Support Add to Discord
Real-Time Duplex Audio

Voice Engine & WebRTC Portal

Yulya features a bi-directional, ultra-low latency voice architecture combining Discord's native Opus audio pipeline with an out-of-band WebRTC microphone portal and Google Gemini Live.

βš™οΈ Voice Architecture Overview

Standard Discord voice bots suffer from high latency and robotic speech pauses because they transcribe audio via Whisper, wait for an LLM text response, and generate speech via separate TTS. Yulya eliminates this delay through Native Multimodal Audio Streaming:

⚑
Real-Time Duplex

Users can naturally interrupt Yulya while she is speaking. The engine dynamically halts audio playback the instant user speech is detected.

🎧
Studio Opus Audio

Streams directly at 48kHz, 2-channel stereo using PyAV and Discord's native Opus encoder for crystal-clear clarity.

🌐
WebRTC Mic Portal

Enables zero-packet-loss audio input and browser-based screen sharing via our secure portal at /mic.

πŸ—£οΈ The 4 Voice Accents

Whenever you summon Yulya with /join or /join_pro, you can optionally specify an accent parameter:

Accent Choice Tone & Characteristics Best For
Achernar (Soft)
Default
Warm, gentle, natural cadence with comforting conversational warmth. Casual voice hangouts, study sessions, and one-on-one chats.
Autonoe (Bright) High-energy, crisp, upbeat delivery with clear pronunciation. Gaming lobbies, hype commentary, and active party channels.
Callirrhoe (Easy-going) Relaxed, laid-back timbre with effortless cadence. Late-night podcasts, chill discussions, and ambient background listening.
Sulafat (Warm) Deep, resonant, expressive and articulate tone. Storytelling, technical explanations, and serious debates.

πŸŽ™οΈ Voice & Studio Commands

Yulya provides distinct voice join modes and browser-integrated workspace tools depending on your hardware, network, and creative goals:

Command Model Vision Web Audio Description
/join Gemini 3 Flash Live βœ… 720p HD ❌ Discord audio mode + 720p HD Screen Share vision (1 FPS with smart frame diffing). Yulya joins your active voice channel, talks via Discord Opus, and watches your shared screen in real-time.
/join_pro Gemini 3.8 Live βœ… 720p HD ❌ [PRO] Gemini 3.8 Live flagship engine + Discord voice + 720p HD Screen Share visual commentary with ultra-low latency and smart frame diffing.
/studio Gemini 3.8 Live + Flash Cascade βœ… 720p HD βœ… Launches Yulya Studio in your browser. Build, preview, and play HTML5 Canvas games with conversational duplex audio and real-time screen share coding assistance.
/leave β€” β€” β€” Safely disconnects Yulya from voice, frees PyAV memory, and terminates live WebSocket connections.

🎀 WebRTC Microphone Portal & Screen Share (/mic)

When you execute any voice join command, Yulya generates a personalized, secure link for each participant:

Portal URL Pattern
https://discord.yulya.me/mic?token=<ephemeral-crypto-token>

Key Features of the Mic Portal:

  • Zero-Install Mobile & PC: Open the link in Chrome, Safari, or Edge on your phone or computer. Keep it open in the background while playing games.
  • High-Fidelity 16kHz PCM: Direct in-browser microphone capture without packet loss or jitter.
  • 15-Minute Ephemeral Security: Microphone tokens are signed with cryptographic salts and automatically expire 15 minutes after session termination.

Smart Screen Share Architecture (720p HD @ 1 FPS):

Screen sharing to AI has been re-engineered for ultra-low bandwidth consumption, zero lag, and instant responsiveness:

  • 720p HD at 1 FPS: Screens are captured and downsampled to 1280x720p at 1 frame per secondβ€”the ideal visual sweet spot for Gemini Live visual comprehension without saturating network buffers.
  • Client-Side Frame Diffing (Motion Detection): The browser compares consecutive frames using a fast Uint32Array pixel-stride analysis. If the screen has not changed (e.g., reading code or paused in a game), redundant frame uploads are completely skipped.
  • Raw Binary JPEG Blobs: Captured frames are transmitted directly as binary JPEG byte arrays over WebSockets instead of Base64 text strings, eliminating 33% encoding overhead and saving CPU.
  • 5-Second Safety Heartbeat: If the screen remains static for 5 seconds, an automatic refresh frame is sent so Gemini Live never loses awareness of your open windows.
  • Tab Visibility Awareness: Frame capture automatically suspends when your browser tab is minimized or hidden in the background.
Automatic Token-Protection Disconnect
If a Discord server administrator Server-Mutes or Server-Deafens Yulya in the voice channel, the engine will immediately execute an emergency disconnect. This safeguard prevents your server's Gemini Live tokens from being drained while the bot cannot be heard.