livekit

We are using LiveKit Rust SDK livekit-rust for our real-time communication needs. The idea is that we should have a separate folder named livekit in the src folder. That folder should contain the main logic for connecting to the livekit server and receiving the audio chunks from subscribed tracks.

Basically, user should be able to send the Websocket API message containing the livekit token to connect to the livekit server as a part of the websocket initial message. Then after we subscribe to the audio track, for the incoming audio chunks, we should send the received audio chunks to the Websocket audio callback. Similarly, how we process the audio chunks right now using websocket incoming audio chunks with a callback.

Basic LiveKit Example

This code below connects to the livekit server and subscribes to the audio tracks.

use livekit::prelude::*;

#[tokio::main]
async fn main() -> Result<()> {
    let (room, mut room_events) = Room::connect(&url, &token).await?;

    while let Some(event) = room_events.recv().await {
        match event {
            RoomEvent::TrackSubscribed { track, publication, participant } => {
                // ...
            }
            _ => {}
        }
    }

    Ok(())
}

This code below gets the audio chunks from the subscribed track.

...
use futures::StreamExt; // this trait is required for iterating on audio & video frames
use livekit::prelude::*;

match event {
    RoomEvent::TrackSubscribed { track, publication, participant } => {
        match track {
            RemoteTrack::Audio(audio_track) => {
                let rtc_track = audio_track.rtc_track();
                let mut audio_stream = NativeAudioStream::new(rtc_track);
                tokio::spawn(async move {
                    // Receive the audio frames in a new task
                    while let Some(audio_frame) = audio_stream.next().await {
                        log::info!("received audio frame - {audio_frame:#?}");
                    }
                });
            },
        }
    },
    _ => {}
}