Eagle 3D Streaming

2. Consuming Microphone Data inside the Unreal app

Owned by Arslan Ali (Unlicensed)
Last updated: Sept 23, 2024 by Khaoula Bouhlali
3 min read

How Microphone data are consumed in your Unreal app.

UE Instructions

In your Unreal Engine project, complete the following steps:

1. Enable the Pixel Streaming Plugin

Refer to this document to enable the Pixel Streaming Plugin in your UE Project.

 

Note: ‘Pixel Streaming Audio’ is needed to transfer the Audio Input from the Browser side to the Pixel Streaming Application.
https://github.com/EpicGames/PixelStreamingInfrastructure/blob/master/Frontend/Docs/Using%20the%20Microphone%20Feature.md
https://docs.unrealengine.com/5.0/en-US/BlueprintAPI/PixelStreamingAudioComponent/

C++
https://docs.unrealengine.com/5.0/en-US/PythonAPI/class/PixelStreamingAudioComponent.html

https://docs.unrealengine.com/5.3/en-US/experimental-pixel-streaming-features/

 

2. Add the 'Pixel Streaming Audio' component to the Blueprint responsible for handling audio input

Image 1. Add Pixel Streaming Audio

 

Note: PixelStreamingAudio is needed to transfer the Audio Input from the Browser side to the Pixel Streaming Application. It is by default automatically activated when the actor is added to the game.

Enabling the UE app to listen to Mic Input

It is a simple setup which involves implementing a small Blueprint script in the project. To enable the application to listen to microphone input, several steps should be completed:

  1. Enable the Pixel Streaming Plugin.

  2. Go to player controller or character blueprint.

  3. On Begin Play node, add get pixel streaming delegates node.

  4. From its return value, get the bind event on new connection node.

Image 2. It can return streamer ID and Player ID

  1. Make a new Blueprint actor and add a Pixel Streaming Audio Component to it.

  2. Create a Listen To node.

  3. Grab that Audio Component and connect it to the new ‘Listen To’ node.

  1. Create a custom event.

  2. Make the ‘Player to Listen to’ an Input of that custom event.

 

  1. Return to the main Player Controller or Character Blueprint where you bound the event on new connection in Step 4.

  2. On the Event On New Connection, use the Spawn Actor from Class node.

  3. Select the newly created actor in the Class input.

  4. After spawning, call the Custom Event that was previously created.

 

  1. Package your app. Refer to this document.

  2. Upload your app in the Old Control Panel. Refer to this document.

  3. Play your app. When the app starts, the Audio Broadcasting will work.

 

Now you know how to get your pixel streaming Audio input!

Troubleshooting your App while testing for Microphone

If you can’t hear any output from the app:

  1. Please verify that you are using the correct Microphone in your system settings.

  2. Make sure your Browser has Microphone access. (Refer to this document to allow access).

Need help? Contact Support

Submit a new request at E3DS support portal.

Requests sent on weekends will not be addressed until the following business day.

Eagle 3D Streaming