How to handle microphone in E3DS System:( Part2-Consuming micrpohone data inside Unreal app)

Unreal Instructions:
In order to get microphone input to your pixel streaming application from the E3DS system, there are a few things that need to be done.

In your Unreal Project, Enable the following things:

1. Enable the PixelStreaming Plugin.

PixelStreamingAudio is needed to transfer the Audio Input from the Browser side to the Pixel Streaming Application.

https://github.com/EpicGames/PixelStreamingInfrastructure/blob/master/Frontend/Docs/Using%20the%20Microphone%20Feature.md

https://docs.unrealengine.com/5.0/en-US/BlueprintAPI/PixelStreamingAudioComponent/
C++
https://docs.unrealengine.com/5.0/en-US/PythonAPI/class/PixelStreamingAudioComponent.html

https://docs.unrealengine.com/5.3/en-US/experimental-pixel-streaming-features/

2. Add the PixelStreamingAudio component to the blueprint which is responsible for Audio Input.

   

It is a simple setup that includes writing small blueprints code in a project. In order to make the application listen to the microphone input there are some things that need to be done.

1. Enable Pixel Streaming Plugin in the plugin.

2. Go to player controller or character blueprint.

3. On Begin Play node, add ‘get pixel streaming delegates’ node.

4. From its return value, get the “bind event on new connection” node.

5. Now make a new Blueprint actor and add a Pixel Streaming Audio Component to it.

6. Grab that Audio Component and create a new “Listen To” node.
   

   

7. Make a custom event and make the “Player to Listen to” an Input of that custom event.
   

   

8. Now go back to the main player controller blueprint or character blueprint where you bind an event on new connection in Step 4.

9. On New Connection, Spawn actor from class and choose new actor that you created.

10. When spawned, call the custom event that was created.
    

    

Now package your application and upload to Eagle 3D Streaming Control Panel and test your application. On application start, the Audio Broadcasting will work.

1. This is everything that needs to be done to get your pixel streaming Audio input to the application.

2. Now package the application and upload to E3DS system.