That will be transcoding so from the server side make sure it's enabled and working. Then you can limit the bitrate (per-user, or globally)
This way the client will stream the content and not direct play it.
Hopefully this fixes the issue with audio.