lately i’ve retaken up trying to create a multiplayer game, an FPS at that. and what FPS would be complete without voice chat, to banter with or trash talk your teammates and opponents alike?
though of course, an issue exists: the defold engine doesn’t have any way to get microphone input, nor does it have any way to support contunuous-stream audio.
at first i tried to use an existing extension: defold mic, however it cannot play back, and outputs in compressed wav which must manually replace a sound object’s audio, which results in unacceptable audio quality because doing so isn’t buffered, or fast enough.
so, i needed to make my own system. now, i’ve messed around with miniauidio before, which is a pretty great low-level barebones audio library, so i thought to myself to just shove that into the engine and call it a day. naturally, it took me a bit to translate a standalone executable test into an engine extention, but i did manage to get it to work, at first simply routing audio from the machine’s microphone to speakers.
once i had the basic groundwork down, i then built a pretty simple lua API to push and pull raw PCM data, and once that was done, i added the networking layer. in total, there’s 3 audio buffers in the whole system to help combat packet issues and timing desyncs. i like to think it’s fairly robust, though it is definetly not perfect. plus the API implementation itself is a bit crude, but it’s functional.
the audio itself is 8 bit 8000hz mono, which i’m aware is low quality, but this is to make things fast and easy on the server, and also for stylistic reasons as well. demonstrating it is the wonderful song from money island, a pirate i was meant to be