Search the Community

This is a very rough first pass attempt at reading amplitude data from a wav file. I'm hoping to get the signal cleaned up so that I can detect subtle differences in amplitude. Anybody really knowledgeable about the Bank class in regards to audio processing, or using fast fourier transform to smooth data?

I'm trying to tap the OpenAL raw audio data to see if it can be processed with an FFT window to build a live stream of the spectrum or amplitude of a playing audio file. This is quite simple in FMOD since it ships with a getSpectrum function. However, we are evaluating the feasibility of bringing our automated lip sync solution, originally built for Unity on top of FMOD, to Leadwerks, and after speaking with Josh, including FMOD as a built in option for Leadwerks users isn't an option at this time. Personally, we would love to see an asset store for Leadwerks as we think Unity has proven it's a good source of income for the host company, encourages developer involvement, and makes it easier for new developers. It is popular enough to convince Unreal Engine to get on board and open their own asset store. Josh informed me that the Bank class pointer references the raw data but I'm struggling to determine if the data in the bank->buf could be processed through an FFT window. Are there any OpenAL pro's here that know if this can be done, and might be will to share some expertise? In case anyone is interested or curious, here are some of our promotional videos for our solution on Unity. Thanks