Monday, July 20, 2009

Real Time Audio Streaming for Android - Some Developments

OK, so I've made some progress on this project.

  • I have figured out how the Audio Streaming APIs work on the 1.5 SDK.
  • I have obtained a G 711 speech codec in Java which runs on Android. This was taken from the 'sipdroid' VoIP client.
  • I have been able to stream a pre-recorded PCM voice file to the emulator via UDP and play it using AudioTrack.
  • I have figured out how to use the jLibRtp RTP stack in a Java program. There is a port of the same stack by HSC for Android. So I guess it should work there also, but, I must still test it out.
So, it looks like most of the pieces of the puzzle are in place. However, while using AudioRecord and UDP on the emulator, I have encountered the following problems.

  1. On the emulator, I instantiate AudioRecord with a sampling rate of 8000Hz and an encoding of 16BIT PCM. This works fine. However, when I try to run the same code on a device, the AudioRecord object does not get created. Looks like I will have to experiment with different sampling rates and buffer sizes. Strange, huh?
  2. To test the sending and receiving of PCM data, I built a small Java applet that streamed the PCM data to the emulator. I setup proper port redirections. I am able to receive the data in the emulator, but, when I try to send data OUT from the emulator, nothing happens.
Looks like once these problems are sorted out, we are good to go!!!


Posted by at

8 comments:

  1. UnknownAugust 8, 2009 at 7:23 AM

    interesting, but funny how could you have got that far (applet to emulator), but the emulator cannot send out? have you tried using a real device instead of emulator. what error messages, if any do you get? also, what does the ddms logger say? could you send me your email address?

    ReplyDelete
  2. UnknownAugust 11, 2009 at 1:24 AM

    the fundamental problem is real-time, you're tests involve sending a pre-recorded file.

    ReplyDelete
  3. OleksandrAugust 14, 2009 at 5:20 AM

    in 1.5 sdk they hardcoded one sample rate 8000/16/1. Just look into android sources

    ReplyDelete
  4. OleksandrAugust 14, 2009 at 5:21 AM

    did you investigate audio latency? did you get some progress in this area?

    ReplyDelete
  5. Earlence "The Ripper" TezSeptember 5, 2009 at 9:33 PM

    @kevin: this is my email ID:
    earlenceferns@gmail.com

    @oleksander:
    there are lots of problems with the audio APIs in 1.5 I am trying to work around these problems.

    ReplyDelete
  6. gunnar-mobimationSeptember 15, 2009 at 4:15 PM

    I have three different phones, tell me if you want me to test some of this on any of them (ADP1, Google ION, HTC Hero).

    ReplyDelete
  7. Earlence "The Ripper" TezSeptember 18, 2009 at 7:36 AM

    @Gunnar - thanks, I will send some APKs in some time :)

    ReplyDelete
  8. maximosMay 20, 2010 at 3:18 AM

    Hello, nice work,can you post your code? or can you make a tutorial explaining how to do it?,
    I have managed to use AutdioTrack and AudioRecord but can't send the packets over JLibRTP. thanks maxsap

    ReplyDelete

Subscribe to: Post Comments (Atom)