Changes

The HTML5 specification introduces the <audio > and <video > media elements, and with them the opportunity to dramatically change the way we integrate media on the web. The current API provides ways to play and get limited information about audio and video, but gives no way to programatically access or create such media. We present a new enhanced API for these media elements, as well as a working Firefox prototype, which allows web developers to read and write raw audio data. Through numerous working demonstrations, we show how access to this data allows for improved web accessibility, opens new possibilities for real-time media manipulation, and extends the web in ways that have traditionally required proprietary plugins. For example, we look at We will demonstrate examples of how an our audio data API can be used leveraged to create such things as improve web accessibility, analyze audio streams, make in-browser synthesizersand instruments, audio based process digital signals, and drive animated visualizations; in tandem, digital signal processing, text to speech, etc. We we will also explore the code necessary for web developers to work with audio datain Javascript, and implement various audio algorithms, calculate for example, Fast Fourier transform (FFT). Finally, we will entertain further possibilities that such an API would provide, such as text to audio, and other audio algorithms in JavaScriptto text analysis, "seeing" 3D using sound, etc. ==Ideas for Presentation==