A networked 3D audio platform for Software Defined Media

The goal of this solution is to create a networked 3D audio platform for object-based audio reproduction systems, which deliver the contents over the internet.
Solution
Overview
In 2014, we established the software-defined media (SDM) consortium, which investigates object-based and internet-based audio-visual services. The SDM application enables the manipulation of audio-visuals using IoT. For example, by using a position estimation system, we can manipulate the position of a sound object in real-time. These technologies and applications can be applied to various fields of audio-visual entertainment.
Highlights
  • Object-based audiovisuals rendering in real-time
  • Real-time correction function for position detection obtained from multiple IoT sensors
  • Content distribution from the internet
  • Flexible application development
  • Affinity with AR and VR
Solution
Details

With the advancement of IoT technology, various elements such as viewer movement have been incorporated into the virtual space in real-time. In object-based audio systems, sound objects in a 3D virtual space can be rendered in real-time.

We developed and evaluated a networked 3D audio platform that enables interactive sound manipulating using IoT. Further developments include an application that enables interactive manipulating on the platform using consumer goods such as smartphones and tablet devices and AR. These systems were exhibited at Interop 2019, and we evaluated effectiveness by testing with 45 users.

Solution
Benefits
  • Provides an immersive acoustic space
  • Offers a completely new entertainment experience
  • Enables utilization of various IoT devices
  • Enables distribution of object-based audio content
Testimonials

It is an interesting idea to be able to move the sound by moving the IoT device. I don't think there is anything else.

It is a technology that would make live viewing more fun.

Get In
Touch
This form may not appear if your browser is running in private mode.
This website uses cookies to provide you with a better user experience. By using our site you agree to the use of cookies as described by our cookie policy. If you do not want to accept all cookies from our website, please see our cookie policy on how to modify the types of cookies that are accepted by your browser client.