Saturday, November 21 • 3:00pm - 3:45pm
Frontiers of Music Technologies: Singing Synthesis and Active Music Listening

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Music technologies will open the future up to new ways of enjoying music both in terms of music creation and music appreciation. In this invited talk, I will introduce the frontiers of music technologies by showing some practical examples to demonstrate how end users can benefit from singing synthesis technologies, music understanding technologies, and music interfaces.


From the viewpoint of music creation, I will demonstrate a singing synthesis system, VocaListener, and a robot singer system, VocaWatcher. I will also introduce the world's first culture in which people actively enjoy songs with synthesized singing voices as the main vocals: emerging in Japan since singing synthesis software such as Hatsune Miku based on VOCALOID has been attracting attention since 2007. Singing synthesis thus breaks down the long-cherished view that listening to a non-human singing voice is worthless. This is a feat that could not have been imagined before. In the future, other long-cherished views could also be broken down.


As for music appreciation, I will demonstrate a web service for active music listening, "Songle" (http://songle.jp), that has analyzed more than 930,000 songs on music- or video-sharing services and facilitates deeper understanding of music. Songle is used to provide a web-based multimedia development framework, "Songle Widget" (http://widget.songle.jp), that makes it easy to develop web-based applications with rigid music synchronization by leveraging music-understanding technologies. Songle Widget enables users to control computer-graphic animation and physical devices such as lighting devices and robot dancers in synchronization with music available on the web. I will then demonstrate a web service for large-scale music browsing, "Songrium" (http://songrium.jp), that allows users to explore music while seeing and utilizing various relations among more than 700,000 music video clips on video-sharing services. Songrium has a three-dimensional visualization function that shows music-synchronized animation, which has already been used as a background movie in a live concert of Hatsune Miku.

Video Recorded:

avatar for Masataka Goto

Masataka Goto

Prime Senior Researcher, National Institute of Advanced Industrial Science and Technology (AIST)
Dr. Masataka Goto is a Prime Senior Researcher and the Leader of the Media Interaction Group at the National Institute of Advanced Industrial Science and Technology (AIST), Japan. In 1992 he was one of the first to start work on automatic music understanding, and has since been at the forefront of... Read More →

Saturday November 21, 2015 3:00pm - 3:45pm JST
4th Floor : Track D Conference Room

Attendees (0)