Creative works

Conversation in the Cloud

live multimedia composition for one human musician and one AI musician

Conversation in the Cloud is a live multimedia composition for one human musician and one AI musician. Two musicians’ conversations start at the intersection of reality and virtuality via music. Then, both musicians will push their limits through improvisation based on each other’s music during the live performance. Finally, the two worlds gradually blend as the conversation deepens. The AI musician is a comprehensive system that applies multiple machine learning techniques to enhance its machine musicianship, such as deep neural networks and human body pose estimation. Thus, with the combination of the live multimedia and two musicians’ performances to unveil a multi-dimensional music conversation.