TY - GEN
T1 - Building AR Virtual String Quartet for Live Concert
AU - Yang, Hung Chih
AU - Xie, Cheng Ming
AU - Wang, Po Chun
AU - Xiao, You Cheng
AU - Su, Wen Yu
N1 - Publisher Copyright:
© 2021 IEEE
PY - 2021
Y1 - 2021
N2 - In this paper, we proposed the system for building virtual string quartets. This system is combined with three parts, which is animation control, sound synthesis, and central synchronization system. In the animation control part, we first design animation and use Unity for animation playback software. Next, the animation is controlled by the CSV file which is generated in the labeling stage. In the sound synthesis part, we analyze the music score and turn the expressive musical performance such as the velocity, duration, and dynamic of each note into the MIDI file. We develop a bowed-string instrument VSTi and use Reaper for sound playback software. Finally, we build the central synchronization system for synchronizing the animation with the sound in the real-time virtual music concert.
AB - In this paper, we proposed the system for building virtual string quartets. This system is combined with three parts, which is animation control, sound synthesis, and central synchronization system. In the animation control part, we first design animation and use Unity for animation playback software. Next, the animation is controlled by the CSV file which is generated in the labeling stage. In the sound synthesis part, we analyze the music score and turn the expressive musical performance such as the velocity, duration, and dynamic of each note into the MIDI file. We develop a bowed-string instrument VSTi and use Reaper for sound playback software. Finally, we build the central synchronization system for synchronizing the animation with the sound in the real-time virtual music concert.
UR - http://www.scopus.com/inward/record.url?scp=85124211605&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85124211605&partnerID=8YFLogxK
U2 - 10.1109/AIVR52153.2021.00066
DO - 10.1109/AIVR52153.2021.00066
M3 - Conference contribution
AN - SCOPUS:85124211605
T3 - Proceedings - 2021 4th IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2021
SP - 313
EP - 318
BT - Proceedings - 2021 4th IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 4th IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2021
Y2 - 15 November 2021 through 17 November 2021
ER -