A Piano Learning System Constructed Based on Multi-Direction Videos and Hand Landmark Detection

During the Covid-19 pandemic, e-learning and online learning systems and platforms have become increasingly popular and essential. Currently, numerous e-learning materials covering various subjects have been developed and are widely utilized in practical education. Music instruction education has also confronted this challenge. In this paper, we introduce a piano learning system. We incorporate multi-directional video technology to enable users to observe piano players from their desired angles. Additionally, we integrate MediaPipe into this system to implement hand landmark detection, facilitating users in virtual piano playing. We also use an experiment to evaluate the educational efforts of our system.