Manga-style Rendering of Clapping Using Animated Onomatopoeia with High Visibility

We propose a method to transform the real world into a manga style in real time by adding onomatopoeia to real-world actions. In this study, we target clapping scenes, estimate onomatopoeia in real time from the clapping sound, and visualize the them in the MR space. To enhance visibility, the onomatopoeia are arranged using a non-overlapping method. Furthermore, we apply manga-style animations to the onomatopoeia to construct a highly immersive system. In an evaluation experiment on visibility, the proposed method received high ratings for manga style, sense of immersion, and visibility. In an animation evaluation, the proposed method received high ratings for sense of immersion and usability.

Images