The AI artwork controversies have now extended to anime thanks to a Rock, Paper, Scissors video created by the group Corridor Digital. The seven-minute video was made using three different AI programs – Stable Diffusion, Dreambooth, and DaVinci Resolve. The Diffusion program creates images from noise and can turn live-action video into animation. The AI model was trained using footage of actors in costume, and the art style was trained using the anime Vampire Hunter D: Bloodlust. The backgrounds were created in Unreal Engine and had the same style applied to them. The end result is impressive, although not perfect.
Anime has been one of the key styles that AI art has been trained on. Its simplistic nature made it easier for AI to grasp, and generating anime-style images is possible on various websites. However, the controversy surrounding AI art lies in the training process. To copy an art style, AI needs to review a lot of artwork in that style, much of which is sourced online without consulting the original creators. This has led to concerns from artists, as AI can now recreate their personal style instantly, potentially affecting their employment opportunities. While Corridor Digital tried to address this issue by relying on a single anime film for their style, the problem still remains.
Despite its impressive appearance, the final product still has some issues capturing the anime style entirely. The technique used in the video is similar to an old animation technique called rotoscoping, where artists trace the movements of actors frame-by-frame and animate over it. The Rock, Paper, Scissors video can be seen as AI-driven rotoscoping, which is technically impressive but not the same as drawing from scratch. It’s easy to distinguish the frames generated by AI from the live-action video, as the single frames more closely match a traditional anime style. While the ideas used in this video have potential for further development, it is unlikely that this process will replace standard anime production anytime soon.
The idea of AI creating artwork raises ethical concerns that need to be addressed. Although the anime industry may be safe for now, these issues must be resolved before the technology advances further.