ChatGPT
Perplexity
Claude
Gemini
Director leads all eight human-preference metrics, delivering the highest overall quality at approximately 15% lower cost than the runner-up and 58% lower than the third-ranked agent.
Creating an anime story requires expressive characters, purposeful movement, and a visual world that stays consistent across scenes. Each shot needs to advance the narrative while preserving the style and emotion that bring it to life.
Physion's evaluation tests how well AI video agents bring these elements together in a complete production. Director's results mark a milestone in OpenArt's ambition to lead the agentic shift for creative work.
From a complete screenplay to a finished story
In Physion ARC 1.0, each agent receives a complete screenplay and plans, generates, and assembles the video in a single end-to-end run. The evaluation examines whether the result holds together as a coherent story.
The Anime evaluation covered 100 prompts and 800 videos, assessed by human evaluators across 19 metrics. It combined checks of correctness and consistency with head-to-head comparisons of creative quality.
Director ranked:
- #1 overall, leading 11 of 19 metrics.
- #1 on all eight human-preference metrics, including emotional intent, composition, pacing, and motion quality.
- #1 in Animetic Language and Production Quality, two of the benchmark's three quality categories.
These results reflect strengths in the details audiences experience: how characters move, how scenes are composed, how sound supports the action, and how the story's emotion comes through.
Leading quality at a competitive cost
Director's quality ranking comes with a cost advantage. In Physion's Anime comparison, OpenArt achieved the highest overall quality at approximately 15% lower cost than the runner-up, Anime Agent 1.0, and 58% lower cost than third-ranked InVideo Agent One.
No other agent in the comparison achieved equal or higher quality at a lower cost.
For anime creators, production budgets influence how much room there is to explore ideas, iterate, and develop a story. These results demonstrate a compelling combination of quality and cost within the evaluated tasks.
Building creative intelligence into production
A screenplay leaves many decisions to the director. How should a character express an emotion? Where should the camera move? How should one scene lead into the next?
This is the creative intelligence we are building with Director: understanding a creator's intent and coordinating the choices needed to express it across a complete production.
Director brings that process into a conversational workflow, with a professional timeline for refining the result and support for videos up to five minutes. Creators can develop an anime concept, shape its characters and narrative, and guide the production through to the final edit.
"Our mission is to make creativity accessible. Bringing an idea to life shouldn't depend on having a full production team or a large budget," said Coco Mao, CEO of OpenArt. "We're building Director to help more people tell the stories they imagine, with control over how those stories take shape."