I ran an AI video editing vs human editor test. I let Claude Opus 5.5 build a full animated promo video from one simple prompt, then I re-edited the same clips myself in Final Cut Pro. This article covers how the AI version came together, where it fell short, and which editing decisions still need a person.
What I gave Claude
I am not an animator and I cannot draw. That is why AI is useful for this kind of project. I am a video editor, though, so I know pacing and emotion.
The video is a promo for Studiamo, the open source study app I am building. The backstory is already on my website, so my prompt was simple: turn the story on my website into an animated video. I also gave Claude access to my Google Gemini account, plus music and sound effects from Epidemic Sound*.
From there Claude handled the rest:
- It wrote the voiceover script.
- It created the characters, style sheets for them, and backgrounds.
- It generated the animation and voiceover through Google’s tools.
- It stitched everything together and saved it in a folder structure I like to use: motion graphics, music, voiceover.
Claude did review its own output and regenerated a few scenes. It did not do that for everything, so some scenes were still not good. I kept the project at 720p to save tokens. I do not know whether higher quality would have cost more, and I did not test it.
Where the AI cut went wrong
I could have dropped the 20 clips in order, one to twenty. I did not, because the problems showed up fast once I watched the footage.
- Artifacts and broken physics. One clip had a clock whose hands did not move like a real clock. I left it out. Another had notes dissolving into a different mass, which is the kind of motion that just feels like AI.
- Glitches Claude did not notice. One character jumps strangely and then disappears. Claude still used that clip. I started it later and cut the glitchy end.
- Too much motion. Almost every shot had movement or a zoom. I would keep many shots static and add a zoom myself, only where it matters.
- Weak emphasis. The pauses and the emotion in the voiceover did not come across as well as I wanted.
Reviewing every clip frame by frame would blow up the token usage, so I am glad Claude did not do that. It is still the reason these problems got through.
What I changed in Final Cut Pro
You do not have to be a professional editor to beat the AI at these decisions. Your common sense about what looks good or bad is enough. If you edit a lot, you just notice it faster. These are the changes I made:
- Cut the bad clips and trimmed glitchy sections of the usable ones.
- Added my own music in places where it builds on the motion.
- Removed a lot of the sound effects Claude added and put in my own. Layers of sound make the video feel less flat and more immersive. This part is not a fair comparison, and I say so in the video.
- Used a freeze frame with a slight zoom where the good part of a clip was too short.
- Added a J cut on the rain transition, so the rain sound starts before the picture changes.
- Changed the pacing. I held one scene longer and I want to try a goofy track there. I also felt the buildup was too slow.
Cutting animated footage is hard because you do not get the shots you want. All those zoom-ins you did not ask for also make the clips fight each other. Real footage has the same problem, since most of it is trash and you work around it. With generated animation it is harder, and regenerating a scene on the spot takes more time. It is a trade-off.
What is still not perfect
My version is not finished. An overlay Claude created for me floats on screen and does not match the animation speed of the shot, so it looks out of place. I still need to fix that. I also want a glow effect for Final Cut Pro that is an outer glow. Everything I found only does an inner glow, so if you know a plugin, tell me in the comments on the video. Final Cut Pro also crashed once during editing and I cannot explain why.
After watching it back many times I cannot be objective anymore, so I will look at it again later.
My take
I could not have animated this myself, and now I can, which is already amazing. But the AI cut needs a person who can feel timing, spot what looks weird, and decide when a shot should stay still. Claude makes the raw material fast. The editing still decides whether the video works. The video shows both versions side by side so you can judge for yourself.
*Affiliate link: if you buy through it, I may earn a commission at no extra cost to you.
This post may contain affiliate links. These links are marked with an * and I may earn a commission from qualifying purchases.