How to Use EB Synth for Hand-Painted Animation
- EB Synth Overview:
- Allows creation of hand-painted animations from live footage using just a single frame painting.
- Eliminates the need to draw or paint thousands of images for a few minutes of animation.
- Requires only a few key frames to be painted, and EB Synth handles the rest.
- Process:
- Video Footage:
- Example provided: Man in a winter coat called “Johnny”.
- Green screen use: While Johnny is shot on a green screen, it’s not essential. Green screens help in stylizing background or different elements separately.
- Image Sequence:
- Convert the video into a PNG sequence using After Effects.
- Key Frames:
- Choose the right key frame(s) and paint them.
- The painting serves as an artistic reference, and other frames will be stylized in the same manner.
- Important: EB Synth is example-based, not AI-based. It strictly adheres to the provided style.
- Frame Selection:
- Frames that reveal as much as possible of the scene are recommended.
- Example: For Johnny, frame number 30 was chosen because his whole face was visible.
- Painting:
- The painting must align with the video for effective stylization.
- Save the painting in a specific format (e.g., “1 0 0 0 30.PNG”).
- Rotoscoping:
- Required if you want to add the background separately.
- Use green screen to generate a black and white alpha sequence.
- Video Footage:
- EB Synth Interface:
- Set paths to your source files: key frames, video, and mask.
- Adjust parameters if necessary.
- Style Weight: Defines how much the stylization adheres to the painted style.
- Video Weight: Adjusts how much the stylized character resembles the original video.
- Mask Weight: Useful when the transparent background is problematic.
- Set the frame interval for stylization and choose a destination folder.
- Final Steps:
- Run EB Synth and check the output folder for results.
- Final compositing can be done in After Effects or a similar tool.
- Credits:
- Example stylization shown was made by Jakob Evora, a concept artist.
- Closing Remarks:
- EB Synth is presented by “Secret Weapons” and “Speculative Elephants”.
Hi is this software for free and the result can be for commercial? thanks
Wonderful intro – well done, I could even understand it as a near total video clueless beginner. Funny, too.
What file manager you use
Thanks for the video. I sometimes get up to a 100 *.ebs files to RUNALL – is there a way to bathc file all the *.eps files so I won't need to sit for the hour or so? thanks for any input and great videos!
Great tutorial, and love the random French at the end
For some reason all generated images from ebsynth are 0kb in size
Thank you for this amazing work. Is there any app do you guys use to change image to paint one without using photoshop? Googled a while and didnt find anything useful 🙂
what if I don't have After Effects?
wow tu m'a surpris quand tu as palĂ© français… 🙂
IT DOESNT WORKKK
Why can this software not autodetect the keyframe steps? if i have 100 keyframes i dont want to setup this 100 times in this ui.
“EbSynth” cannot be opened because the developer cannot be verified. macOS cannot verify that this app is free from malware.
I've just looked through the video quickly. As I understood each single frame image should be redrawn manually, shouldn't they? Or I did not catch it?
Does this have problems with cloud based files as i get an "error- missing file….." for the .mov file
a useful tool, I'll probably use this in some projects, though it's a bit of setup compared to my other tool. It's kind of dying and it's slow but SD-CN Animator is my original choice. Despite it kidna falling apart since it hasn't been updated afaik, it has the flexibility of making either videos similar to ebsynth, or AI generated videos with potential surprise elements to them, just depends on how you balance the prompts and CN modules to favor the video input, seed/SD-picture, or prompt as the weighted primary input, which can be tricky and a pain sometimes, but again, flexibility.
Ebsynth by the sounds of it will do rigging/replacement/inpainted videos 30x if not 100+X quicker than SD-CN could, but, it would be nice to have AI generated flavor of videos, with that same performance. Still, looks like an awesome tool and will keep it in mind for my current projects.
I am using the latest version that does not exist .Tricmat 4:42. Please help me or give me keywords to find out.
It was working for me great a couple months back. Seems to be crashing as soon as I select my video/key frame directory now. Anyone having this issue?
Well done, so far so good!
Am i the only one who hates the way this looks…. The motion is too uncanny. And the chosen painting style was atrocious in motion
I have to say, awesome software, just downloaded the software and love it. Just a couple of questions, is there a way to use the Mac M1 graphics? I think it will speed up the process.. Thanks!