Hey, I wanted to generate some images for my protagonist in a game I am making, but having different stages of weight. So I try and generate an image of a girl, and incrementally making her look fatter, whilst keeping the same general appearance, clothes, etc. I have tried doing this by using the previous weight stage image as a reference, but one of 2 things happens:
The girl in the image barely looks fatter
I increase the weight (pun not intended) of the fat model I’m using but then the appearance of the girl deviates significantly from the original.
I am using the website SeaArt, so it would be extra helpful if advice was applicable to that. I have tried fiddling about with the weights of each model, prompts, denoising strength, sampling, etc, but nothing works.
Can anyone help? Or at least point me to a forum/page that has information about generating good WG sequences?
I am also interested in knowing this. I know on stuffer.ai there are people who managed to do sequence with the same model and progressing the weight. Maybe you can check out in there.
I’ve never used that site but what I do is i find a first image that im happy with and make sure it has something like “(fat:0.0)” in it somewhere. Then I freeze the seed and slowly tweak the prompt until I am satisfied with the result. I tend to keep all the settings the same. Hope that helps.
I’d use ComfyUI for that. You can train a model/Lora based on a character and make images of that chatacter. How you would do that i dont know, i havent done it myself. Also ConfyUI is really complex. If you are curious of how to use it, r/comfyui is your friend.
I use SwarmUI for it and the Hyperfusion V9 model with a custom workflow I don’t mind sharing. Though if you’re using another model it wouldn’t need the custom workflow as it wouldn’t require the Vprediction and clip skip nodes and would work “out of the box”. Unless the model you’re using is specifically trained for doing fat characters you’re probably also going to need LORAs that are trained to that end - and possibly for some models even then you might still want LORAS to achieve particular effects.
Another handy thing about SwarmUI is that whilst it uses ComfyUI as a backend it has some QOL features that make it easier to use. Including the ability to (if you don’t live in the UK with our bloody stupid Draconian Internet ‘safety’ Act pissing in the cornflakes) copy and paste model and lora URLs from CivitAI straight into the utility interface and download the models instead of having to git bash them (a term I am saddened to say does not involve bodily harm to gits).
As I’ve said elsewhere my method is use a randomised seed until I get an overall look I like for the starting weight then freeze the seed and bump the weight up and see if it still looks good (sometimes it doesn’t) - if not I’ll try starting at the other end and working backwards, or starting in the “middle” and going out out towards the end points.
Its generally pretty good at consistency. Though sometimes if I’m struggling for a particular pose to look good I’ll drop it back to a random seed and iterate until I get something that’s reasonably close to A) what I want it to look like and B) is reasonably consistent with the base image.
Though at the end of the day while consistency is good I have seen me spend hours on one image tweaking a prompt to try get it to look right and have learned to know sometimes you just have to say “good enough” and hope people will be forgiving of a bit of inconsistency in the interests of A) enjoying playing the game and B) recognising that I’m not a professional developer by any stretch of the imagination and I’m making this game as much as for the fun of making it and learning something new as I am for the end result.
If you’re just starting out with image generation, and do not have a powerful GPU, then I recommend CivitAI. If you do have a powerful GPU, you can also use the same site to find models that you can download for free and run locally using ComfyUI. If you have a GPU with 24G of VRAM, then you can even generate videos locally. Also, I have a WAN2.2 Video LoRA on CivitAI named “Fattenator”. This will take any image you have of a character and turn it into a video where the character gains weight, a LOT of weight. I really appreciate the work that the authors do putting together these games and am willing to offer my services transforming your character images into a collection of images of that character at various weights. This is child’s play for me and I can even provide them with transparent backgrounds to allow you to swap out locations.
Edit: The guy who runs stuffer.ai reached out to me for permission to use the Fattenator on his site, so I fully expect it to be available there soon. Donating to him might speed things along.
I’d be interested in giving that a spin - see if I can make some gain process vids to play in the game I’m making. Had limited success so far with other video models I’ve tried. Unfortunately civit is blocked in the UK thanks to the bloody nanny state. Any chance you can pose the URLs so I can paste them into Swarm to download?
Here are the URLs:
Model: Sign in to Civitai
Workflow: Sign in to Civitai
The other associated models are probably on hugging face. You need to have a good seed image to start with. It does better with photorealistic images, but it is a WAN 2.2 High LoRA, and the difference between photorealistic and other styles is mostly in the WAN 2.2 Low weights.