Proof of concept model: a motion lora attempt to generate a full rotation of a full body female without 'beetlejuice head', upper/lower body counter-rotation or thigh/leg/foot morphing during rotation. I think i was able to train out 'beetljuice head' and upper/lower body counter-rotation. Lower leg and foot morphing is still hit or miss.
Prompting: Should contain a moving motion to get the model to initiate turning motion. 'takes a step and turns around', 'turns in a circle', 'spins around', 'turns to the left'...
Note: wan version - if prompt contains a short top, or, short dress, model tends to 'flash' the camera.
Dataset: 5x100 frame 1024x1024 24fps video clips. each clip contained a female model performing a complete full body rotation. 3 clothed, 2 nudes. 2 models walking and turning, 3 dancing and turning.
Training: 45 epochs, 1629 steps, 288x288 resolution.
Testing: Sample videos were generated using a two stage tea cache sampler comfyui workflow. Samples with blue background were generated with caption files from training dataset. Stage 1 was run at 1.6x speed for 7 steps. This was to verify full body and rotational content before proceeding. Stage 2 was run at 1.0x speed for 20 steps. For clips that were clean, stage 2 denoising was set to 0,7. For others, stage 2 denoising was set to 0.8-0.9 to clean them up.