Work / Video and content

Motion-transfer videos: our own characters on someone else's choreography

What it was

There is a clip with an extra-filled crowd in white suits on temple steps, and we needed the same dance but with the club's cartoon hamster in the centre and a crowd of bears and bulls in market-coloured suits. Then the same trick for gifts: the birthday person in place of the donor video's hero, with their face and their clothes.

What we did

Characters were made in Nano Banana Pro, one reference per character, and fed into Higgsfield Genjutsu together with the donor. Three runs of 27 seconds each, every one checked frame by frame. Between runs the prompt changed: separate references instead of one picture, a bias towards bulls instead of 'equal', a no-overlap rule, a new background, a Latin caption spelled letter by letter.

What the client got

The final was accepted as is: the hamster stays cartoon for all 27 seconds, bulls are about half, the temple is gone, the ALTSEASON caption has no errors. The whole video cost 255 credits. In parallel a bear and a bull rapped on an orange background, and the recipe went on to produce gift videos for friends.

ClientCrypto club Full Hamster and personal projects for friends
My roleCharacter references, prompts, Genjutsu runs, frame-by-frame review, editing and caption overlays
StatusTwo videos for the club accepted as is, gift videos assembled from the recipe
Result3 runs of 27 seconds and 255 credits for the crowd to split in half and the hamster to block nobody · Open
Rejected: run 2, the prompt said 'exactly equal': bears are more than half, the temple with lanterns is still there. Frame from the video
Rejected: run 2, the prompt said 'exactly equal': bears are more than half, the temple with lanterns is still there. Frame from the video
Accepted: run 3, the prompt biased 'clearly more bulls': about half on the output, sky instead of the temple. Frame from the video
Accepted: run 3, the prompt biased 'clearly more bulls': about half on the output, sky instead of the temple. Frame from the video

The task

The traders’ club Full Hamster has a cartoon hamster from its stickers: flat, light brown, cream chest, big cheeks, two front teeth. The idea: take a clip with a large crowd of extras and replace everyone with crypto animals. Bears in emerald-green suits with red ties, bulls in bright red with green ties, all in dark glasses, and in the centre, instead of the man in black, our hamster. The donor: 27 seconds, extras in white suits on the steps of a Japanese temple, eight cuts. At the end, the caption ALTSEASON.

The same day, a second video with the same technique: a photorealistic bear and bull in suits rap over a donor video of two people on an orange background, with hand-drawn candles and arrows. Later the recipe went into gifts: a birthday girl in a crowd of bodybuilders, and a close friend in place of the dancer, the skydiver and the woman with the bottle in three donor videos.

Why, and what the idea was

Motion transfer gives what generation from scratch does not: exact choreography, head turns, lip sync and timing from the donor, with our own characters on top. Higgsfield has two different Motion Controls, and they are not equal: the old one on Kling 3.0 takes no prompt and holds one character; Genjutsu takes a prompt and up to 49 characters. So Genjutsu, always. The output length equals the donor length, there is no duration parameter, and there is no 10-second limit like in Kling 2.6.

Characters are made in advance in Nano Banana Pro and fed in as images, one figure on a neutral background each. The hamster stayed flat 2D next to photorealistic animals and never drifted once in 27 seconds: the model can hold two styles in one frame.

How it went

When What happened
Run 1 Bear and bull in one picture. The output was almost all bears, suits handed out at random: the colour was tied to nothing
Run 2 Two separate references, the prompt said “exactly 50 percent” and “count them as you place them”. The bulls came back, but at 10 to 20 percent, suits still mixed up, the temple still there
Run 3 A bias, “bulls must clearly outnumber bears, at least two in three with horns”, a no-overlap rule as the first item, direct bans “no temple, no shrine buildings, no lanterns, no roofs”, a Latin caption spelled letter by letter. Accepted as final
In parallel “A bear and a bull rap”: two tries at 87 credits each, the final accepted. The hand-drawn graphics came out better than expected. The Cyrillic caption came out as gibberish, the Latin FULL HAMSTER without errors
Three days later The same scheme for a birthday: a crowd of bodybuilders, the birthday girl from a photo in the centre. Bare shoulders, straps and a small floral pattern drifted in the first seconds, the caption came out as MARGU. Second run: a plain red dress with sleeves, the caption split into two lines
Three weeks later A gift for a close friend’s 54th birthday: three donors (a dance of 32 s, a skydive of 17 s, a bottle of 9 s), a character sheet with FACE LOCK, a separate prompt per video. The bottle donor has the number 35 baked in, so that prompt carries the strictest ban on text, and 54 was overlaid in the edit with the same slide-in as the original

Tools and method

The call: generate_video, model hf_mult_motion_control, images with the role image and exactly one video. The platform offers a preset such as “DROWN IN MUSIC” and will not start without a refusal: we decline the preset, otherwise it replaces the idea. The price depends on donor length and resolution: 27 seconds is 81 credits at 480p, 190 at 720p, 299 at 1080p, roughly 3, 7 and 11 credits per second. A Nano Banana Pro image is 2 credits. A run takes 20 to 45 minutes; that is not a hang.

The prompt is one block in English, with the bans woven into the text. Order matters, because the model holds the beginning and the end best: first the no-overlap rule, then crowd proportions through bias, a hard tie of clothing to character, a description of each with its reference number, the background with bans on what must go, graphics and the final caption, and at the tail photorealism, no humans, no watermarks.

For a real person in the reference the clothing is closed and plain, because bare skin and small patterns drift. For the face, a FACE LOCK block: shape, cheekbones, eyelids, wrinkles, age, and direct bans “do not narrow the face, do not make him younger, do not blend two faces into one”. Bans like “no grey hair” break the face, so hair shade is changed only through the HAIR line.

Result

ALTSEASON: 27 seconds, 854x480, 24 fps, shown here without sound because the donor carries someone else’s track. What works: the caption has no errors, the temple is gone and the sky has opened, bulls are about half, the hamster cuts off nobody’s head, the cartoon look holds for the whole video, the suits are mostly right. What remains and was accepted as is: occasional suit errors, a bear in red at second three, no white hand-drawn graphics on the background, the model only delivered the caption, and distant figures are blurred in wide shots.

“A bear and a bull rap”: 29 seconds, 752x560, the mute version. The motion transferred exactly, the hand-drawn graphics appear and vanish, the FULL HAMSTER caption is clean. Two blockers before publishing: the format is not vertical and the original carries the donor’s audio, so for TikTok and Reels it goes up without sound with a track from the platform’s library.

Credits: 255 for ALTSEASON, three runs at 81 plus 12 for images, and 178 for the rap video. The animal references are ready and uploaded, so the next video on the same scheme is 81 credits and about an hour of work. What we do not know: the result of the second birthday run was not recorded, and the gift videos for the friend were launched from our instructions on the client’s side.

Mistakes and what we took from them

One reference per character.Bear and bull in one picture were read as a single character: the model pulled the figure on the left and larger, and the frame ended up almost all bears. A separate picture for each, one figure on a neutral background, and the bulls came back at once.
The model does not count "equal", only bias works."Exactly 50 percent" and "count them" gave 10 to 20 percent bulls: a crowd of hundreds is held as a texture. We ask for a bias the other way, "clearly more bulls", and the output lands at about half.
Cyrillic in video breaks, Latin does not.The Cyrillic club name came out as gibberish; FULL HAMSTER and ALTSEASON landed without errors. Only Latin in video, spelled out: "spelled A-L-T-S-E-A-S-O-N". Cyrillic is overlaid in the edit or made in Nano Banana Pro, where it comes out clean.
Ban overlap with a direct rule.The hero kept running over his neighbour and cutting off his head. First item of the prompt: the hero never covers those behind him, stands in a free gap, everyone keeps a visible head, horns and body. Local demands on a single figure are what the model does best; this was fixed on the first try.
The donor background changes only through a direct ban.Genjutsu inherits the donor's environment. The temple with lanterns left only after "no temple, no shrine buildings, no lanterns, no roofs".
The model does not hold a checkerboard.Genjutsu cannot place a crowd on a grid or tie suit colour to species in a mass scene. When composition control is needed, build from static frames in Nano Banana Pro: there the checkerboard and the large hero landed on the first try for 2 credits, but the motion will then not be the donor's.
Bare skin and small patterns drift.A real person in the reference gets closed, plain clothing from the start, a long caption is split into lines, the name is checked letter by letter, and if it drifts again the caption is overlaid in the edit.

Tools

Higgsfield GenjutsuNano Banana ProPythonClaude Code