Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
(Not sure why it's diffing some lines that are the same. Edit: Might be my soft reset)
A little experiment to use different prompts for different segments.
In this PR, you can set one prompt per segment generated (roughly 1.5 seconds). Prompts are semi-colon (;) separated. In natural order. If you specify less prompts than segments, it will reuse the first one. Each section has no knowledge of the other prompts, so you must be explicit in the description, hence the double "robot chef"
Example:
"the robot chef gestures with its arms; the robot chef walks to the pot on the right side and stirs it"
250425_190901_125_9597_18.mp4
Now, there are some limitations with this method.
Since FramePack starts with the last segment, the amount of movement you can do is limited. In this case it will start with the image and the prompt " the robot chef walks to the pot on the right side and stirs it". Technically, you might be able to have it enter from the left side, but with the image being what it is, it might be difficult. I've only done a couple of tests so far, so I have no idea how well it works on more complex things.
I afterwards (or mid) realized there is a more advanced project here, which utilizes time-stamps for the prompts : https://github.com/colinurbs/FramePack-Studio