Skip to content

is it possible to add Flux w/loras and i2i? #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
KINGLIFER opened this issue Sep 1, 2024 · 15 comments
Open

is it possible to add Flux w/loras and i2i? #4

KINGLIFER opened this issue Sep 1, 2024 · 15 comments

Comments

@KINGLIFER
Copy link

KINGLIFER commented Sep 1, 2024

xxxxxxxxxxx

@BetaDoggo
Copy link
Owner

Sure, here's an example workflow:
workflow
Make sure that you're using the newest version and that the dependencies are also all installed. The lora_url should be a direct download link (you can usually get this by right clicking the download button and selecting copy link). Also keep in mind that the required strength value varies a lot by the style of the image. Let me know if you have any issues.

@BetaDoggo
Copy link
Owner

@KINGLIFER I'm an idiot, I just realized that my image conversion code was also converting the image to greyscale. I copied it from a previous project but forgot to remove that part. This was also an issue in the vision model nodes. Thank you so much for helping me catch this. I've pushed the fix now so you'll have to update.

@BetaDoggo
Copy link
Owner

Yes it was fixed in aadf07b
When I set the strength to 0.01 I get a nearly identical image (it's stretched because of the set generation resolution)
image
What method are you using to update the extension?

@KINGLIFER KINGLIFER reopened this Sep 6, 2024
@BetaDoggo
Copy link
Owner

Sorry I've been busy the last week. As far as a know the only cause of this would be that the version you have is out of date. You should try reinstalling the extension completely (deleting the folder) and trying this again. Otherwise I'm not sure if there's anything else I can do, I can't replicate this issue anymore on a clean install.

@BetaDoggo
Copy link
Owner

In the example above I set my strength to 0.01 and it produced an almost identical image to the input (stretched to match the generation resolution). Here are two with the regular image2image node:
i2i
dogi2i

@BetaDoggo
Copy link
Owner

@KINGLIFER Sorry for the late response, as far as I can tell i2i only works with a single image, you're probably thinking of ipadapter, controlnet or one of the other model extensions that has gotten flux support in the last few months. I don't really use this project anymore so it's a pretty low priority, but I'll see if I can throw together a node based on the flux-general and flux-general/image-to-image endpoints this weekend.

@BetaDoggo
Copy link
Owner

Oh ok yeah that shouldn't be too hard, I should be able to add that to the existing nodes. Rather than adding 4 outputs to the node I'll probably make another node to split the output so that it's an optional feature.

@BetaDoggo
Copy link
Owner

I've just pushed support for multiple image outputs. It outputs as comfyui's normal multi-image format and can be split by a new node (SplitImages) into up to 4 individual images. I've added it to the falfluxAPI, falfluxi2iAPI, and falfluxloraAPI nodes. I might add it to all of the other image output nodes later but I don't feel like retesting every single one right now, let me know if there's a specific node you want it on.
workflow with split

I didn't find the time to make a flux/general node this weekend and I'm not sure if I'll do it just based on the pricing of the images (13/$1). I might still make nodes based on the redux endpoints since they're still relatively affordable, but that would have to wait until next weekend.

@BetaDoggo
Copy link
Owner

@KINGLIFER You might be running an outdated version of comfy manager. Comfy Manager switched to using the official ComfyUI Registry not too long ago. The list that the older versions are using is outdated.

If you're running the newest version the search should look something like this:
image

You also need to select the specific 1.0.5 version or it will complain about security settings:

image

@KINGLIFER
Copy link
Author

Please add this node... fal-ai/veo2/image-to-video
Love it. I was hoping you could add this one as well. I know you put a lot of work into these things for free so I am saying thank you.

@KINGLIFER
Copy link
Author

:(

@BetaDoggo
Copy link
Owner

Sorry I was busy last week and couldn't get to this until now. I don't think I'm going to add veo support due to the cost. It's $2.50 per 5 seconds so it would be very expensive to test properly. I think Google's pricing is absurd since I believe they also offer a certain number of free generations through their own AIstudio platform.

@KINGLIFER
Copy link
Author

KINGLIFER commented Apr 27, 2025 via email

@KINGLIFER
Copy link
Author

Ok it seems my offer is not something you would want so how about Kling-video? .09 seems better than .5 per second.

@BetaDoggo
Copy link
Owner

Sorry for the late response, I haven't been checking my email, I did end up giving a Veo2 node a shot after all, it doesn't have many options so I only needed to do a single test generation.

I'll be a bit more available the next few days, if there are any other specific video endpoints you want support for let me know. Most of the work is already done with the veo node, it just needs to modified a bit for other models with more settings.

Image

The new version (1.1.0) should already be available on the comfy registry, you can update to the current version through comfy-manager.

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants