Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add FLUX Redux support #7726

Merged
merged 12 commits into from
Mar 5, 2025
Merged

Add FLUX Redux support #7726

merged 12 commits into from
Mar 5, 2025

Conversation

RyanJDick
Copy link
Collaborator

@RyanJDick RyanJDick commented Mar 3, 2025

Summary

This PR adds support for the FLUX Redux model (https://huggingface.co/black-forest-labs/FLUX.1-Redux-dev).

Example

Caption: A gnome at the beach holding a banana


Redux image prompt

Result

Usage

  • Install the following Starter Models: SigLIP - google/siglip-so400m-patch14-384 and FLUX Redux
  • Sample workflow:
image

Follow-up: Canvas Integration

@psychedelicious I have left integration of FLUX Redux into the Canvas UI for a follow-up PR, because it is a little hairy.

The Redux model differs from the other IP-Adapter models in the following ways:

  • Does not support start/end percentage in the same way
  • Does not support weight
  • Uses a SigLIP image encoder - not one of the existing CLIP models.
  • Supports masked image prompting. Masking is not currently supported for the other FLUX IP Adapter models.

Related Issues / Discussions

N/A

QA Instructions

Tests:

  • Test installation of SigLIP and FLUX Redux via the Starter Model tab.
  • SigLIP and FLUX Redux appear in the model list.
  • Run a FLUX Redux workflow without a mask
  • Run a FLUX Redux workflow with a mask
  • Run a FLUX Redux workflow with multiple Redux image prompts

Merge Plan

No special instructions.

Checklist

  • The PR has a short but descriptive title, suitable for a changelog
  • Tests added / updated (if applicable)
  • Documentation added / updated (if applicable)
  • Updated What's New copy (if doing a release after this PR)

@github-actions github-actions bot added python PRs that change python files invocations PRs that change invocations backend PRs that change backend files frontend PRs that change frontend files python-tests PRs that change python tests labels Mar 3, 2025
@RyanJDick RyanJDick marked this pull request as ready for review March 3, 2025 20:59
@hipsterusername
Copy link
Member

Happy path testing
image

Good to go!

Copy link
Collaborator

@psychedelicious psychedelicious left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great. Let's wait until v5.7.2 stable is released, then we'll get this & the workflow library changes merging in.

@psychedelicious psychedelicious enabled auto-merge (rebase) March 5, 2025 23:22
@psychedelicious psychedelicious merged commit 1f6430c into main Mar 5, 2025
15 checks passed
@psychedelicious psychedelicious deleted the ryan/flux-redux branch March 5, 2025 23:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend PRs that change backend files frontend PRs that change frontend files invocations PRs that change invocations python PRs that change python files python-tests PRs that change python tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants