-
Notifications
You must be signed in to change notification settings - Fork 2.6k
Integrate Bria 3.1/3.2 Models and ControlNet Pipelines into InvokeAI #8248
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
7d2a666
to
1076d8e
Compare
1076d8e
to
2d55dbe
Compare
Hey! Confirming, have you tested that this works with the new location? I ran into some issues and may need to poke around in my local install to see what's going on if you were able to run these without issue |
3af3004
to
c08a6a8
Compare
Hey! yeah had an import error, fixed it. Should work now |
37ebc28
to
29aed4b
Compare
Thanks - Trying to get this to run in between a lot of other stuff. I'm getting an error Device-side assertions were explicitly omitted for this error check; the error probably arose while initializing the DSA handlers. Looking at the above, it may be wise to reference some of the device references elsewhere -- Is the noise generation something that needs to happen on GPU? |
It would be significantly faster if it runs on the gpu, but I suspect that if it fails here it will also fail in the denoiser node. |
29aed4b
to
c296fd2
Compare
I am able to run the node now (progress) although it's extremely slow - I suspect that there are a number of missing hooks into existing device references, tools for memory management, etc. Did you reference other inference nodes for conventions, or is this primarily a simple code port? (Re: Device I'm on - testing on a box with 4 ADA 6000s) |
I referenced flux and sd3 inference nodes, but I didn't found anything special other then the use of |
Summary
This feature PR integrates Bria 3.1/3.2 text-to-image models and their ControlNet pipelines into InvokeAI.
How
Representative commits:
Add Bria text to image model and controlnet support
Setup Probe and UI to accept bria main/controlnet models
Added scikit-image required for Bria's OpenposeDetector model
Related Issues / Discussions
Follow-up to exploratory PR Setup Probe and UI to accept bria main models #7973 ("Setup Probe and UI to accept Bria main models").
QA Instructions
Steps:
Install Models
Set HF token with access to Bria's models.
Install
briaai/BRIA-3.2
.Install
briaai/BRIA-3.2-ControlNet-Union
.Load Workflow
Load the workflow from the attached file:
[Bria's ControlNet workflow.json](https://github.com/user-attachments/files/21248912/Bria.s.ControlNet.workflow.json) [Bria's text-to-image workflow.json](https://github.com/user-attachments/files/21248924/Bria.s.text-to-image.workflow.json)Run Workflow
Run workflow without controlnet.
Run workflow with controlnet.
Merge Plan
Rebase onto
main
after current release.Checklist
What's New
copy (if doing a release after this PR)