[Stable Diffusion] Integration with stable-diffusion.cpp

[danemadsen]

I'm wanting to integrate stable-diffusion.cpp into maid at some point. I'm submitting this issue as an expression of interest for anyone who wants to implement it for me.

[RookieIndieDev]

Certainly would be interesting addition. How well does it run on mobile devices locally?

[danemadsen]

Certainly would be interesting addition. How well does it run on mobile devices locally?

No idea. Its theoretically possible because like llama.cpp its can be run in an android terminal emulator. Its going to be a huge addition once I get around to it and there's other stuff that needs to be done to core.cpp before I cross that bridge.

[Ar57m]

Certainly would be interesting addition. How well does it run on mobile devices locally?

I ran sd-turbo safetensors q4_0 on stablediffusion. cpp about 88 seconds per iteration, it's too much slow

[RookieIndieDev]

That's painfully slow. Mobile GPUs/CPUs aren't good enough I guess.

[MugoSquero]

You can try implementing whisper.cpp too. It runs quite easily on my phone using the base model.

[Foul-Tarnished]

There's an app for android already
https://github.com/ShiftHackZ/Stable-Diffusion-Android

It doesn't use sd-turbo afaik, SD1.5 ?
Pretty slow, like 2min per image on SD865 12GB (+4GB) at 512x and something like 30 steps
I don't really remember

You can't even choose another checkpoint, and it lacks a lot of settings

[Ar57m]

There's an app for android already https://github.com/ShiftHackZ/Stable-Diffusion-Android

It doesn't use sd-turbo afaik, SD1.5 ? Pretty slow, like 2min per image on SD865 12GB (+4GB) at 512x and something like 30 steps I don't really remember

You can't even choose another checkpoint, and it lacks a lot of settings

thanks for sharing, it runs pretty decent, I ran until 320x448 20 steps in less than 40 seconds, after that resolution it crashed(probably not enough ram)

[GameOverFlowChart]

There's an app for android already https://github.com/ShiftHackZ/Stable-Diffusion-Android
It doesn't use sd-turbo afaik, SD1.5 ? Pretty slow, like 2min per image on SD865 12GB (+4GB) at 512x and something like 30 steps I don't really remember
You can't even choose another checkpoint, and it lacks a lot of settings

thanks for sharing, it runs pretty decent, I ran until 320x448 20 steps in less than 40 seconds, after that resolution it crashed(probably not enough ram)

It doesn't show the option for steps to me but it shows 1/8? How do you know that it's 20?

Also yeah thanks for sharing I didn't know that the app can generate locally.

Edit: nvm it shows in the details of the finished image that it's 20 steps

[dsx1986]

I am using this for stable diffusion on ios/macos and it is working fine. https://pub.dev/packages/flutter_stable_diffusion