[–] 3 points 11 months ago

Yes-ish. The base is Draw Things and the relevant bits are https://github.com/drawthingsai/draw-things-community?tab=readme-ov-file#cuda-capable-linux that isn’t too difficult to setup. The app with the pretty interface is Apple only (the developer one day decided to cram the full 1.5 on his iPhone and that was the start of this. The app has feature parity between the iOS, iPad and Mac versions, the gRPC server is “just” the generation parts decoupled from the app) but there’s a Comfy plugin to use the server.

BTW on Apple’s hardware Comfy is poorly optimized, while Draw Things is optimized. The iPhone XR is the oldest hardware capable of on device generation, and (with the right settings) could do a SDXL 1024x1024 generation. 13 minutes mind you for 8 steps, but also 3gb of total system memory. On the other hand, the iPhone 17 Pro is a third of the speed of my RTX 3060. There’s also a friendly Discord, and the dev clearly enjoys adding support for new, cool models because he’s quick at it but doesn’t share roadmaps of any kind.

Yeah. I really, really like that thing.

  • source
  • parent
  • context
  • [–] 3 points 11 months ago (1 child)

    A big note that it's nigh impossible to put two separate characters in one image, as the model has no idea who you are referencing. You can see this in all image models how they usually only have one central person, or two people who look oddly alike. Only way to get two or more characters would be with complex workflows to inpaint certain characters.

  • source
  • parent
  • context
  • [–] 4 points 11 months ago*

    If you have or can create a LoRA trained on images of the character you're presenting, that may be helpful. Or if you have a checkpoint model trained on that character. Would be like having a character that the base model is trained on.

  • source
  • parent
  • context
  • [–] 4 points 11 months ago* (2 children)

    You would probably need to use something like Visual Novel Character Creation Suite to generate a character and a dataset for LoRA training, and then train a LoRA for each character. LoRA are adapters you plug into larger models to help it generate whatever concept you want, in this case it would be a character. With a well-trained LoRA you shouldn't have any problem with character consistency.

    If you're trying to get started with generating locally, here's a tutorial for Comfy UI.

  • source
  • parent
  • context
  • view more: ‹ prev next ›