Text generation is the least you can do. You can still fire up Photoshop and feed in a half-finished image. Diffusion turns whatever you have into whatever you describe. If it does decent scratches on metal, but won't put them exactly where you want, then select them and move them, and the robot will smooth it over.

The very first article I read about Stable Diffusion, three years ago, had the author doodling mountains and flipping a spaceship. All the image-to-video stuff demands you provide art, as an input. Prompts alone are just a tech demo gone feral.