▲ 7 ▼ ostris/Z-Image-De-Turbo · A De-distilled Z-Image-Turbo (huggingface.co) submitted 11 months ago by Even_Adder@lemmy.dbzer0.com to c/stable_diffusion@lemmy.dbzer0.com 5 comments fedilink hide all child comments
[–] scrubbles@poptalk.scrubbles.tech 3 points 11 months ago (4 children) Stupid question, what is a distilled model? permalink fedilink source hideshow 4 child comments replies: [–] Zarxrax@lemmy.world 5 points 11 months ago (1 child) A distilled model is a more lightweight version of a full model which can run in fewer steps at slightly reduced quality. Z-image-turbo is a distilled model, and the full version of the model will be released soon. This post is referring to someone attempting to somehow undo the distillation to make an approximation of the full model, I guess. Which is basically pointless because as I said, the actual full model will release soon. permalink fedilink source parent hideshow 1 child comment replies: [–] scrubbles@poptalk.scrubbles.tech 3 points 11 months ago Thanks! permalink fedilink source parent [–] Even_Adder@lemmy.dbzer0.com [S] 4 points 11 months ago* (1 child) It's basically when you use a larger model to train a smaller one. You use a dataset of data generated by the teacher model and ground truth data to train the student model, and by some strange alchemy I don't quite understand you get a much smaller model that resembles the teacher model. It's really hard training on a distilled model without breaking it, so people prefer models undistilled whenever possible. Without the teacher model, distilled models are basically cripple-ware. permalink fedilink source parent hideshow 1 child comment replies: [–] scrubbles@poptalk.scrubbles.tech 3 points 11 months ago Thanks for explaining! permalink fedilink source parent
[–] Zarxrax@lemmy.world 5 points 11 months ago (1 child) A distilled model is a more lightweight version of a full model which can run in fewer steps at slightly reduced quality. Z-image-turbo is a distilled model, and the full version of the model will be released soon. This post is referring to someone attempting to somehow undo the distillation to make an approximation of the full model, I guess. Which is basically pointless because as I said, the actual full model will release soon. permalink fedilink source parent hideshow 1 child comment replies: [–] scrubbles@poptalk.scrubbles.tech 3 points 11 months ago Thanks! permalink fedilink source parent
[–] Even_Adder@lemmy.dbzer0.com [S] 4 points 11 months ago* (1 child) It's basically when you use a larger model to train a smaller one. You use a dataset of data generated by the teacher model and ground truth data to train the student model, and by some strange alchemy I don't quite understand you get a much smaller model that resembles the teacher model. It's really hard training on a distilled model without breaking it, so people prefer models undistilled whenever possible. Without the teacher model, distilled models are basically cripple-ware. permalink fedilink source parent hideshow 1 child comment replies: [–] scrubbles@poptalk.scrubbles.tech 3 points 11 months ago Thanks for explaining! permalink fedilink source parent
[–] scrubbles@poptalk.scrubbles.tech 3 points 11 months ago Thanks for explaining! permalink fedilink source parent
all 5 comments