Stable Diffusion（Huggingface的方式安装）
Huggingface的方式安装
在Huggingface个人目录下有一个token号，这个tokens号要在服务器登陆的过程中进行添加；
1，在服务器登陆要输入huggingface登陆：
huggingface-cli login # READ 权限的就够了 运行完命令，按照提示将之前的token复制过来，然后 Y ，回车，登陆成功！
2，相关包安装
pip install --upgrade diffusers transformers scipy pip install torch==1.11.0+cu113 torchvision==0.12.0+cu113 torchaudio==0.11.0 --extra-index-url https://download.pytorch.org/whl/cu113 pip install accelerate # 这个加速包可以不装，但是他一直提示看着难受的就装了 3，运行模式
import torch from torch import autocast from diffusers import StableDiffusionPipeline model_id = "CompVis/stable-diffusion-v1-1" device = "cuda" pipe = StableDiffusionPipeline.from_pretrained(model_id, use_auth_token=True) pipe = pipe.to(device) prompt = "a photo of an astronaut riding a horse on mars" with autocast("cuda"): image = pipe(prompt, guidance_scale=7.5)["sample"][0] image.save("astronaut_rides_horse.png") 哈哈，报错，error key ‘sample’
打印下pipe看看
只有两个key：images 和 nsfw_content_detected
那改成 images试试
import torch from torch import autocast from diffusers import StableDiffusionPipeline model_id = "CompVis/stable-diffusion-v1-1" device = "cuda" pipe = StableDiffusionPipeline.from_pretrained(model_id, use_auth_token=True) pipe = pipe.to(device) prompt = "a photo of an astronaut riding a horse on mars" with autocast("cuda"): image = pipe(prompt, guidance_scale=7.5)["images"][0] image.save("astronaut_rides_horse.png") 第一次运行会下载模型，需要点时间，生成的时候显存大概占用12G
成功了，看下生成的怎么样。
马马虎虎，还有很大优化空间。
补充
显卡显存不足10G的话可以改成float16 precision
import torch from torch import autocast from diffusers import StableDiffusionPipeline model_id = "CompVis/stable-diffusion-v1-1" device = "cuda" pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16) #pipe = StableDiffusionPipeline.from_pretrained(model_id, use_auth_token=True) pipe = pipe.to(device) prompt = "a photo of an astronaut riding a horse on mars" with autocast("cuda"): image = pipe(prompt, guidance_scale=7.5)["images"][0] image.save("astronaut_rides_horse.png") #To swap out the noise scheduler, pass it to from_pretrained:
要交换噪声调度器，将其传递给from_pretrained：
import torch from diffusers import StableDiffusionPipeline, LMSDiscreteScheduler model_id = "CompVis/stable-diffusion-v1-1" # Use the K-LMS scheduler here instead scheduler = LMSDiscreteScheduler(beta_start=0.00085, beta_end=0.012, beta_schedule="scaled_linear", num_train_timesteps=1000) pipe = StableDiffusionPipeline.from_pretrained(model_id, scheduler=scheduler, use_auth_token=True) pipe = pipe.to("cuda") prompt = "a photo of an astronaut riding a horse on mars" with autocast("cuda"): image = pipe(prompt, guidance_scale=7.5)["images"][0] image.save("astronaut_rides_horse.png")
哈哈啊哈啊
PS：huggingface-cli: command not found
参考
CompVis/stable-diffusion-v1-1（Hugging Face）
模型方法–Stable Diffusion
CompVis/stable-diffusion（github）
Stable Diffusion with ? Diffusers