Categories: Image

SUPIR (Super Resolution) – Tutorial to run it locally with around 10-11 GB VRAM

So, with a little investigation it is easy to do I see people asking Patreon sub for this small thing so I thought I make a small tutorial for the good of open-source:

A bit redundant with the github page but for the sake of completeness I included steps from github as well, more details are there: https://github.com/Fanghua-Yu/SUPIR

git clone https://github.com/Fanghua-Yu/SUPIR.git (Clone the repo)
cd SUPIR (Navigate to dir)
pip install -r requirements.txt (This will install missing packages, but be careful it may uninstall some versions if they do not match, or use conda or venv)
Download SDXL CLIP Encoder-1 (You need the full directory, you can do git clone https://huggingface.co/openai/clip-vit-large-patch14)
Download https://huggingface.co/laion/CLIP-ViT-bigG-14-laion2B-39B-b160k/blob/main/open_clip_pytorch_model.bin (just this one file)
Download an SDXL model, Juggernaut works good (https://civitai.com/models/133005?modelVersionId=348913 ) No Lightning or LCM
Skip LLaVA Stuff (they are large and requires a lot memory, it basically creates a prompt from your original image but if your image is generated you can use the same prompt)
Download SUPIR-v0Q (https://drive.google.com/drive/folders/1yELzm5SvAi9e7kPcO_jPp2XkTs4vK6aR?usp=sharing)
Download SUPIR-v0F (https://drive.google.com/drive/folders/1yELzm5SvAi9e7kPcO_jPp2XkTs4vK6aR?usp=sharing)
Modify CKPT_PTH.py for the local paths for the SDXL CLIP files you downloaded (directory for CLIP1 and .bin file for CLIP2)
Modify SUPIR_v0.yaml for local paths for the other files you downloaded, at the end of the file, SDXL_CKPT, SUPIR_CKPT_F, SUPIR_CKPT_Q (file location for all 3)
Navigate to SUPIR directory in command line and run “python gradio_demo.py –use_tile_vae –no_llava –use_image_slider –loading_half_params”