Categories: Image

SUPIR (Super Resolution) – Tutorial to run it locally with around 10-11 GB VRAM

So, with a little investigation it is easy to do I see people asking Patreon sub for this small thing so I thought I make a small tutorial for the good of open-source:

A bit redundant with the github page but for the sake of completeness I included steps from github as well, more details are there: https://github.com/Fanghua-Yu/SUPIR

  1. git clone https://github.com/Fanghua-Yu/SUPIR.git (Clone the repo)
  2. cd SUPIR (Navigate to dir)
  3. pip install -r requirements.txt (This will install missing packages, but be careful it may uninstall some versions if they do not match, or use conda or venv)
  4. Download SDXL CLIP Encoder-1 (You need the full directory, you can do git clone https://huggingface.co/openai/clip-vit-large-patch14)
  5. Download https://huggingface.co/laion/CLIP-ViT-bigG-14-laion2B-39B-b160k/blob/main/open_clip_pytorch_model.bin (just this one file)
  6. Download an SDXL model, Juggernaut works good (https://civitai.com/models/133005?modelVersionId=348913 ) No Lightning or LCM
  7. Skip LLaVA Stuff (they are large and requires a lot memory, it basically creates a prompt from your original image but if your image is generated you can use the same prompt)
  8. Download SUPIR-v0Q (https://drive.google.com/drive/folders/1yELzm5SvAi9e7kPcO_jPp2XkTs4vK6aR?usp=sharing)
  9. Download SUPIR-v0F (https://drive.google.com/drive/folders/1yELzm5SvAi9e7kPcO_jPp2XkTs4vK6aR?usp=sharing)
  10. Modify CKPT_PTH.py for the local paths for the SDXL CLIP files you downloaded (directory for CLIP1 and .bin file for CLIP2)
  11. Modify SUPIR_v0.yaml for local paths for the other files you downloaded, at the end of the file, SDXL_CKPT, SUPIR_CKPT_F, SUPIR_CKPT_Q (file location for all 3)
  12. Navigate to SUPIR directory in command line and run “python gradio_demo.py –use_tile_vae –no_llava –use_image_slider –loading_half_params”

and it should work, let me know if you face any issues.

You can also post some pictures if you want them upscaled, I can upscale for you and upload to

Thanks a lot for authors making this great upscaler available opn-source, ALL CREDITS GO TO THEM!

Happy Upscaling!

Edit: Forgot about modifying paths, added that

submitted by /u/SykenZy
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Fast Attention Kernels and Operator Fusion

Overview This post is divided into four parts; they are: • Operator Fusion • FlashAttention-Style…

11 hours ago

Getting Reliable Structured Outputs from LLMs: Validation, Retries and Constrained Decoding

The fixture suite turns the sentences above into fourteen test cases, from a missing required…

11 hours ago

Theoretical Limits of Language Model Alignment

Language model (LM) alignment improves model outputs to reflect human preferences while preserving the capabilities…

11 hours ago

Deploy frontier AI models on AWS Trainium with SGLang-Neuron

Today, Amazon announced that SGLang-Neuron is publicly available and can be accessed through an AWS…

11 hours ago

‘Bring Back THE Boss’: Nvidia Employees Petition for Jensen Huang’s Return

An internal post urging the board to consider employee sentiment about Nvidia’s former CEO has…

12 hours ago

Inside this quantum computer, memory vibrates like a guitar string

Researchers have created a quantum computer that stores information in microscopic vibrations, potentially making quantum…

12 hours ago