Decoding Reponse for extra-single-image requests

[SolusGod]

Hello Automatic's community! I'm no coder but I finally figured out how to do im2img from API in Python but I am at the precipice of another great breakthrough in human advancement...or at least it feels like it for none-coders lol

Like I said, I figured out how to do img2img but now I can't figure out how to decode the response request of the extra-single-image API into an image variable.

in img2img here's how I would decode it.

response = requests.post(url=f'{url}/sdapi/v1/img2img', json=payload)

r = response.json()

for i in r['images']:
    image = Image.open(io.BytesIO(base64.b64decode(i.split(",",1)[0])))#<<< this decodes the response.json() into a coherent image.

However, doing the same thing in a extra-single-image response gives out missing "images" key. I assume it's because img2img deals in lists but extra-single-image works in a single image variable. (I wouldn't know though lol)

response = requests.post(url=f'{url}/sdapi/v1/extra-single-image', json=payload)

r = response.json()

for i in r['images']:
    image = Image.open(io.BytesIO(base64.b64decode(i.split(",",1)[0])))

So the question remains for those who are blessed. How would I go about converting the returned response I get from response = requests.post(url=f'{url}/sdapi/v1/extra-single-image', json=payload) into an image variable?

P.S. The API docs don't contain practical examples of how the codes would be used so that doesn't help.
P.S. I'll attach the img2img script that worked for me below just so I'm giving back to this community!

import json
import requests
import io
import base64
from PIL import Image, PngImagePlugin
from io import BytesIO

url = "Gradio URL"

pil_image = Image.open("C:\\Users\\User\\path.png")
#Convert image to base64
def pil_to_base64(pil_image):
    with BytesIO() as stream:
        pil_image.save(stream, "PNG", pnginfo=None)
        base64_str = str(base64.b64encode(stream.getvalue()), "utf-8")
        return "data:image/png;base64," + base64_str


payload = {
    "init_images": [pil_to_base64(pil_image)],#Plug converted Image to Payload
    "prompt": "",
    "negative_prompt": "",
    "steps": 50,
    "denoising_strength": 0.95,
    #"mask": "string",
    #"mask_blur": 4,
    #"inpainting_fill": 0,
    #"inpaint_full_res": True,
    #"inpaint_full_res_padding": 0,
    #"inpainting_mask_invert": 0,
    #"initial_noise_multiplier": 0,
    #"styles": ["string"],
    "seed": -1,
    "sampler_name": "Euler a",
    "cfg_scale": 7,
    "width": 512,
    "height": 512,
    #"restore_faces": False,
    #"tiling": False,
    #"override_settings": {},
    #"override_settings_restore_afterwards": True,
    #"include_init_images": False
}

response = requests.post(url=f'{url}/sdapi/v1/img2img', json=payload)

r = response.json()

for i in r['images']:
    image = Image.open(io.BytesIO(base64.b64decode(i.split(",",1)[0])))

    png_payload = {
        "image": "data:image/png;base64," + i
    }
    response2 = requests.post(url=f'{url}/sdapi/v1/png-info', json=png_payload)

    pnginfo = PngImagePlugin.PngInfo()
    pnginfo.add_text("parameters", response2.json().get("info"))
    image.save('output.png', pnginfo=pnginfo)

[westmancurtis]

You are correct, it's because it doesn't return a list, it returns a single dict.

response = requests.post(url=f'{url}/sdapi/v1/extra-single-image', json=payload)

r = response.json()
   
image = Image.open(io.BytesIO(base64.b64decode(r['image'].split(",",1)[0])))

FYI, you can browse all the API request/response details on your local install at 127.0.0.1:7860/docs

[SolusGod]

Hey, West, I appreciate the insight! When I plug in the code it still gives out an error

Here's the code:

import json
import requests
import io
import base64
from PIL import Image, PngImagePlugin
from io import BytesIO

url = "Gradio URL"


    
pil_image = Image.open("...\\output.png")
#Convert image to base64
def pil_to_base64(pil_image):
    with BytesIO() as stream:
        pil_image.save(stream, "PNG", pnginfo=None)
        base64_str = str(base64.b64encode(stream.getvalue()), "utf-8")
        return "data:image/png;base64," + base64_str

payload = {
"resize_mode": 0,
  "show_extras_results": True,
  "gfpgan_visibility": 0,
  "codeformer_visibility": 0,
  "codeformer_weight": 0,
  "upscaling_resize": 2,
  "upscaling_resize_w": 512,
  "upscaling_resize_h": 512,
  "upscaling_crop": True,
  "upscaler_1": "None",
  "upscaler_2": "None",
  "extras_upscaler_2_visibility": 0,
  "upscale_first": False,
  "image": [pil_to_base64(pil_image)]
}

response = requests.post(url=f'{url}/sdapi/v1/extra-single-image', json=payload)

r = response.json()

Variable= Image.open(io.BytesIO(base64.b64decode(r['image'].split(",",1)[0]))) <<< Error happens here ('image')
    
Variable.save('Upscaled.png')

P.S. The API request/response docs don't really help me because I don't understand their structure. I just learnt Python a week ago just to make this addon I'm working on!

P.S.2 I forgot to mention that I'm plugging the script into Blender's python. I don't know if that makes a tangible difference to the code request/response structure.

[westmancurtis]

Oh, I would wager it has to do with the payload you're providing, then. There's no "image" key in the response because the response is probably an error.

It appears you're attaching the image to the payload in a list [] format rather than a str format. Try removing the square brackets around pil_to_base64(pil_image).

[SolusGod]

I figured it out!!! Thank you so much West! Maybe I'll let you try out my addon when it's done 👯‍♂️ :D

[kaushal101]

This helped me as well in using this API, thanks a lot @westmancurtis

I had just one additional question. I'm able to save the output PNG this way, but these PNGs are usually far too large for my purpose. If I was generating from WebUI, I would usually delete the PNG and just retain the much smaller size JPG.

Is there any way to save the smaller JPG while using the API in a similar way? If not, would it be possible to convert the newly generated PNG into smaller JPG using API by any chance?

[kaushal101]

Never mind, I got it :)

I can save JPEG instead of PNG, just by using below command, and it works:

image.save(targetimage, 'JPEG')