3

Interactive Exploration of Stable Diffusion-Generated Images

Interactive Exploration of Stable Diffusion-Generated Images

I just created a Huggingface Space showcasing how to interactively explore the outputs of a Stable Diffusion model via CLIP Embeddings. Probably this could be similarly applied to midjourney generated images as well.

Embedding-based image similarity plotted in 2D via dimensionality reduction.

The visualization is done using the tool Spotlight.

Also, I created a tutorial showcasing how to automatically select promising prompts and images from a large dataset. It is roughly based on the following approach:

  1. Calculate the CLIP Score for all prompt-image pairs to measure generation quality.
  2. Generate CLIP Embeddings to be able to calculate a similarity between images (or texts)
  3. Embedding-based identification of clusters that have an exceptionally high CLIP Score.

Have you ever explored any (automatic) evaluation strategies for image generation models? I would love to learn about some alternative approaches.

submitted by /u/OkResearch6289
[link] [comments]
https://www.reddit.com/r/midjourney/comments/154qsrn/interactive_exploration_of_stable/