This Food Does Not Exist 🍪🍰🍣🍹
We have trained four StyleGAN2 models to generate food pictures. The images below are purely synthetic!
The code optimized for TPU training as well as the pretrained models are openly available.
- 📝 Cherry-picked results, check out the Colab notebook to generate your own!
- 🛠 Or train your own model: https://github.com/nyx-ai/stylegan2-flax-tpu
- 🐦 Follow our Generative AI research: @NyxAI_Lab
Why not DALL·E/diffusion models? 🤔
Recent methods like diffusion and auto-regressive models are all the rage these days: DALL·E 2, Craiyon (formerly DALL·E mini), ruDALL-E… Why not go in this direction?
Realism vs control
StyleGAN models shine in terms of photorealism, as can be some by some of our food results. For another example, the website ThisPersonDoesNotExist.com produces very believable face images. While GANs are still better at this, diffusion models are catching up and this may change soon.
Diffusion models offer better control and flexibility, thanks in large part to text guidance. This comes at the cost of larger models and slower generation times.
We were able to train the provided models in less than 10h each using a single TPU v4-8:
FID (Fréchet inception distance) is a metric used to assess the quality of images created by a generative model.
In comparison, Craiyon is being training on a v3-256 TPU pod which means 32x the resources (albeit using the previous TPU generation) and the training has been going on for over a month.
Craiyon (“a pile of cookies on a plate”)
DALL·E 2 (“a pile of cookies on a plate”)