min-dalle-test/README.md

30 lines
981 B
Markdown
Raw Normal View History

2022-06-27 19:46:04 +00:00
# min(DALL·E)
2022-06-27 17:38:35 +00:00
2022-06-27 17:51:48 +00:00
This is a minimal implementation of [DALL·E Mini](https://github.com/borisdayma/dalle-mini) in both Flax and PyTorch
2022-06-27 18:34:10 +00:00
### Setup
2022-06-27 17:51:48 +00:00
2022-06-27 18:34:10 +00:00
Run `sh setup.sh` to install dependencies and download pretrained models. The only required dependencies are `flax` and `torch`. In the bash script, GitHub LFS is used to download the VQGan detokenizer and the Weight & Biases python package is used to download the DALL·E Mini and DALL·E Mega transformer models. You can also download those files manually by visting the links in the bash script.
2022-06-27 17:51:48 +00:00
2022-06-27 18:34:10 +00:00
### Run
2022-06-27 17:51:48 +00:00
Here are some examples
2022-06-27 17:38:35 +00:00
```
2022-06-27 19:46:04 +00:00
python3 image_from_text.py --text='alien life' --seed=7
```
![Alien](examples/alien.png)
```
python3 image_from_text.py --mega --seed=4 \
2022-06-27 17:38:35 +00:00
--text='a comfy chair that looks like an avocado'
```
![Avocado Armchair](examples/avocado_armchair.png)
```
2022-06-27 19:46:04 +00:00
python3 image_from_text.py --mega --seed=100 \
2022-06-27 17:38:35 +00:00
--text='court sketch of godzilla on trial'
```
![Godzilla Trial](examples/godzilla_trial.png)