tanner/min-dalle-test
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

update readme

Browse Source
This commit is contained in:
Brett Kuprel 2022-07-01 19:08:42 -04:00
parent 847daa5be2
commit cc9bdb8f7b
1 changed files with 9 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
README.md vendored
View File

@ -5,9 +5,9 @@
This is a minimal implementation of Boris Dayma's [DALL·E Mini](https://github.com/borisdayma/dalle-mini) in PyTorch. It has been stripped to the bare essentials necessary for doing inference. The only third party dependencies are numpy and torch. This is a minimal implementation of Boris Dayma's [DALL·E Mini](https://github.com/borisdayma/dalle-mini) in PyTorch. It has been stripped to the bare essentials necessary for doing inference. The only third party dependencies are numpy and torch.
It currently takes **7.4 seconds** to generate an image with DALL·E Mega on a standard GPU runtime in Colab It currently takes **7.4 seconds** to generate an image with DALL·E Mega on a standard GPU runtime in Colab.
The flax model, and the code for coverting it to torch can be found [here](https://github.com/kuprel/min-dalle-flax). The flax model and the code for coverting it to torch can be found [here](https://github.com/kuprel/min-dalle-flax).
## Install ## Install
@ -32,9 +32,10 @@ $ python image_from_text.py --text='court sketch of godzilla on trial' --mega
``` ```
![Godzilla Trial](examples/godzilla_on_trial.png) ![Godzilla Trial](examples/godzilla_on_trial.png)
### Python ### Python
To load a model once and generate multiple times, first initialize `MinDalleTorch` To load a model once and generate multiple times, first initialize `MinDalleTorch`.
```python ```python
from min_dalle import MinDalleTorch from min_dalle import MinDalleTorch
@ -46,19 +47,19 @@ model = MinDalleTorch(
) )
``` ```
The required models will be downloaded to `models_root` if they are not already there. After the model has loaded, call `generate_image` with some text and a seed as many times as you want. The required models will be downloaded to `models_root` if they are not already there. After the model has loaded, call `generate_image` with some text and a seed as many times as you want.
```python ```python
image = model.generate_image("a comfy chair that looks like an avocado") text = "a comfy chair that looks like an avocado"
image = model.generate_image(text)
display(image) display(image)
``` ```
![Avocado Armchair](examples/avocado_armchair.png) ![Avocado Armchair](examples/avocado_armchair.png)
```python ```python
image = model.generate_image( text = "trail cam footage of gollum eating watermelon"
"trail cam footage of gollum eating watermelon", image = model.generate_image(text, seed=1)
seed=1
)
display(image) display(image)
``` ```
![Gollum Trailcam](examples/gollum_trailcam.png) ![Gollum Trailcam](examples/gollum_trailcam.png)