2022-06-27 19:46:04 +00:00
# min(DALL·E)
2022-06-27 17:38:35 +00:00
2022-07-01 23:12:43 +00:00
[](https://colab.research.google.com/github/kuprel/min-dalle/blob/main/min_dalle.ipynb)
2022-06-29 19:24:09 +00:00
[](https://replicate.com/kuprel/min-dalle)
2022-07-01 23:12:43 +00:00
[](https://discord.gg/xBPBXfcFHd)
2022-06-27 21:26:05 +00:00
2022-07-01 18:06:50 +00:00
This is a minimal implementation of Boris Dayma's [DALL·E Mini ](https://github.com/borisdayma/dalle-mini ) in PyTorch. It has been stripped to the bare essentials necessary for doing inference. The only third party dependencies are numpy and torch.
2022-06-29 17:56:29 +00:00
2022-07-01 23:08:42 +00:00
It currently takes **7.4 seconds** to generate an image with DALL·E Mega on a standard GPU runtime in Colab.
2022-06-27 17:51:48 +00:00
2022-07-01 23:19:02 +00:00
The flax model and code for converting it to torch can be found [here ](https://github.com/kuprel/min-dalle-flax ).
2022-07-01 18:06:50 +00:00
2022-07-01 23:03:18 +00:00
## Install
2022-06-27 17:51:48 +00:00
2022-07-01 22:52:40 +00:00
```bash
2022-07-01 22:30:22 +00:00
$ pip install min-dalle
```
2022-06-27 21:26:05 +00:00
2022-07-01 23:03:18 +00:00
## Usage
2022-06-27 21:28:40 +00:00
2022-07-01 23:03:18 +00:00
### Python
2022-07-01 23:02:49 +00:00
2022-07-01 23:44:24 +00:00
To load a model once and generate multiple times, first initialize `MinDalle` .
2022-07-01 22:30:22 +00:00
2022-07-01 22:32:48 +00:00
```python
2022-07-01 23:44:24 +00:00
from min_dalle import MinDalle
2022-07-01 22:30:22 +00:00
2022-07-02 00:24:19 +00:00
model = MinDalle(is_mega=True, models_root='./pretrained')
2022-06-27 19:46:04 +00:00
```
2022-07-01 23:01:07 +00:00
The required models will be downloaded to `models_root` if they are not already there. After the model has loaded, call `generate_image` with some text and a seed as many times as you want.
2022-07-01 22:54:05 +00:00
2022-07-01 22:50:11 +00:00
```python
2022-07-01 23:08:42 +00:00
text = "a comfy chair that looks like an avocado"
image = model.generate_image(text)
2022-07-01 22:50:11 +00:00
display(image)
2022-06-27 17:38:35 +00:00
```
2022-07-01 22:51:06 +00:00
2022-06-27 17:38:35 +00:00
2022-07-01 22:50:11 +00:00
```python
2022-07-01 23:08:42 +00:00
text = "trail cam footage of gollum eating watermelon"
image = model.generate_image(text, seed=1)
2022-07-01 22:50:11 +00:00
display(image)
2022-06-27 17:38:35 +00:00
```
2022-07-01 23:15:31 +00:00
### Command Line
2022-07-01 23:19:02 +00:00
Use `image_from_text.py` to generate images from the command line.
2022-07-01 23:15:31 +00:00
```bash
$ python image_from_text.py --text='artificial intelligence' --seed=7
```
```bash
$ python image_from_text.py --text='court sketch of godzilla on trial' --mega
```
