Commit Graph

28 Commits

Author SHA1 Message Date
Brett Kuprel
dba3f11b3f faster inference with cuda/cudnn backends flags 2022-07-09 06:48:51 -04:00
Brett Kuprel
703bfb231d detach unnecessary 2022-07-08 13:26:53 -04:00
Brett Kuprel
985c5fad4c removing unused import 2022-07-08 09:50:13 -04:00
Brett Kuprel
24162ee717 change grid_size argument of generate_images to image_count 2022-07-07 20:21:43 -04:00
Brett Kuprel
736904ef2f fix typing 2022-07-07 17:18:30 -04:00
Brett Kuprel
2cac9220b5 generate_images_stream and generate_images 2022-07-07 17:03:47 -04:00
Brett Kuprel
c199507a7a vqgan needs to be float32 2022-07-07 08:53:27 -04:00
Brett Kuprel
da62298f06 support bfloat16 2022-07-07 08:21:20 -04:00
Brett Kuprel
f071b31bdd properly limit input to 64 tokens 2022-07-05 22:14:19 -04:00
Brett Kuprel
89a125b4b9 control top_k value 2022-07-05 17:23:05 -04:00
Brett Kuprel
ba6080668f update readme 2022-07-05 07:44:42 -04:00
Brett Kuprel
9a4d9dc118 remove unused imports 2022-07-05 06:31:01 -04:00
Brett Kuprel
6d81d514a0 control super condition factor 2022-07-04 21:30:27 -04:00
Brett Kuprel
5f4815775b generate_image_stream 2022-07-04 20:02:33 -04:00
Brett Kuprel
97d22f0fdd handle log2_mid_count=0 2022-07-04 17:46:31 -04:00
Brett Kuprel
1702d3c439 log2_mid_count 2022-07-04 17:27:23 -04:00
Brett Kuprel
0d9998926d display intermediate images 2022-07-04 16:06:49 -04:00
Brett Kuprel
deefd24919 decode_row 2022-07-04 09:58:00 -04:00
Brett Kuprel
377d15cb16 faster decoder self attention 2022-07-04 08:05:55 -04:00
Brett Kuprel
256fd1aab0 empty cache if cuda available 2022-07-04 07:21:54 -04:00
w4ffl35
7d549505da Fixes #16 - mega model running out of memory
Prior to this fix the mega model will (more often than not) fail when running in succession.

Clearing the cache seems to fix the issue.
2022-07-04 00:26:17 -06:00
Brett Kuprel
313635e914 fixed typing error for older python versions 2022-07-02 09:06:22 -04:00
Brett Kuprel
1eb56737d8 added grid_size parameter to generate a grid of images 2022-07-02 08:45:49 -04:00
Brett Kuprel
cf9656baa2 added is_verbose flag 2022-07-01 20:17:20 -04:00
Brett Kuprel
35e97768a5 v0.2.0, MinDalleTorch -> MinDalle, breaking change 2022-07-01 19:44:24 -04:00
Brett Kuprel
1e18ba0ffa is_expendable argument reduces memory usage for command line script 2022-06-30 06:43:10 -04:00
Brett Kuprel
61cc99c13c read tokenizer files with utf8 encoding 2022-06-29 14:18:23 -04:00
Brett Kuprel
ed91ab4a30 refactored to load models once and run multiple times 2022-06-29 09:42:12 -04:00