Commit Graph

11 Commits

Author SHA1 Message Date
Brett Kuprel
1e18ba0ffa is_expendable argument reduces memory usage for command line script 2022-06-30 06:43:10 -04:00
Brett Kuprel
ed91ab4a30 refactored to load models once and run multiple times 2022-06-29 09:42:12 -04:00
Adam Novak
28c812c832 Use all logical cores in Torch mode 2022-06-28 22:26:51 -04:00
Brett Kuprel
1fbb209623 fixed bug with cuda in detokenizer 2022-06-28 22:02:35 -04:00
Brett Kuprel
764b0bc685 cuda in detokenizer from previous commit broke colab flax model, fixed 2022-06-28 21:36:48 -04:00
Brett Kuprel
17c96fe110 works with cuda 2022-06-28 21:28:36 -04:00
Brett Kuprel
9d6b6dcc92 previous commit broke flax model, fixed now 2022-06-28 12:54:58 -04:00
Brett Kuprel
5aa6fe49bf use cuda if available 2022-06-28 12:47:11 -04:00
Brett Kuprel
8544f59576 use cuda if available 2022-06-28 12:38:31 -04:00
Brett Kuprel
aef24ea157 torch.no_grad(), cleanup 2022-06-28 12:16:44 -04:00
Brett Kuprel
e7001f063c simplified 2022-06-27 15:46:04 -04:00