You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
out of memory when downloading models locally. #306
hello. i'm trying to use the models locally to avoid downloading them at each run.
using
DALLE_MODEL = "dalle-mini/dalle-mini/mega-1-fp16:latest"
DALLE_COMMIT_ID = None
works fine and gives me a result but it will download the models at each run.
but now it gives me a memory error :
Traceback (most recent call last):
File "dalle.py", line 44, in
params = replicate(params)
File "/mnt/shared/foss-20/dalle-mini/dallemini/lib/python3.8/site-packages/flax/jax_utils.py", line 56, in replicate
return jax.device_put_replicated(tree, devices)
File "/mnt/shared/foss-20/dalle-mini/dallemini/lib/python3.8/site-packages/jax/_src/api.py", line 2877, in device_put_replicated
return tree_map(_device_put_replicated, x)
File "/mnt/shared/foss-20/dalle-mini/dallemini/lib/python3.8/site-packages/jax/_src/tree_util.py", line 205, in tree_map
return treedef.unflatten(f(*xs) for xs in zip(*all_leaves))
File "/mnt/shared/foss-20/dalle-mini/dallemini/lib/python3.8/site-packages/jax/_src/tree_util.py", line 205, in
return treedef.unflatten(f(*xs) for xs in zip(*all_leaves))
File "/mnt/shared/foss-20/dalle-mini/dallemini/lib/python3.8/site-packages/jax/_src/api.py", line 2865, in _device_put_replicated
buf, = dispatch.device_put(x, devices[0])
File "/mnt/shared/foss-20/dalle-mini/dallemini/lib/python3.8/site-packages/jax/_src/dispatch.py", line 1024, in device_put
return device_put_handlers[type(x)](x, device)
File "/mnt/shared/foss-20/dalle-mini/dallemini/lib/python3.8/site-packages/jax/_src/dispatch.py", line 1055, in _device_put_device_array
x = _copy_device_array_to_device(x, device)
File "/mnt/shared/foss-20/dalle-mini/dallemini/lib/python3.8/site-packages/jax/_src/dispatch.py", line 1082, in _copy_device_array_to_device
moved_buf = backend.buffer_from_pyval(x.device_buffer.to_py(), device)
jaxlib.xla_extension.XlaRuntimeError: RESOURCE_EXHAUSTED: Out of memory while trying to allocate 402653184 bytes.
i have a Nvidia GTX 1080 with 8192 MB of memory.
but i wonder why it works when downloading the models. is it using a smaller part of it ?
sorry if all this are dumb questions.
Activity