-
Notifications
You must be signed in to change notification settings - Fork 71
Description
Please input prompts:
text|image|A bustling medieval market scene with vendors selling exotic goods under colorful tents
Traceback (most recent call last):
File "/home/marsdy/AnyGPT/anygpt/src/infer/cli_infer_base_model.py", line 317, in interact
self.forward(prompt)
File "/home/marsdy/AnyGPT/anygpt/src/infer/cli_infer_base_model.py", line 308, in forward
response = self.response(modality, to_modality, input_data, voice_prompt)
File "/home/marsdy/AnyGPT/anygpt/src/infer/cli_infer_base_model.py", line 264, in response
input_ids = input_ids.to(self.device)
RuntimeError: CUDA error: out of memory
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.