Expected all tensors to be on the same device #2
Description
When I run transllm, I face this error:
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select).
I set the device_map with the default value: "auto"
Thanks for your help.