Skip to content

Does ONNX models used in this project supports CUDA only( crashes on CPU) #1

@JohnMasen

Description

@JohnMasen

HI,
I'm trying to run your models with CPU, the application crashes while loading the model.
To verify if these ONNX models could be loaded by CPU, I created a simple test app like this.

using Microsoft.ML.OnnxRuntime;
using Onnx;
SessionOptions options = new();
options.AppendExecutionProvider_CPU();
InferenceSession session = new InferenceSession(@"D:\Models\RWKV-4-Raven-3B-v11-Eng49-Chn49-Jpn1-Other1-20230429-ctx4096_32_2560_16.onnx", options);
Console.WriteLine("Done");
Console.ReadLine();

the application crashes with following exception

System.AccessViolationException: 'Attempted to read or write protected memory. This is often an indication that other memory is corrupt.'

Could you please kindly suggest if any thing I did wrong or the model bin file is designed for CUDA only?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions