Support TE's fused Rope kernels in custom models #606

Open

Assignees

Labels

Milestone

opened

Describe the solution you'd like
https://github.com/NVIDIA/TransformerEngine/blob/main/transformer_engine/pytorch/attention/rope.py

Metadata

Assignees

hemildesai

Labels

Type

No type

Projects

No projects

Milestone

26.02

Relationships

None yet

Development

No branches or pull requests