Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BF16 in CUDA builtins.hpp #15418

Open
jinz2014 opened this issue Sep 17, 2024 · 3 comments
Open

BF16 in CUDA builtins.hpp #15418

jinz2014 opened this issue Sep 17, 2024 · 3 comments
Labels
bug Something isn't working cuda CUDA back-end

Comments

@jinz2014
Copy link
Contributor

Describe the bug

BF16 is not added in
https://github.com/intel/llvm/blob/sycl/sycl/include/sycl/ext/oneapi/experimental/cuda/builtins.hpp

To reproduce

The error message is "no matching function for call to 'ldg'"

Environment

No response

Additional context

No response
@jinz2014 jinz2014 added bug Something isn't working cuda CUDA back-end labels Sep 17, 2024
@JackAKirk
Copy link
Contributor

Thanks, do you have an example cuda application that uses __ldg for bf16?

@jinz2014
Copy link
Contributor Author

Please see https://github.com/zjin-lcf/HeCBench/blob/master/src/addBiasResidualLayerNorm-sycl/

@JackAKirk
Copy link
Contributor

cc @npmiller

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working cuda CUDA back-end
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jinz2014 @JackAKirk