Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log-space version #11

Open
kklemon opened this issue Oct 4, 2024 · 1 comment
Open

Log-space version #11

kklemon opened this issue Oct 4, 2024 · 1 comment

Comments

@kklemon
Copy link

kklemon commented Oct 4, 2024

Feng et al. proposed a log-space implementation of parallel scan for improved numerical stability. It should be fairly easy to implement, but I'm a bit out of practice with my CUDA skills and wanted to ask whether you don't already have it on your mind by any chance before I attempt an implementation by myself.

@proger
Copy link
Owner

proger commented Oct 5, 2024

Hi @kklemon! I did not need to make cuda implementations of log space scans because I usually was able to stabilize the recurrence and use addition instead of logsumexp/logadd.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants