PrtYBLKiTTy Gets High Through...

[PRtyBlkKitty]

this morsel scratched a little itch..

High throughput and memory efficient Transformers (GitHub Repo)

As Transformers have started to gain more and more traction, they are being served far more often than trained. This can be quite slow and expensive, but with some clever optimizations around memory layout on GPU, they get many multiples faster.

Thanks TLDR Andrew Tan & Andrew Carr

and impressive @kjannette So many commits, so little time