We’re collecting world-class triton kernels

Published:

You’re an AI researcher. You try different things, so you need different gpu kernels to make those things be fast (so you have shorter iteration cycles). But maybe other researchers have already written kernels for some parts of your ideas? And you’re no gpu expert yet, so where can you see examples of really good kernels to learn from?

To address these issues, Hailey Schoelkopf (not at Anthropic, then at EleutherAI) and I started triton-index.

The goals of triton-index are:

  • Catalog openly available Triton kernels, so
    • (i) practitioners save work and
    • (ii) learners have world-class examples to learn from.
  • Surface which Triton kernels are still needed by the community, so
    • (i) work of the community can be more targeted, and
    • (ii) eager people new to our community have projects to demonstrate their skill.

Feel free to use, share, and contribute!

And of course, let me know if we can make it better for you.

- Umer