Intro to Quantization
Published:
todo umer
Posts on AI
Making OpenAI Triton easier đ± đ
Published:
I find writing triton kernels involves many repetitive tasks, that can be cleanly abstracted away. This allows to write triton code much more in line with how I actually think. Itâs way more fun, and less mentally draining.
Weâre collecting world-class triton kernels
Published:
Youâre an AI researcher. You try different things, so you need different gpu kernels to make those things be fast (so you have shorter iteration cycles). But maybe other researchers have already written kernels for some parts of your ideas? And youâre no gpu expert yet, so where can you see examples of really good kernels to learn from?
A Practitionerâs Guide to Triton
Published:
For the cuda mode community, I gave a lecture titled âA Practitionerâs Guide to Tritonâ. My goal was to give the best possible intro to Triton, which to me means:
- tell you when youâd use it, and when to use something else
- clearly state what knowledge I assume and introduce everything else
- teach by practically working through examples, only adding a manageable amount of complexity each time
- guide you to places where you can learn more