tilelang

TileLang is a domain-specific language that makes that dramatically less painful. Writing CUDA or Triton kernels by hand is notoriously difficult. TileLang gives you a higher-level way to express tile-based computations (the pattern most GPU work follows) and compiles them down to optimized code for NVIDIA, AMD, and other accelerators.

Basically, it's a step above raw CUDA but below a full ML framework. You describe your computation in terms of tiles (blocks of data), and TileLang handles the memory management, thread scheduling, and hardware-specific optimizations that normally take weeks to get right.

Completely free and open source. No paid tier.

The catch: this is deeply specialized. If you're not writing custom GPU kernels, this tool has zero relevance to you. The target audience is ML researchers, HPC engineers, and framework developers, maybe a few thousand people globally. The project is young (, emerging), documentation is still maturing, and you'll need solid GPU programming knowledge to use it effectively. OpenAI's Triton is the more established alternative in this space, with a larger community and more learning resources. NVIDIA's CUTLASS is another option if you're locked to NVIDIA hardware.