• 0 Posts
  • 4 Comments
Joined 2 years ago
cake
Cake day: June 21st, 2023

help-circle



  • I have to wonder if NPUs are just going to eventually become a normal part of the instruction set.

    When SIMD was first becoming a thing, it was advertised as accelerating “multimedia,” as that was the hot buzzword of the 1990s. Now, SIMD instructions are used everywhere, any place there is a benefit from processing an array of values in parallel.

    I could see NPUs becoming the same. Developers start using NPU instructions, and the compiler can “NPU-ify” scalar code when it thinks it’s appropriate.

    NPUs are advertised for “AI,” but they’re really just a specialized math coprocessor. I don’t really see this as a bad thing to have. Surely there are plenty of other uses.