Tag Archives: matrix multiplication

Researchers upend AI status quo by eliminating matrix multiplication in LLMs

Enlarge / Illustration of a brain inside of a light bulb. reader comments 100 Researchers claim to have developed a new way to run AI language models more efficiently by eliminating matrix multiplication from the process. This fundamentally redesigns neural network operations that are currently accelerated by GPU chips. The findings, detailed in a recent… Read More »

Matrix multiplication breakthrough could lead to faster, more efficient AI models

Enlarge / When you do math on a computer, you fly through a numerical tunnel like this—figuratively, of course. reader comments 45 Computer scientists have discovered a new way to multiply large matrices faster than ever before by eliminating a previously unknown inefficiency, reports Quanta Magazine. This could eventually accelerate AI models like ChatGPT, which… Read More »

DeepMind breaks 50-year math record using AI; new record falls a week later

Enlarge / A colorful 3×3 matrix. Aurich Lawson / Getty Images reader comments 46 with 37 posters participating Share this story Matrix multiplication is at the heart of many machine learning breakthroughs, and it just got faster—twice. Last week, DeepMind announced it discovered a more efficient way to perform matrix multiplication, conquering a 50-year-old record.… Read More »