Intel and AMD finally realize that the CPU needs to do matrix algebra. They created ACE CPU extensions, a set of CPU instructions for doing matrix computing in the CPU.
The real problem of the CPU is the #C pointer logic which does not look at memory as chunks like arrays, instead it treats memory as addresses that are pointed at one at a time. Fortran has always been faster than C in doing matrix computing, despite the fact that most operating systems are written in C or C pointer logic. A programming language, no matter how efficient it is in doing matrix computation, will have to either go through a C ABI or to write system call or to talk to the kernel (which is also written in C) in order to talk to the hardware.
In the era of AI, this C pointer ghost will haunt all devices making them slow in doing AI inferencing. The reason is simple, even if you don't use a C-like language to train or fine-tune AI and even if your choose a programming language that has no C-pointer logic in it, your hardware design and drivers, your OS, most available APIs and libraries, .. are all written in or built around C.
No comments:
Post a Comment