Arm Announces Armv9 Architecture: SVE2, Security, and the Next Decade
by Andrei Frumusanu on March 30, 2021 2:00 PM EST
It’s been nearly 10 years since Arm had first announced the Armv8 architecture in October 2011, and it’s been a quite eventful decade of computing as the instruction set architecture saw increased adoption through the mobile space to the server space, and now starting to become common in the consumer devices market such as laptops and upcoming desktop machines. Throughout the years, Arm has evolved the ISA with various updates and extensions to the architecture, some important, some maybe glanced over easily.
Today, as part of Arm’s Vision Day event, the company is announcing the first details of the company’s new Armv9 architecture, setting the foundation for what Arm hopes to be the computing platform for the next 300 billion chips in the next decade.
The big question that readers will likely be asking themselves is what exactly differentiates Armv9 to Armv8 to warrant such a large jump in the ISA nomenclature. Truthfully, from a purely ISA standpoint, v9 probably isn’t an as fundamental jump as v8 was over v7, which had introduced a completely different execution mode and instruction set with AArch64, which had larger microarchitectural ramifications over AArch32 such as extended registers, 64-bit virtual address spaces and many more improvements.
Armv9 continues the usage of AArch64 as the baseline instruction set, however adds in a few very important extensions in its capabilities that warrants an increment in the architecture numbering, and probably allows Arm to also achieve a sort of software re-baselining of not only the new v9 features, but also the various v8 extensions we’ve seen released over the years.
The three new main pillars of Armv9 that Arm sees as the main goals of the new architecture are security, AI, and improved vector and DSP capabilities. Security is a very big topic for v9 and we’ll go into the new details of the new extensions and features into more depth in a bit, but getting DSP and AI features out of the way first should be straightforward.
Probably the biggest new feature that is promised with new Armv9 compatible CPUs that will be immediately visible to developers and users is the baselining of SVE2 as a successor to NEON.
Scalable Vector Extensions, or SVE, in its first implementation was announced back in 2016 and implemented for the first time in Fujitsu’s A64FX CPU cores, now powering the world’s #1 supercomputer Fukagu in Japan. The problem with SVE was that this first iteration of the new variable vector length SIMD instruction set was rather limited in scope, and aimed more at HPC workloads, missing many of the more versatile instructions which still were covered by NEON.
SVE2 was announced back in April 2019, and looked to solve this issue by complementing the new scalable SIMD instruction set with the needed instructions to serve more varied DSP-like workloads that currently still use NEON.
The benefit of SVE and SVE2 beyond addition various modern SIMD capabilities is in their variable vector size, ranging from 128b to 2048b, allowing variable 128b granularity of vectors, irrespective of what the actual hardware is running on. Purely from a view of vector processing and programming, it means that a software developer would only ever have to compile his code once, and if in the future a CPU would come out with say native 512b SIMD execution pipelines, the code would be able to already take advantage of the full width of the units. Similarly, the same code would be able to run on more conservative designs with a lower hardware execution width capability, which is important to Arm as they design CPUs from IoT, to mobile, to datacentres. It also does this all whilst remaining within the 32b encoding space of the Arm architecture, whereas alternative implementations such as on x86 have to add on new extensions and instructions depending on vector size.
Machine learning is also seen as an important part of Armv9 as Arm sees more and more ML workloads to become common place in the next years. Running ML workloads on dedicated accelerators naturally will still be a requirement for anything that is performance or power efficiency critical, however there still will be vast new adoption of smaller scope ML workloads that will run on CPUs.
Matrix multiplication instructions are key here and will represent an important step in seeing larger adoption across the ecosystem as being a baseline feature of v9 CPUs.
Generally, I see SVE2 as probably the most important factor that would warrant the jump to a v9 nomenclature as it’s a more definitive ISA feature that differentiates it from v8 CPUs in every-day usage, and that would warrant the software ecosystem to go and actually diverge from the existing v8 stack. That’s actually become quite a problem for Arm in the server space as the software ecosystem is still baselining software packages on v8.0, which unfortunately is missing the all-important v8.1 Large System Extensions.
Having the whole software ecosystem move forward and being able to assume new v9 hardware has the capability of the new architectural extensions would help push things ahead, and probably solve some of the current situation.
However v9 isn’t only about SVE2 and new instructions, it also has a very large focus on security, where we’ll be seeing some more radical changes.
Facebook
Twitter
RSS
74 Comments
View All Comments
HardwareDufus - Friday, April 2, 2021 - link
you are a rather offensive and unpleasant person.... why do you repeatedly say things like are you stupid, that sounds stupid, are you on drugs?can you find a nicer way to express your disagreement with what others have posted?
grant3 - Wednesday, March 31, 2021 - link
TSMC is a design-agnostic foundry. They build the highest performing x86 chips available. They will (presumably) continue to build x86 as long as a customer is willing to pay to have them built.I presume you're saying Apple is the 2nd biggest threat to x86 because they are transitioning away from x86 processors in their computers. But apple is transitioning TOWARDS arm architecture. So it's completely nonsensical to say "Apple (the company) is a bigger threat than ARM (an architecture)t" when they are both integral to the same transition.
Furthermore: Apple computers have used x86 architecture for a lot fewer years than they DID use x86 architecture. Apple's transition might by a *symptom* of x86 possibly approaching end-of-life, but it sure is not a CAUSE of it. Until Apple obtains a vast majority of personal & server computing market share, which would be unprecedented, it is not itself a threat to x86 remaining a highly-used computing architecture.
Ppietra - Wednesday, March 31, 2021 - link
Threats don’t come only from companies that can reduce x86 marketshare significantly and directly. Threats also come from companies that can change people/market perception about the need of x86 processors - that is actually the first step needed before the marketshare drops significantly. Apple is one of such companies and Intel has already demonstrated that it is indeed a threat (not a symptom).Kjella - Wednesday, March 31, 2021 - link
Apple might be transitioning but software companies rarely will, they'll go from some old assembler code to a higher level language where ARM/x86 code is a compile away. While I agree that there's been a lot of false starts, the M1 is causing a lot of spring cleaning in desktop-oriented companies who's managed to ignore smartphones/tablets like for example getting Adobe to make a native version of Photoshop. If you're indifferent about ARM or x86, that's a win for ARM.back2future - Thursday, April 1, 2021 - link
Customers who decide to buy that 300 billion devices on ARM v9.x ISA that next decade are final decision about production success. If these customers (generally) stay with x86/x64 this would balance statistics in different manner and on desktops or laptops there is availability for grown, mature programs for technical drawing and design, analysis, devices support, databases access or office related support software still an advantage for to decide. Mobile devices (Android) have wider variety of (useful) apps that fulfill smaller tasks for users (like access to IoT devices, that are probably bigger share of 300 billion devices 'til 2030, been 180 billion ARM SoCs 'til 2021)?No problem having ARM device beside x64 device, because there are cheap available of either ARMv9.x or x86/x64)
melgross - Saturday, April 10, 2021 - link
To Apple, the ARM cores are just a part of their SoC, and possibly not the most important part.SarahKerrigan - Tuesday, March 30, 2021 - link
If "going nowhere" means moving core volume that makes x86 look like small fry, making serious inroads in servers and HPC, and getting the buy-in of the most profitable PC OEM (Apple), sure. What were you expecting, that "ARM succeeding" means "x86 drops to zero in eight years"? "x86 is going to be the downfall of RISC/UNIX" was something that was being said when the 486 was new, and RISC/UNIX was still a majority of server revenue into the 2000s and is still big money (billions of dollars a year today.)Shifts take time, and even if x86 does enter terminal decline - and I'm not necessarily saying it will - desktop PCs will be the last part to go.
name99 - Tuesday, March 30, 2021 - link
Uhh, ARM IS the next big thing TODAY.Last time I checked the mobile market is a lot larger than the PC market...
You're like the guy who insists "microprocessors never won! IBM is still selling mainframes and they still kick ass". It's true. mainframes still sell, and still kick ass. But they don't define the state of computing.
Intel will be around for a long time supporting the "requires x86 market"; that was never in doubt. The point is, x86 no longer defines the interesting state of computing; it's fading away to mainframe status before our eyes.
Oh sure, there'll be a few more glory years -- peak IBM was 1985 -- but the pattern is laid out.
And are you incapable of understanding the article? SVE/2 WILL be available across the industry! That's a large part of the point of creating this new v9 branding and establishing a new baseline for the ARM community.
darkich - Wednesday, March 31, 2021 - link
Exactly.29a - Wednesday, March 31, 2021 - link
"ARM was prophacized in 2013 as the next big thing, and it went nowhere"I guess 99.999999999999% of mobile devices is nowhere?