Intel Launches 5th Generation “Emerald Rapids” Xeon Processors

Emerald Rapids introduces comprehensive support for Intel's range of silicon security features, including Intel Trust Domain Extensions (Intel TDX). This enhancement significantly fortifies confidentiality and security at the virtual machine (VM) level. By isolating guest operating systems and VM applications from cloud host and hypervisor access, it provides an extra layer of protection.

This advancement in 5th Gen Xeon processors holds significant implications for both customers and the IT channel. For customers, the pin-compatibility with the previous generation facilitates seamless infrastructure upgrades, offering a means to enhance systems while curbing costs and reducing carbon emissions.

Embedded acceleration technology

One of the standout features of Emerald Rapids is its embedded acceleration technology, catering to various workloads. Specifically engineered accelerators targeting compression, encryption, and data analytics tasks boost performance. The processors' flexibility in configuring different accelerator 'devices' ensures adaptability based on workload demands. Technologies like Intel Advanced Matrix Extensions (Intel AMX) and Intel QuickAssist Technology (Intel QAT) highlight Intel's commitment to tailoring performance enhancements for specific applications. Leveraging accelerators, these processors yield up to a 42% increase in inference performance with low latency, especially for large language models (LLMs).

Additionally, Intel's unveiling of the Gaudi3 accelerator, part of the Gaudi technology acquired through Habana Labs in 2019, further amplifies its AI processing capabilities. With a dual-chiplet design and multiple HBM3 (or HBM3E) memory stacks, the Gaudi3 aims to significantly augment AI workloads compared to its predecessor, Gaudi2. Intel plans to release the Gaudi3 in 2024, boasting four times higher BF16 performance, doubled networking speed, and 1.5 times higher bandwidth.

Generative AI hardware

Capitalising on the escalating demand for generative AI hardware, Intel aims to expand its share of the accelerator market in 2024, leveraging the competitive total cost of ownership (TCO) and reasonable pricing of its Gaudi lineup.

Moreover, Intel has outlined its roadmap for 2025, intending to consolidate GPU and Gaudi capabilities into a product termed Falcon Shores. This strategic move aims to further broaden its AI processing offerings, aligning with evolving market needs and technological advancements.