February 20, 2024

Byte Class Technology

Byte Class Technology & Sports Update

Intel DCAI 2023 Update New Technology and Updated Xeon Roadmap

Intel DCAI 2023 Update New Technology and Updated Xeon Roadmap

4th Generation Intel Xeon Scalable Sapphire Rapids 1
4th Technology Intel Xeon Scalable Sapphire Rapids 1

Currently we have an update from Intel about its details middle and AI enterprise. We have been pre-briefed on the update but will be covering the party reside. Hope to hear a lot more about Intel Xeon roadmap updates as nicely as new technologies, including the MCR DIMM or Multiplexer Mixed Ranks DIMM that we lined not too long ago.

Be aware, this is currently being protected reside so remember to justification typos.

Intel DCAI 2023 Update New Technologies and Up-to-date Xeon Roadmap

A massive element of today’s function is focused on the trader community, so there is a big part of this that is on the TAM for DCAI or marketplace opportunity.

Intel DCAI Update March 2023 Data Center TAM
Intel DCAI Update March 2023 Info Center TAM

Intel mentioned that it is likely to improve cores for each socket and so it expects its main progress to comply with field tendencies even if sockets development is diverse.

Intel DCAI Update March 2023 CPU Core Trends
Intel DCAI Update March 2023 CPU Core Trends

Intel says it is going to speed up its main density faster than it had been. In this article is the Updated AMD EPYC and Intel Xeon Main Counts About Time check out that we shared before this 12 months.

Intel And AMD Core Count Growth For Mainstream Servers 2013 2023 With SPEC Callouts
Intel And AMD Core Count Progress For Mainstream Servers 2013 2023 With SPEC Callouts

Intel reported it plans to raise ASP to seize the benefit of getting more cores. It will also seize the worth from other portfolio IP.

Intel DCAI Update March 2023 Portfolio
Intel DCAI Update March 2023 Portfolio

Intel says that the market place has developed to assistance the two higher-performance cores as very well as lessen-effectiveness dense cores.

Intel DCAI Update March 2023 Data Center Infrastructure Requirements
Intel DCAI Update March 2023 Facts Center Infrastructure Necessities

Intel is talking about P-main “Rapids” merchandise and E-main “Forest” chips.

Intel DCAI Update March 2023 P Core Rapids And E Core Forest
Intel DCAI Update March 2023 P Main Rapids And E Core Forest

Intel claims it strategies to re-use I/O chiplets and memory controllers between Rapids and Forest products and solutions. Intel would seem to be subsequent AMD EPYC’s IO Die-like models.

Intel states that it has 450+ 4th Gen Intel Xeon Scalable “Sapphire Rapids” types, but fewer than fifty percent of these are at present in the marketplace. Intel suggests that the crossover for SPR quantity will occur mid-year. It also hopes when China comes back and when enterprises get started shelling out less cautiously that it will support raise income.

Intel DCAI Update March 2023 4th Gen Xeon Scalable Update
Intel DCAI Update March 2023 4th Gen Xeon Scalable Update

Intel is exhibiting a demo working with Intel AMX acceleration to present how its chips can be a lot quicker than AMD EPYC components. You can master much more about that in: Fingers-on Benchmarking with Intel Sapphire Rapids Xeon Accelerators.

Later this year is the Emerald Rapids. Below is that chip. I missed the <5 second clip of the chip close up.

Intel DCAI Update March 2023 Emerald Rapids
Intel DCAI Update March 2023 Emerald Rapids

Emerald Rapdis will be the 5th Gen Intel Xeon Scalable series. It is a drop-in replacement for Sapphire Rapids servers. This is different than the Ice Lake generation which was a single-generation platform.

Intel DCAI Update March 2023 Emerald Rapids 2
Intel DCAI Update March 2023 Emerald Rapids 2

5th Gen Xeon Scalable will be on Intel 7.

Sierra Forest in the first half of 2024. Granite Rapids shortly thereafter. Granite Rapids will be on Intel 3.

Intel DCAI Update March 2023 Granite Rapids
Intel DCAI Update March 2023 Granite Rapids

Granite Rapids will have MCR DIMMs. Those will offer 1.5TB/s of memory bandwidth in a dual-socket server.

Intel DCAI Update March 2023 MCR DIMM Bandwidth 1.5TB
Intel DCAI Update March 2023 MCR DIMM Bandwidth 1.5TB

Here is DDR5-8800 running with Intel MLC:

Intel DCAI Update March 2023 MCR DIMM Bandwidth In Granite Rapids
Intel DCAI Update March 2023 MCR DIMM Bandwidth In Granite Rapids

Intel’s Sierra Forest is expected in 1H’24. We usually expect “1H” to mean June based on previous launches. This will be an Intel 3 platform.

Intel DCAI Update March 2023 Sierra Forest
Intel DCAI Update March 2023 Sierra Forest

Sierra Forest is 144 cores and is booting OSes and running stress-ng.

Intel DCAI Update March 2023 Sierra Forest HTOP With Stress Ng
Intel DCAI Update March 2023 Sierra Forest HTOP With Stress Ng

Clearwater Forest in Intel 18A in 2025. This is the next E-core design.

Here is the Xeon roadmap between now and 2025.

Intel DCAI Update March Xeon Roadmap
Intel DCAI Update March Xeon Roadmap

Here is the DCAI Roadmap including other products. I asked about the lack of HBM accelerators. Intel told me that they will be addressing higher performance memory updates in the future.

Intel DCAI Update March 2023 DCAI Roadmap
Intel DCAI Update March 2023 DCAI Roadmap

Something to note here is that the GPU, Habana Gaudi AI accelerator and FPGAs are continuing. 15 new FPGAs in 2023 is a lot.

Here is Intel’s AI Accelerator TAM:

Intel DCAI Update March 2023 AI Accelerator TAM
Intel DCAI Update March 2023 AI Accelerator TAM

Intel is talking about OneAPI and SYCL. The pace of this is fast enough that we are going to leave most of that for others since there is not as much being announced here and seems like it is more of a recap.

More to come as the event progresses.

Final Words

There is a lot in here. The P-core versus E-core mix is something we are really interested in at STH. Intel gave us a wide range of the expected future mix of P-cores versus E-cores that it could be shipping in a few years. To be frank, I am much more excited about Sierra Forest than Emerald Rapids at this point. As we increase the number of dedicated accelerators in the ecosystem, having E-cores alongside accelerators may make sense. Also, there are many servers simply running nginx serving web pages that do not need optimizations for high-performance computing.

Intel DCAI Update March 2023 Summary
Intel DCAI Update March 2023 Summary

I asked about what the IO Die or Tile will be called. Intel told me that the exact name is not finalized.