An AI data center (sometimes known as an AI factory) is a specialized data center facility designed for the computationally intensive tasks of training and running inference for artificial intelligence (AI) and machine learning models. Unlike general-purpose data centers, they are optimized for the parallel processing demands of AI workloads, typically utilizing hardware such as AI accelerators (e.g., GPUs, TPUs) and high-speed interconnects.
The global push to construct these specialized facilities accelerated dramatically during the AI boom of the 2020s. This demand has reshaped supply chains, driving memory manufacturers to prioritize production of High Bandwidth Memory (HBM) essential for AI servers, which has led to a global memory supply shortage, and triggering a broader competition for advanced chips, power, and infrastructure.
Architecture
Data centers for building and running large machine learning models contained specialized computer chips, GPUs, that used 2-4 times as much energy as their regular CPU counterparts (250-500 watts). Companies such as Google and Nvidia constructed GPUs specifically for
…
Source: Wikipedia
No Comments yet!