How much security, power, and cooling do data centers need?
In this InTechnology video, Tom and Camille talk with Matt Adiletta, Senior Fellow at Intel. They get into the growing scale of data centers, rising power and cooling needs, and the evolution of privacy and security in data center software.
The Growing Scale of Data Centers
Matt highlights the swift and continuous expansion of data centers as a pivotal trend for the future. The scale at which they’re growing today is truly remarkable. But with this scale, there arises an imperative for heightened consistency in performance, availability, and privacy within these centers. Matt believes it’s not just about the computational aspects of a server—it’s also about optimizing the network, storage, and the entire system. A notable shift he anticipates is the transition towards a singular, private network in the data center. This network will handle both AI data and standard data center tasks, eliminating the need for two separate networks.
Rising Power and Cooling Needs in Data Centers
As data centers expand, so does their demand for power and cooling. When you factor in the significant power requirements of large AI models on these centers, you’re looking at an exceptionally power-intensive system. One of the primary challenges for cloud service providers is devising ways to execute complex AI algorithms efficiently. Matt points out some of the latest advancements in server cooling, such as immersion cooling, single-phase cooling with cold plates, and two-phase cooling using engineered fluids.
Evolution of Privacy and Security in Software Architecture
Turning to the software aspect of data centers, there’s a wave of innovation concerning privacy and security. The focus on what’s essential in processing and networking is shifting. Matt notes how the future might see the infrastructure software being transitioned from the application processor to a dedicated infrastructure processor, termed an IPU (Infrastructure Processor Unit). This architectural shift necessitates changes in software handling and data movement, emphasizing the return to a singular network for ensuring security and efficiency in data centers.
Matt Adiletta, Senior Fellow at Intel
Matt Adiletta holds a tenure of over 25 years with Intel. Beginning in 1998, he stepped into the role of Senior Fellow at the Data Center Group Innovation Lab, spearheading advancements in silicon, architecture, software, and systems. As of 2021, he’s taken on additional responsibilities as the acting Data Center and Artificial Intelligence Chief Technology Officer. Before his career at Intel, Matt dedicated 13 years as a Consulting Engineer at Digital Equipment Corporation. He earned his Bachelor’s degree in Electrical Engineering from the University of Connecticut.
Check it out. For more information, previous podcasts, and full versions, visit our homepage.
To read more about cybersecurity topics, visit our blog.
#datacenter #cloud #AI
The views and opinions expressed are those of the guests and author and do not necessarily reflect the official policy or position of Intel Corporation.
—–
If you are interested in emerging threats, new technologies, or best tips and practices in cybersecurity, please follow the InTechnology podcast on your favorite podcast platforms: Apple Podcast and Spotify.
Follow our hosts Tom Garrison @tommgarrison and Camille @morhardt.
Learn more about Intel Cybersecurity and Intel Compute Life Cycle (CLA).