We use cookies to improve your online experience. By continuing browsing this website, we assume you agree our use of cookies.
Home
Products
Hot Stock
TI Hot parts
CHIP/IC
CHIP / IC
Active devices
Diode / Transistor Crystal oscillator
Passive device
Capacitor Resistor Inductor
Components
Switch Connector Potentiometer LED/Nixie tube Bridge Rectifiers Connecting cables Relay Module Fuse tube PCB boards Speakers/Pickup Transmitter/receiver Component combination Other components
MORE
MORE (1) MORE (2) MORE (3) MORE (4) MORE (5)
OTHER
OTHER IC
.
XT Series
UA Series
LT Series
HM Series
PI Series
KM Series
WD Series
RP Series
FK Series
FS Series
DC Series
TD Series
FP Series
AI Series
VB Series
CH Series
TJ Series
EP Series
DD Series
KK Series
NR Series
JF Series
UN Series
TY Series
CJ Series
LN Series
BD Series
KD Series
UY Series
LK Series
ET Series
UB Series
CT Series
VT Series
TE Series
HV Series
DK Series
UP Series
FO Series
KX Series
US Series
VM Series
XS Series
GM Series
SS Series
HP Series
PR Series
DE Series
VL Series
VW Series
MT Series
AL Series
GL Series
XC Series
UL Series
EF Series
HC Series
DH Series
AO Series
TG Series
PM Series
RF Series
GN Series
LY Series
BZ Series
BT Series
IM Series
UG Series
IT Series
PW Series
SH Series
HR Series
HI Series
HZ Series
BN Series
IC Series
IS Series
AE Series
PN Series
VP Series
GD Series
AB Series
CW Series
Hot Stock
RFQ
Contact Us
Who We Are
What We Do
Industry News
Home > Industry News

Arithmetic behemoths consume a staggering amount of energy: the total power consumption of NVIDIA's H100 AI chip will be more than that of a small Eur

Views : 39
Update time : 2024-01-08 18:05:45
        With the rapid development of artificial intelligence, the demand for computing power continues to climb. NVIDIA's AI processor H100 is a big seller in the market, however, the peak power consumption of each H100 is as high as 700 watts, which exceeds the average power consumption of an average American household. If a large number of H100 are deployed, experts predict that their total power consumption will be comparable to a large      American city or even exceed that of some small European countries.
        France's Schneider Electric estimated last October that the total power consumption of data centers used for AI applications is already comparable to the entire country of Cyprus. So what exactly is the power consumption of one of the hottest AI processors, NVIDIA's H100?
        Paul Churnock, Principal Electrical Engineer, Data Center Technology Governance and Strategy at Microsoft, posted on Leaderboard, "NVIDIA's H100 GPUs have a peak power consumption of 700 watts, which is equivalent to the average power usage of a US household (assuming 2.51 people per household) at 61% annual utilization. NVIDIA expects H100 sales to reach between 1.5 and 2 million units by the end of 2024. Ranked by the city's residential electricity consumption, H100 will rank fifth in the nation in total power consumption, behind Houston and ahead of Phoenix."
        Based on a 61% annual utilization rate, each H100 will consume about 3,740 kilowatt-hours (kWh) of electricity per year. If NVIDIA sells 1.5 million H100s in 2023 and 2 million in 2024, there will be 3.5 million H100 chips deployed by the end of 2024. The total annual power consumption of these chips would be a staggering 13.091 billion kilowatt-hours (GWh), or 13,091.82 gigawatt-hours.
        In comparison, countries such as Georgia, Lithuania or Guatemala also have an average annual power consumption of about 13,092 GWh. While the H100's power consumption is alarming, it's worth noting that AI and high-performance computing (HPC) GPUs are becoming more efficient. So while NVIDIA's next-generation B100 chip with the Blackwell architecture may consume more power than H100, it will also offer higher performance, resulting in more work being done with fewer units of power.
        With the development of AI technology, the important topics that need to be addressed between the pursuit of balance between arithmetic power and energy consumption have become urgent.
 
Previous :
Next :
Related News
Read More >>
Qingming Festival holiday notice Qingming Festival holiday notice
Apr .02.2024
On April 4th, it is the traditional Chinese festival Qingming Festival. According to traditional customs, we will return to our hometown to worship, ancestor worship, and tomb sweeping. We will enjoy a three-day holiday and return to our hometown to worsh
Microchip Technology Announces Qi® v2.0 Compliant, dsPIC33-Based Reference Designs Microchip Technology Announces Qi® v2.0 Compliant, dsPIC33-Based Reference Designs
Mar .30.2024
Microchip has officially released the ISO 26262 functional safety package for dsPIC33C digital signal controllers (DSC), PIC18, and AVR microcontrollers (MCU), accelerating the development of safety critical designs for ASIL B and ASIL C safety levels and
Easter Notice Easter Notice
Mar .29.2024
During the Easter holiday, SIC Electronics’ companies in the United States, Hong Kong, and the United Kingdom are on holiday, but employees of the Chinese company work normally.
Infineon launches low-cost, low-power, long-distance Bluetooth module CYW20822-P4TAI040 Infineon launches low-cost, low-power, long-distance Bluetooth module CYW20822-P4TAI040
Mar .28.2024
Infineon Technology Co., Ltd. recently announced the launch of the latest Bluetooth module CYW20822-P4TAI040, which has achieved new breakthroughs in low power consumption and coverage, promoting the further development of wireless connection technology i
Email