We use cookies to improve your online experience. By continuing browsing this website, we assume you agree our use of cookies.
Home
Products
Hot Stock
TI Hot parts
CHIP/IC
CHIP / IC
Active devices
Diode / Transistor Crystal oscillator
Passive device
Capacitor Resistor Inductor
Components
Switch Connector Potentiometer LED/Nixie tube Bridge Rectifiers Connecting cables Relay Module Fuse tube PCB boards Speakers/Pickup Transmitter/receiver Component combination Other components
MORE
MORE (1) MORE (2) MORE (3) MORE (4) MORE (5)
OTHER
OTHER IC
.
XT Series
UA Series
LT Series
HM Series
PI Series
KM Series
WD Series
RP Series
FK Series
FS Series
DC Series
TD Series
FP Series
AI Series
VB Series
CH Series
TJ Series
EP Series
DD Series
KK Series
NR Series
JF Series
UN Series
TY Series
CJ Series
LN Series
BD Series
KD Series
UY Series
LK Series
ET Series
UB Series
CT Series
VT Series
TE Series
HV Series
DK Series
UP Series
FO Series
KX Series
US Series
VM Series
XS Series
GM Series
SS Series
HP Series
PR Series
DE Series
VL Series
VW Series
MT Series
AL Series
GL Series
XC Series
UL Series
EF Series
HC Series
DH Series
AO Series
TG Series
PM Series
RF Series
GN Series
LY Series
BZ Series
BT Series
IM Series
UG Series
IT Series
PW Series
SH Series
HR Series
HI Series
HZ Series
BN Series
IC Series
IS Series
AE Series
PN Series
VP Series
GD Series
AB Series
CW Series
Hot Stock
RFQ
Contact Us
Who We Are
What We Do
Industry News
Home > Industry News

NVIDIA's H100 consumes a staggering amount of energy, and balancing AI chip computing power and energy consumption has become an important issue.

Views : 73
Update time : 2024-01-03 10:43:24
        With the rapid development of artificial intelligence, the demand for computing power is also rising. Nvidia's H100 is currently a hot seller, but each H100 consumes 700 watts of peak power. With large numbers of H100s deployed, experts predict its total power consumption will be comparable to that of a major American city, even more than some small European countries.
 
 
        At a 61% annual utilization rate, each H100 is predicted to consume about 3,740kWh per year. If NVIDIA sells 1.5 million H100s in 2023 and 2 million in 2024, by the end of 2024 there will be 3.5 million H100 chips deployed. The total annual power consumption of these chips would be a staggering 13.091 billion kilowatt-hours, or 13,091.82 GWh. By comparison, countries like Georgia, Lithuania, or Guatemala also consume an average of about 13,092 GWh of electricity per year.
        While the H100's power consumption is alarming, it's worth noting that AI and HPC GPUs are becoming more efficient. So while NVIDIA's next-generation B100 chip with the Blackwell architecture may consume more power than the H100, it will also offer higher performance, resulting in more work being done with less power per unit.
        Obviously, with the development of AI technology, how to balance the contradiction between arithmetic power and energy consumption will become an important topic that needs to be resolved in the future.
Previous :
Next :
Related News
Read More >>
Qingming Festival holiday notice Qingming Festival holiday notice
Apr .02.2024
On April 4th, it is the traditional Chinese festival Qingming Festival. According to traditional customs, we will return to our hometown to worship, ancestor worship, and tomb sweeping. We will enjoy a three-day holiday and return to our hometown to worsh
Microchip Technology Announces Qi® v2.0 Compliant, dsPIC33-Based Reference Designs Microchip Technology Announces Qi® v2.0 Compliant, dsPIC33-Based Reference Designs
Mar .30.2024
Microchip has officially released the ISO 26262 functional safety package for dsPIC33C digital signal controllers (DSC), PIC18, and AVR microcontrollers (MCU), accelerating the development of safety critical designs for ASIL B and ASIL C safety levels and
Easter Notice Easter Notice
Mar .29.2024
During the Easter holiday, SIC Electronics’ companies in the United States, Hong Kong, and the United Kingdom are on holiday, but employees of the Chinese company work normally.
Infineon launches low-cost, low-power, long-distance Bluetooth module CYW20822-P4TAI040 Infineon launches low-cost, low-power, long-distance Bluetooth module CYW20822-P4TAI040
Mar .28.2024
Infineon Technology Co., Ltd. recently announced the launch of the latest Bluetooth module CYW20822-P4TAI040, which has achieved new breakthroughs in low power consumption and coverage, promoting the further development of wireless connection technology i
Email