The next time you’re on a Zoom meeting or asking ChatGPT a question, picture this: The information zips instantaneously through a room of hot, humming servers, traveling hundreds, possibly thousands of miles, before it makes its way back to you in just a second or two.
It can be hard to wrap your mind around, said Vijay Gadepally, a senior scientist at Massachusetts Institute of Technology’s Lincoln Laboratory, but large data centers are where nearly all artificial intelligence systems and computing happens today.
kAm“t249 @?6 @7 E96D6 px >@56=D 92D E@ D:E @? 2 D6CG6C D@>6H96C6[ 2?5 E96J E6?5 E@ 36 G6CJ[ G6CJ 3:8[â€� 96 D2:5] â€�$@ :7 J@FC >:==:@?D @C 3:==:@?D @7 FD6CD 2C6 E2=<:?8 E@ E96 DJDE6> D:>F=E2?6@FD=J[ E96 4@>AFE:?8 DJDE6>D 92G6 E@ C62==J 8C@H 2?5 8C@H 2?5 8C@H]â€k^Am
kAmpD E96 &?:E65 $E2E6D H@C<D E@ 36 2 8=@32= px DFA6CA@H6C[ :E’D 364@>6 2 9@>6 E@ 9F?5C65D @7 52E2 46?E6CD � 3F:=5:?8D E92E DE@C6 2?5 >2:?E2:? E96 A9JD:42= 6BF:A>6?E ?66565 E@ 4@>AFE6 :?7@C>2E:@?]k^Am
kAmu@C FD6CD @7 E96 ?6H 2?5 :?4C62D:?8=J A@AF=2C px E@@=D[ :E >:89E D66> =:<6 E96 492?86D 92G6 366? 2== @?=:?6[ H:E9@FE 2 A9JD:42= 7@@EAC:?E] qFE E96 C:D6 @7 px 92D E2?8:3=6 67764ED � 52E2 46?E6CD 2?5 E96 A9JD:42= :?7C2DECF4EFC6 ?66565 E@ CF? E96> FD6 =2C86 2>@F?ED @7 6?6C8J[ H2E6C 2?5 @E96C C6D@FC46D[ 6IA6CED D2J]k^Am
kAmâ€�(6 567:?:E6=J ECJ E@ E9:?< 23@FE E96 4=:>2E6 D:56 @7 :E H:E9 2 4C:E:42= 6J6[â€� D2:5 y6??:76C qC2?5@?[ 2 D4:6?46 2?5 DFDE2:?23:=:EJ 4@?DF=E2?E] “p== @7 2 DF556?[ :E’D 255:?8 D@ >F49 DEC2:? @? E96 8C:5 E@ D@>6 @7 E96D6 A=246D]â€k^Am
k9cm%96 C:D6 @7 52E2 46?E6CDk^9cm
kAmpD D@4:6EJ EC2565 =2C86[ 56D<E@A 4@>AFE6CD 7@C D=66< =2AE@AD[ 2?5 :?E6C?6E :?7C2DECF4EFC6 3682? DFAA@CE:?8 px >@56=D 2?5 @E96C D@7EH2C6 E@@=D[ E96 &]$] 92D 3F:=E E96 A9JD:42= :?7C2DECF4EFC6 E@ DFAA@CE 8C@H:?8 4@>AFE:?8 A@H6C]k^Am
kAm{2C86 =2?8F286 >@56=D W{{|DX 2?5 >249:?6 =62C?:?8 W|{X E649?@=@8:6D � E96 7@F?52E:@? @7 >@DE >@56C? px E@@=D � 92G6 366? FD65 3J E649?@=@8:DED 7@C 564256D[ 3FE @?=J :? E96 =2DE 7:G6 E@ D6G6? J62CD 92G6 E96J 364@>6 4@>>6C4:2=:K65 2?5 FD65 3J E96 86?6C2= AF3=:4[ D2:5 s2G:5 p4@DE2[ 4@7@F?56C 2?5 49:67 2CE:7:4:2= :?E6==:86?46 @77:46C @7 p#q~2:]k^Am
kAm%@ EC2:? 2?5 AC@46DD :?7@C>2E:@?[ E96D6 72DE\=62C?:?8 px >@56=D C6BF:C6 8C2A9:4 AC@46DD:?8 F?:ED Wv!&DX[ D6CG6CD[ DE@C286[ 423=:?8 2?5 @E96C ?6EH@C<:?8 6BF:A>6?E[ 2== 9@FD65 :? 52E2 46?E6CD 24C@DD E96 4@F?ECJ] r@>AFE6CD 92G6 366? DE@C:?8 2?5 AC@46DD:?8 52E2 @77\D:E6 :? 565:42E65 46?E6CD 7@C 564256D[ 3FE E96 5@E\4@> 3F33=6 :? E96 62C=J a___D 2?5 E96 >@G6 E@ 4=@F5 DE@C286 56>2?565 >F49 >@C6 DE@C286 42A24:EJ @G6C E96 =2DE 564256]k^Am
kAmpD >@C6 E9:?8D >@G65 @?=:?6[ 2?5 4@>AFE:?8 92C5H2C6 2?5 49:A E649?@=@8J DFAA@CE65 72DE6C AC@46DD:?8[ px >@56=D 3642>6 2EE2:?23=6 E@ E96 86?6C2= AF3=:4[ p4@DE2 D2:5] rFCC6?E px >@56=D FD6 E9@FD2?5D @7 v!&D E@ @A6C2E6[ 2?5 EC2:?:?8 2 D:?8=6 492E3@E =:<6 r92Ev!% FD6D 23@FE E96 D2>6 2>@F?E @7 6?6C8J 2D `__ 9@>6D @G6C E96 4@FCD6 @7 2 J62C]k^Am
kAm“p?5 E96? J@F >F=E:A=J E92E E:>6D E96 E9@FD2?5D @7 >@56=D E92E 2C6 36:?8 EC2:?65[â€� p4@DE2 D2:5] “xE’D AC6EEJ :?E6?D6]â€k^Am
kAm%96 &?:E65 $E2E6D :D 4FCC6?E=J 9@>6 E@ >@C6 E92? b[e__ 52E2 46?E6CD[ 3FE 23@FE g_T @7 E96> 2C6 4@?46?EC2E65 :? `d DE2E6D[ s2E2 r6?E6C |2A D9@HD] %96 >2C<6E 92D 5@F3=65 D:?46 a_a_[ u@C36D C6A@CE65[ H:E9 a`T J62C @G6C J62C 8C@HE9] u@C >2?J J62CD[ ?62C=J 2== @7 E96 4@F?ECJ’D 52E2 46?E6CD H6C6 9@FD65 :? ':C8:?:2[ 2?5 E96 DE2E6 :D 4@?D:56C65 2 8=@32= 9F3 H:E9 ?62C=J f_T @7 E96 H@C=5’D :?E6C?6E EC277:4 7=@H:?8 E9C@F89 :ED ?62C=J e__ 46?E6CD] %6I2D 2?5 r2=:7@C?:2 7@==@H ':C8:?:2[ H:E9 bbe 2?5 b_f 46?E6CD[ C6DA64E:G6=J]k^Am
kAm%649 4@>A2?:6D E92E C6BF:C6 =2C86 2>@F?ED @7 4@>AFE:?8 A@H6C[ E96 AC:G2E6 6BF:EJ 7:C>D 2?5 32?<D E92E :?G6DE :? E96> 2?5 @E96C C62= 6DE2E6 @C DA64:2=:K65 7:C>D 2C6 E96 AC:>2CJ 7F?56CD @7 52E2 46?E6CD] x? $6AE6>36C[ q=24<#@4<[ v=@32= x?7C2DECF4EFC6 !2CE?6CD[ |:4C@D@7E 2?5 px :?G6DE>6?E 7F?5 |v) :?G6DE65 Sb_ 3:==:@? :?E@ ?6H 2?5 6IA2?565 52E2 46?E6CD AC:>2C:=J :? E96 &]$[ 2?5 D2:5 E96J H:== D66< S`__ 3:==:@? :? E@E2= :?G6DE>6?E[ :?4=F5:?8 563E 7:?2?4:?8]k^Am
kAmx?G6DE>6?E :? p>6C:42? 52E2 46?E6C :?7C2DECF4EFC6 :D 6?4@FC28:?8 4@?D:56C:?8 E96 8=@32= “px 2C>D C246[� H6’C6 :?[ p4@DE2 D2:5]k^Am
kAm“x7 J@F @H? E96 52E2[ J@F 92G6 E96 A@H6C[â€� p4@DE2 D2:5] “x ;FDE E9:?< H6 ;FDE >2<6 DFC6 H6 5@ :E 6E9:42==J 2?5 2D AC66>AE:G6 2D A@DD:3=6]â€k^Am
k9cmt?6C8J 2?5 6?G:C@?>6?E2= :>A24Ek^9cm
kAmrFCC6?E 6DE:>2E6D D2J 52E2 46?E6CD 2C6 C6DA@?D:3=6 7@C 23@FE aT @7 E96 &]$]� 6?6C8J 56>2?5[ 3FE p?E9@?J s6~CD6J[ 2 C6D62C49 >2?286C 2E DFDE2:?23=6 6?6C8J C6D62C49 7:C> r=62?E649 8C@FA[ AC@;64ED 52E2 46?E6CD H:== 36 23@FE `_T @7 56>2?5 3J a_af]k^Am
kAmpD 52E2 46?E6CD 2C6 56G6=@A65 :? ?6H 4@>>F?:E:6D 24C@DD E96 4@F?ECJ[ C6D:56?ED 2?5 E96:C DE2E6 =68:D=2E@CD D66 2 >:I @7 7:?2?4:2= 36?67:ED H:E9 6?6C8J 2?5 6?G:C@?>6?E2= 492==6?86D]k^Am
kAm%96 56G6=@A>6?E @7 52E2 46?E6CD 3C:?8D D@>6 :?7C2DECF4EFC6 ;@3D E@ 2? 2C62[ 2?5 :? 3FDJ 52E2 46?E6C 4@>>F?:E:6D[ =:<6 ':C8:?:2’D {@F5@F? 2?5 !C:?46 (:==:2> 4@F?E:6D[ 46?E6CD 42? 86?6C2E6 >:==:@?D :? E2I C6G6?F6[ E96 ':C8:?:2 |6C4FCJ C6A@CE65]k^Am
kAm{@42= 8@G6C?>6?ED 42? 36 6286C E@ DEC:<6 562=D H:E9 E96 E649 4@>A2?:6D @C AC:G2E6 6BF:EJ 7:C>D D66<:?8 E@ 3F:=5[ 3FE E96 2G2:=23:=:EJ 2?5 4@DE @7 A@H6C :D 2 AC:>2CJ 4@?46C?] }6H =2C86 52E2 46?E6CD C6BF:C6 E96 6=64EC:4:EJ 6BF:G2=6?E @7 23@FE fd_[___ 9@>6D[ 2 u63CF2CJ C6A@CE 7C@> DFDE2:?23:=:EJ 4@?DF=E2?4J 7:C> q$x 2?5 C62= 6DE2E6 D6CG:46D 7:C> rq#t]k^Am
kAm&?56C >2?J DE2E6’D FE:=:E:6D DECF4EFC6D[ =@42= C6D:56?ED 42? 36 DF3;64E65 E@ 6=64EC:4 AC:46 :?4C62D6D E@ >66E 3:8 6=64EC:4 ?665D @7 52E2 46?E6CD] $@>6 =68:D=2E@CD[ =:<6 v6@C8:2 $E2E6 $6?] r9F4< wF7DE6E=6C[ 92G6 D@F89E E@ AC@E64E C6D:56?E:2= 2?5 4@>>6C4:2= 4FDE@>6CD 7C@> 86EE:?8 9:E H:E9 9:896C FE:=:EJ 3:==D]k^Am
kAmvC2?G:==6 |2CE:?[ 2? t2DE6C? $9@C6[ r@??64E:4FE\32D65 =2HJ6C H:E9 6IA6CE:D6 :? 7:?2?46 2?5 6?G:C@?>6?E2= C68F=2E:@?[ D2:5 E96 D2>6 AC@3=6> 92D 4@>6 FA :? 9:D @H? 4@>>F?:EJ]k^Am
kAm�%96 2C8F>6?E H2D[ E96 =@42=D 5:5?’E H2?E E9:D 52E2 46?E6C 4@>:?8 :? E96C6 2?5 DF4<:?8 FA 2 3F?49 @7 E96 2G2:=23=6 A@H6C 3642FD6 E96:C G:6H � C:89E=J @C HC@?8=J[ 2?5 x E9:?< C:89E=J � H2D H6==[ E92E’D ;FDE 8@:?8 E@ C2:D6 @FC C2E6D[� |2CE:? D2:5]k^Am
kAm$@>6 DE2E6D 2C6 6IA=@C:?8 2=E6C?2E:G6 6?6C8J D@FC46D] x? !6??DJ=G2?:2[ r@?DE6==2E:@? t?6C8J >256 2 562= E@ C6DE2CE :ED ?F4=62C A@H6C A=2?E 2E %9C66 |:=6 xD=2?5 E@ AC@G:56 42C3@?\7C66 6=64EC:4:EJ E@ @77D6E |:4C@D@7E’D A@H6C FD286 2E :ED ?62C3J 52E2 46?E6CD]k^Am
kAmqFE 4=:>2E6 6IA6CED 92G6 4@?46C?D 23@FE 52E2 46?E6CD @FED:56 @7 E96:C A@H6C 56>2?5]k^Am
kAm�%96 86?6C2= AF3=:4 :D =2C86=J F?2H2C6 E92E 4@@=:?8 :?5FDEC:2= 724:=:E:6D[ H92E6G6C E96J >:89E 36[ :D 24EF2==J 2 C62==J[ C62==J :>A@CE2?E 2DA64E @7 E96:C 7F?4E:@?[� |2CE:? D2:5]k^Am
kAm%96 6BF:A>6?E :? 52E2 46?E6CD[ >2?J @7 H9:49 CF? ac^f[ 86?6C2E6 2 =@E @7 962E] %@ C68F=2E6 E6>A6C2EFC6[ >@DE AF>A H2E6C E9C@F89 EF3:?8 DFCC@F?5:?8 E96 x% 6BF:A>6?E[ 2?5 FD6 2:C 4@?5:E:@?:?8 DJDE6>D E@ <66A E9@D6 DECF4EFC6D 4@@=] p3@FE c_T @7 52E2 46?E6C’D 6?6C8J 4@?DF>AE:@? :D FD65 7@C 4@@=:?8[ E96 r=62?E649 8C@FA 7@F?5]k^Am
kAm$@>6 92G6 2 4=@D65\=@@A DJDE6>[ C64J4=:?8 8C6J H2E6C E9C@F89 E96 D2>6 DJDE6>[ 3FE >2?J FD6 7C6D9 5C:?<:?8 H2E6C] %96 2>@F?E @7 H2E6C 2?5 6?6C8J FD65 :? 4@@=:?8 :D 6?@C>@FD[ qC2?5@?[ E96 DFDE2:?23:=:EJ 4@?DF=E2?E] D2:5]k^Am
kAmâ€�%96 4FCC6?E 2>@F?E @7 px 52E2 46?E6CD H6 92G6 E2<6D D:I E:>6D E96 2>@F?E @7 H2E6C 2D E96 4@F?ECJ @7 s6?>2C<[â€� D96 D2:5] “p?5 E96? H6 2C6 FD:?8 E96 D2>6 2>@F?E @7 6?6C8J 2D y2A2?[ H9:49 :D E96 7:7E9 =2C86DE 6?6C8J FD6C :? E96 H@C=5[ 7@C 52E2 46?E6CD C:89E ?@H]â€k^Am
k9cmxD E96C6 2 DFDE2:?23=6 7FEFC6 7@C 52E2 46?E6CDnk^9cm
kAmt?6C8J :D ?@H 2 >2E6C:2= :DDF6 E@ CF??:?8 2? px 4@>A2?J[ s6~CD6J D2:5[ 2?5 F?C6DEC2:?65[ BF:4<=J 6G@=G:?8 px >@56=D 2C6 G6CJ 6IA6?D:G6 E@ EC2:? 2?5 @A6C2E6] s6~CD6J A@:?E65 E@ r9:?6D6 px 4@>A2?J s66A$66<[ H9:49 C6=62D65 :ED 2EE6>AE 2E 2 4@DE\4@?D4:@FD[ 6?6C8J 677:4:6?E =2C86 =2?8F286 >@56=[ #`[ :? y2?F2CJ]k^Am
kAm%96 4@>A2?J 4=2:>D :E EC2:?65 E96 >@56= @? a[___ 49:AD[ >F49 76H6C E92? 4@>A6E:E@CD =:<6 ~A6? px[ r92Ev!%’D A2C6?E 4@>A2?J[ 2?5 v@@8=6[ H9:49 FD6 23@FE `e[___ 49:AD] xE’D ?@E J6E 4=62C :7 E96 >@56= =:G6D FA E@ :ED 4=2:>D @7 6?6C8J 677:4:6?4J :? FD6[ 3FE :E’D 2 D:8? E92E 4@>A2?:6D 2C6 766=:?8 E96 AC6DDFC6 E@ 36 >@C6 677:4:6?E[ s6~CD6J D2:5]k^Am
kAm“x E9:?< 4@>A2?:6D =:<6 s66A$66< 2C6 2? 6I2>A=6 @7 4@>A2?:6D 5@:?8 4@?DEC2:?65 @AE:>:K2E:@?[â€� 96 D2:5] â€�%96J’C6 2DDF>:?8 E96J H@?’E ;FDE 86E 2== E96 A@H6C E96J ?665[ E96J H@?’E 36 23=6 E@ 86E 2== @7 E96 49:AD E96J ?665[ 2?5 ;FDE >2<6 5@ H:E9 H92E E96J 92G6]â€k^Am
kAmu@C v256A2==J[ H9@ :D 2=D@ 49:67 E649 @77:46C @7 px 4@>A2?J #25:F> r=@F5[ E9:D D6=64E:G6 @AE:>:K2E:@? :D 2 E@@= 96 9@A6D >@C6 4@>A2?:6D 368:? FD:?8] w:D C646?E H@C< 2E |x%’D {:?4@=? {23@C2E@CJ $FA6C4@>AFE:?8 r6?E6C 7@4FD65 @? E96 =23’D @H? 52E2 46?E6C 4@?DF>AE:@?] (96? E96J C62=:K65 9@H 9@E E96:C 6BF:A>6?E H2D 86EE:?8[ E96J 5:5 2? 2F5:E]k^Am
kAmv256A2==J D2:5 D:>A=6 DH:E496D =:<6 FD:?8 4962A6C[ =6DD\C@3FDE px >@56=D 4FE 5@H? @? E96:C 6?6C8J FD6] &D:?8 px >@56=D 2E @77\A62< E:>6D D2G65 >@?6J[ 2D 5:5 “A@H6C 42AA:?8� @C =:>:E:?8 E96 2>@F?E @7 A@H6C 7665:?8 E96:C 4@>AFE6C AC@46DD@CD] %96 5:776C6?46 H2D ?@>:?2= � J@F >2J H2:E 2 D64@?5 @C EH@ >@C6 E@ 86E 2? 2?DH6C 324< 7C@> 2 492E3@E[ 7@C 6I2>A=6]k^Am
kAm(:E9 }@CE962DE6C? &?:G6CD:EJ[ |x% 3F:=E D@7EH2C6 42==65 r=@G6C E92E H2E496D 42C3@? :?E6?D:EJ 7@C A62< A6C:@5D 2?5 >2<6D 25;FDE>6?ED[ =:<6 2FE@>2E:42==J FD:?8 2 =@H6C\BF2=:EJ px >@56= H:E9 =6DD 4@>AFE:?8 A@H6C H96? 6?6C8J 56>2?5 :D 9:89]k^Am
kAmâ€�(6’G6 366? <:?5 @7 AFD9:?8 324< @? A6@A=6 7@C 2 =@?8 E:>6 D2J:?8[ :D :E C62==J H@CE9 :Enâ€� v256A2==J D2:5] â€�*@F >:89E 86E 2 36EE6C[ J@F <?@H[ <?@4<\<?@4< ;@<6 7C@> E9:D 492E3@E] qFE E92E’D ?@H FD:?8 `_ E:>6D E96 A@H6C E92? :E H2D 5@:?8 367@C6] xD E92E H@CE9 :Enâ€k^Am
kAmv256A2==J 2?5 p4@DE2 3@E9 DA@<6 23@FE =@42=:K:?8 px E@@=D 2D 2?@E96C 6?6C8J 2?5 4@DE D2G:?8 DEC2E68J 7@C 4@>A2?:6D 2?5 52E2 46?E6CD] x? AC24E:46[ E92E >62?D 3F:=5:?8 E@@=D E@ 5@ 6I24E=J H92E J@F ?665 E96> E@ 5@[ 2?5 ?@E9:?8 >@C6[ 2?5 9@DE:?8 E96> @? =@42= D6CG6CD E92E 5@?’E ?665 E@ D6?5 E96:C 4@>AFE:?8 @FE A@E6?E:2==J 9F?5C65D @7 >:=6D 2H2J E@ E96 ?62C6DE 52E2 46?E6C]k^Am
kAmw62=E9 42C6 2?5 28C:4F=EFC2= D6EE:?8D 2C6 2 8C62E 6I2>A=6[ p4@DE2 D2:5[ H96C6 E@@=D 42? 36 3F:=E E@ D6CG6 E96D6 DA64:2=:K65 D6EE:?8D C2E96C E92? AC@46DD:?8 E96:C 52E2 2E �3=@2E65[ @G6C\7=F7765� =2C86 52E2 46?E6CD]k^Am
kAm}6:E96C px 56G6=@A6C D66D 2?J D=@H5@H? :? E96 56>2?5 7@C px 2?5 AC@46DD:?8 42A23:=:E:6D @7 52E2 46?E6CD] qFE v256A2==J D2:5 6?G:C@?>6?E2= 2?5 6?6C8J 4@?46C?D H:== 4@>6 E@ 2 9625 7@C E649 4@>A2?:6D H96? E96J C62=:K6 E96J 4@F=5 D2G6 >@?6J 3J D2G:?8 6?6C8J[ E@@] (96E96C s66A$66< 7:?5D E96 D2>6 DF446DD 2D D@>6 @7 :ED p>6C:42? 4@>A6E:E@CD :D J6E E@ 36 D66?[ v256A2==J D2:5[ 3FE :E H:== AC@323=J >2<6 E96> BF6DE:@? E96:C AC24E:46D]k^Am
kAm“xE H:== 2E =62DE >2<6 A6@A=6 BF6DE:@? 367@C6 D@>6@?6 D2JD[ ‘x ?665 2 3:==:@? 5@==2CD E@ 3FJ ?6H :?7C2DECF4EFC6[â€� @C ‘x ?665 E@ DA6?5 2 3:==:@? 5@==2CD @? 4@>AFE:?8 ?6IE >@?E9[â€� v256A2==J D2:5] “}@H E96J >2J D2J[ â€�5:5 J@F ECJ E@ @AE:>:K6 :En’â€k^Am