I-Jim Keller-Led Chip Company TensTorrent ikhiphe iprosesa yaso esesizukulwaneni esizayo sokulayisha umsebenzi we-AI, okulindelwe ukuthi anikeze ukusebenza kahle ngentengo engabizi.Le nkampani njengamanje inikezela ngamakhadi amabili angeziwe we-PCIE angathola amaprosesa athile noma amabili we-wormhole, kanye ne-tt-loitedbox kanye ne-TT-Southbox Workstation ye-software onjiniyela. Zonke izimemezelo zanamuhla zihloselwe abathuthukisi, hhayi labo abasebenzisa amabhodi e-wormmole emisebenzi yokusebenza.
"Kuyanelisa njalo ukuthola imikhiqizo yethu ezandleni zonjiniyela. Izinhlelo zokuthuthukisa ezisetshenziswa ama-wormhole ™ amakhadi wethu angasiza abathuthukisi ukuthi bakwazi ukukala futhi bathuthukise i-software ye-AI-Chip AI," kusho uJim Keller, umphathi wesi-Culter, umphathi we-Tentorent.Ngaphezu kwalokhu kwethulwa, sijabule kakhulu ukubona inqubekela phambili esiyenza nge-tepi ngaphandle namandla okusebenza komkhiqizo wethu wesizukulwane sesibili, iBlackhole. "
Iprosesa ngalinye le-wormhole liqukethe ama-cores angu-72 ama-ceres (amahlanu okusekela ama-risc-v amafomethi ahlukahlukene amafomethi wedatha) kanye ne-108 MB ye-SRAM, alethe ama-262 fp8 tflops nge-1 ghz ngamandla we-160w. Ikhadi le-Wormhole N150 elilodwa lifakwe imemori yevidiyo ye-12 GB GDDR6 futhi ine-bandwidth ka-288 GB / s.
Ama-processors we-wormhole ahlinzeka ngesikali esiguqukayo ukuze ahlangabezane nezidingo ezahlukahlukene zemithwalo yomsebenzi. Ekusetshenzisweni kwemisebenzi ejwayelekile enamakhadi amane we-wormhole N300, amaprosesa angahlanganiswa abe yiyunithi elilodwa elivela ku-software njengenethiwekhi enobunye, ebanzi yeTensix Core. Lokhu kucushwa kuvumela i-accelerator ukuthi iphathe umthwalo ofanayo, hlukana phakathi kwabathuthukisi abane noma bagijime kuze kufike kumamodeli ahlukene ayisishiyagalombili ahlukahlukene ai ngasikhathi sinye. Isici esingukhiye salokhu kukhubazeka ukuthi kungaqhuba endaweni yangakini ngaphandle kwesidingo sokubonaka. Emvelweni yesikhungo sedatha, amaprosesa e-wormhole azosebenzisa i-PCIE ukuze kwandiswe ngaphakathi komshini, noma i-Ethernet yokwanda kwangaphandle.
Mayelana nokusebenza, amakhadi we-tenstorent's single-chip-chip wormmole N150 (ama-coreen angama-72 ama-coreen, imvamisa eyi-128 MB, i-128 GDDR3, ngenkathi i-SNAUKED-THICH N300 Board (128 Tensix coreen, i-1 GHZ I-Aggregated 24 GB GDDDR6, i-576 GB / S Bandwidth) ihambisa kuze kufike ku-466 FP8 Tflops ngo-300w.
Ukubeka ama-300W we-466 fp8 tflops kumongo, thina 'sizoqhathanisa nomholi wemakethe we-AI Nvidia unikela kulo mandla we-thermal design. I-NVIDIA I-A100 ayisekeli i-FP8, kepha iyasekela i-Int8, ngokusebenza okuphezulu kwezihloko ezingama-624 (izihloko eziyi-1,248 lapho i-sparse). Uma kuqhathaniswa, i-H100 ye-NVIDIA isekela i-FP8 futhi ifinyelele ukusebenza okuphezulu kwe-1,670 tflops ngo-300W (3,341 tflops nge-sparse), okuhluke kakhulu kwi-wormmole ye-tenstorent's Wormhole N300.
Kodwa-ke, kunenkinga enkulu eyodwa. Izitolo ze-Tenstorent's Wormmole N150 ngama- $ 999, kanti i-N300 ithengisa ngo- $ 1,399. Ngokuqhathanisa, izitolo zekhadi le-NVIDIA H100 lemidwebo ye-NVIDIA H100 yama- $ 30,000, kuya ngenani. Vele, asazi ukuthi ngabe amaprosesa abane noma ayisishiyagalombili noma ayisishiyagalombili angaletha ukusebenza kwe-H300 eyodwa, kepha ama-TDPs abo angama-600w futhi ngo-1200w ngokulandelana.
Ngaphezu kwamakhadi, ama-tenstorent anikezela ngezindawo zokusebenza ezakhelwe ngaphambili zonjiniyela, kufaka phakathi amakhadi angama-4 n300 ku-geon-attle tt-ladbox TT-ladbox ngokupholisa okusebenzayo, kanye ne-advanced TT-Souepbox ene-EPYC-based xiaolong).
Isikhathi sePosi: Jul-29-2024