Abaphandi baye baphuhlisa isisombululo sokhuseleko ngale chip incinci yeemodeli ze-AI ezilambele amandla ezinikezela ngokhuseleko kuhlaselo oluqhelekileyo.
Impilo-esweni apps inokunceda abantu balawule izifo ezinganyangekiyo okanye bahlale kwindlela eneenjongo zempilo, bengasebenzisi nto ngaphandle kwe-smartphone. Nangona kunjalo, ezi apps zinokucotha kwaye zingasebenzi kakuhle ngenxa yokuba iimodeli ezinkulu zokufunda ngomatshini ezibanika amandla kufuneka zivalelwe phakathi kwe-smartphone kunye neseva yememori ephakathi.
Iinjineli zihlala zikhawulezisa izinto zisebenzisa ihardware enciphisa isidingo sokuhambisa idatha eninzi emva naphambili. Ngelixa ezi zikhawulezayo zokufunda ngoomatshini zinokwenza lula ukubala, zisesichengeni kubahlaseli abanokuba ulwazi oluyimfihlo.
Ukunciphisa lo mngcipheko, abaphandi abavela kwi-MIT kunye ne-MIT-IBM Watson AI Lab benza i-accelerator yokufunda ngomatshini echasene neentlobo ezimbini eziqhelekileyo zokuhlaselwa. I-chip yabo inokugcina iirekhodi zezempilo zomsebenzisi, ulwazi lwezemali, okanye enye idatha ebuthathaka yabucala ngelixa isenza iimodeli ezinkulu ze-AI zisebenze ngokufanelekileyo kwizixhobo.
Iqela liphuhlise ulungiselelo oluninzi olwenza ukhuseleko oluluqilima ngelixa lucotha kancinci isixhobo. Ngaphezu koko, ukhuseleko olongezelelweyo aluchaphazeli ukuchaneka kwezibalo. Esi santya sokufunda ngomatshini sinokuba luncedo ngakumbi ekufuneni izicelo ze-AI ezifana nenyani eyandisiweyo kunye nenyani okanye ukuqhuba ngokuzimeleyo.
Ngelixa ukuphumeza i-chip kuya kwenza isixhobo sibize kakhulu kwaye singabi namandla angaphantsi, oko ngamanye amaxesha lixabiso elifanelekileyo lokuhlawula ukhuseleko, utsho umbhali okhokelayo uMaitreyi Ashok, umfundi ophumelele isidanga sobunjineli bombane kunye nesayensi yekhompyuter (EECS) eMIT.
“Kubalulekile ukuyila ngokhuseleko engqondweni ukusuka phezulu ukuya phezulu. Ukuba uzama ukongeza nokuba isixa esincinci sokhuseleko emva kokuba inkqubo iyilwe, kubiza kakhulu. Sikwazile ukulinganisa ngokufanelekileyo uninzi lwezi ntengiso ngexesha lesigaba soyilo, utshilo uAshok.
Ababhali abakunye naye baquka uSaurav Maji, umfundi onesidanga seEECS; Xin Zhang kunye noJohn Cohn we-MIT-IBM Watson AI Lab; kunye nombhali ophezulu u-Anantha Chandrakasan, igosa eliphambili le-MIT lokusungula izinto ezintsha kunye neqhinga, umfundisi weSikolo soBunjineli, kunye noVannevar Bush uNjingalwazi we-EECS. Uphando luya kuboniswa kwiNkomfa yeeSekethe eziDityanisiweyo ze-IEEE.
Ukuba buthathaka kwetshaneli
Abaphandi bajolise kuhlobo lwe-accelerator yokufunda ngomatshini ebizwa ngokuba yi-digital in-memory compute. Itshiphu yedijithali ye-IMC yenza uqikelelo ngaphakathi kwimemori yesixhobo, apho amaqhekeza omzekelo wokufunda ngomatshini agcinwa emva kokufuduswa kumncedisi osembindini.
Yonke imodeli inkulu kakhulu ukuba ingagcinwa kwisixhobo, kodwa ngokuyiqhekeza ibe ziingceba kunye nokusebenzisa kwakhona ezo ziqwenga kangangoko kunokwenzeka, iitshiphusi ze-IMC zinciphisa inani ledatha ekufuneka ihanjiswe emva naphambili.
Kodwa iitshiphusi ze-IMC zinokuchaphazeleka kubageli. Kuhlaselo lwetshaneli esecaleni, i-hacker ibeka iliso kusetyenziso lwamandla etshiphu kwaye isebenzisa ubuchule bamanani ukubuyisela umva idatha yobunjineli njengoko i-chip idibanisa. Kuhlaselo lokukhangela ibhasi, i-hacker inokweba amasuntswana emodeli kunye nedathasethi ngokuphonononga unxibelelwano phakathi kwe-accelerator kunye nememori ye-off-chip.
I-Digital IMC ikhawuleza ukubala ngokuqhuba izigidi zemisebenzi ngexesha elinye, kodwa oku bunzima kwenza kube nzima ukukhusela ukuhlaselwa usebenzisa iindlela zokukhusela zendabuko, uAshok uthi.
Yena namahlakani akhe bathatha indlela entlantlu-ntathu yokuvala itshaneli esecaleni kunye nohlaselo lokujonga ibhasi.
Okokuqala, baqeshe umlinganiselo wokhuseleko apho idatha kwi-IMC yahlulwe ibe ngamaqhekeza angaqhelekanga. Umzekelo, i-zero encinci inokwahlulwa ibe ngamasuntswana amathathu asalingana no-zero emva komsebenzi onengqondo. I-IMC ayinakuze idibanise zonke iziqwenga kumsebenzi omnye, ngoko ke uhlaselo lwetshaneli esecaleni alunakuze luphinde luphinde lukhe ulwazi lokwenyani.
Kodwa ukuze obu buchule busebenze, amasuntswana angaqhelekanga kufuneka afakwe ukwahlula-hlula idatha. Ngenxa yokuba i-IMC yedijithali yenza izigidi zemisebenzi ngaxeshanye, ukuvelisa amasuntswana amaninzi angenamkhethe kuya kubandakanya ikhompyutha eninzi kakhulu. Kwi-chip yabo, abaphandi bafumene indlela yokwenza lula ukubala, okwenza kube lula ukwahlula idatha ngokufanelekileyo ngelixa ususa imfuno yamasuntswana angaqhelekanga.
Okwesibini, bathintele ukuhlaselwa kwebhasi usebenzisa i-cipher elula efihla imodeli egcinwe kwimemori ye-off-chip. Le cipher ekhaphukhaphu ifuna kuphela ubalo olulula. Ukongeza, bakhuphela kuphela amaqhekeza emodeli agcinwe kwi-chip xa kuyimfuneko.
Okwesithathu, ukuphucula ukhuseleko, bavelise isitshixo esisusa i-cipher ngqo kwi-chip, kunokuba siyihambise emva naphambili kunye nemodeli. Bavelise esi sitshixo esikhethekileyo kwiinguqu ezingaqhelekanga kwi-chip eziziswa ngexesha lokuvelisa, kusetyenziswa oko kwaziwa njengomsebenzi ongabonakaliyo ngokomzimba.
“Mhlawumbi olunye ucingo luza kuba ngqindilili kancinane kunolunye. Sinokusebenzisa ezi zintlukwano ukufumana ooziro kunye nabanye ngaphandle kwesekethe. Kuyo yonke i-chip, sinokufumana isitshixo esingenamkhethe ekufuneka singqinelane kuba ezi zakhiwo zingenamkhethe akufuneki zitshintshe kakhulu ekuhambeni kwexesha, ”uchaza uAshok.
Baphinde basebenzise iiseli zememori kwi-chip, besebenzisa ukungafezeki kwezi seli ukwenza isitshixo. Oku kufuna ukubala okuncinci kunokuvelisa isitshixo ukusuka ekuqaleni.
“Njengokuba ukhuseleko lube ngumba obalulekileyo kuyilo lwezixhobo ezisemacaleni, kukho imfuneko yokuphuhlisa inkqubo epheleleyo egxile ekusebenzeni okukhuselekileyo. Lo msebenzi ugxininise kukhuseleko lomsebenzi wokufunda umatshini kwaye uchaza iprosesa yedijithali esebenzisa ukulungelelaniswa kwe-cross-cut optimization. Ibandakanya ukufikelela kwedatha efihliweyo phakathi kwememori kunye neprosesa, iindlela zokuthintela ukuhlaselwa kwe-channel-channel usebenzisa i-randomization, kunye nokuxhaphaza ukuguquguquka ukuvelisa iikhowudi ezizodwa. Uyilo olunjalo luza kubaluleka kwizixhobo eziphathwayo ezizayo, utshilo uChandrakasan.
Uvavanyo lokhuseleko
Ukuvavanya i-chip yabo, abaphandi bathatha indima yabahlaseli kwaye bazama ukuba ulwazi oluyimfihlo besebenzisa i-channel-channel kunye nokuhlaselwa kwebhasi.
Nasemva kokwenza izigidi zemizamo, abakwazanga ukuphinda baphinde baphinde bafake ulwazi lokwenyani okanye bakhuphe amaqhekeza emodeli okanye iseti yedatha. I-cipher nayo yahlala ingaqhawuki. Ngokwahlukileyo, kuthathe kuphela iisampulu ezingama-5,000 ukuba ulwazi oluvela kwitshiphu engakhuselekanga.
Ukongezwa kokhuseleko kuye kwanciphisa ukusebenza kakuhle kwamandla kwe-accelerator, kwaye ifuna indawo ye-chip enkulu, eya kwenza ukuba kubize kakhulu ukwenza.
Iqela liceba ukuhlola iindlela ezinokunciphisa ukusetyenziswa kwamandla kunye nobukhulu be-chip yabo kwixesha elizayo, eliya kwenza kube lula ukuphumeza kwinqanaba.
“Njengoko kubiza kakhulu, kuba nzima ukweyisela umntu ukuba ukhuseleko lubalulekile. Umsebenzi wexesha elizayo unokuphonononga olu tshintsho. Mhlawumbi singayenza ingakhuselekanga kancinane kodwa kube lula ukuyiphumeza kwaye ingabizi kakhulu,” utshilo uAshok.
Ibhalwe ngu Adam Zewe
