Shaqooyinkii u dambeeyay waxay muujiyeen horumar weyn oo laga gaaray hawlo badan oo NLP ah iyo heerbeegyo iyadoo la sameeyay wejiga hore ee tabbabarka ku salaysan ururin weyn oo qoraal ah, dabadeedna lagu sameeyay hagaajin gaar u ah hawl cayiman. Inkastoo qaab-dhismeed ahaan habkani badanaa uusan ku xirnayn hawl gaar ah, haddana weli wuxuu u baahan yahay xog-ururinno hagaajin oo u gaar ah hawsha oo ka kooban kumannaan ama tobannaan kun oo tusaale. Taa beddelkeeda, bini’aadamku guud ahaan waxay qaban karaan hawl luqadeed oo cusub iyagoo haysta keliya dhowr tusaale ama tilmaamo fudud - arrin ay nidaamyada NLP ee hadda jira weli si weyn ugu dhibtoonayaan. Halkan waxaan ku muujinaynaa in ballaarinta noocyada luqadda ay si weyn u hagaajiso waxqabadka tiro yar ee aan ku xirnayn hawl gaar ah, mararka qaarkoodna xitaa gaarta tartan la leh hababkii hore ee ugu sarreeyay ee hagaajinta. Gaar ahaan, waxaan tabbabarnay GPT‑3, oo ah nooc luqadeed autoregressive ah oo leh 175 bilyan oo doorsoome, taas oo 10 jeer ka badan nooc kasta oo luqadeed oo aan sparse ahayn oo hore u jiray, waxaanan tijaabinay waxqabadkiisa dejinta tiro yar. Dhammaan hawlaha, GPT‑3 waxaa la adeegsadaa iyada oo aan wax cusboonaysiin gradient ah ama hagaajin la samayn, halka hawlaha iyo muujinnada tiro yar lagu qeexayo oo keliya isdhexgal qoraal ah oo lala yeesho nooca. GPT‑3 wuxuu gaaraa waxqabad xooggan xog-ururinno badan oo NLP ah, oo ay ku jiraan turjumaad, su’aal-jawaab, iyo hawlaha cloze, iyo sidoo kale dhowr hawlood oo u baahan caqliyeynta degdegga ah ama la-qabsiga domain-ka, sida kala-furidda erayada isku qasan, adeegsiga eray cusub jumlad gudaheed, ama xallinta xisaab saddex-god ah. Isla waqtigaas, waxaan sidoo kale aqoonsannay qaar ka mid ah xog-ururinnada halkaas oo barashada tiro yar ee GPT‑3 weli ku dhibtoonayso, iyo sidoo kale qaar ka mid ah xog-ururinnada halkaas oo GPT‑3 uu kala kulmo arrimo hab-raaceed oo la xiriira tabbabarka ku salaysan ururro waaweyn oo webka ah. Ugu dambayn, waxaan ogaanay in GPT‑3 uu soo saari karo muunado maqaallo warar ah oo qiimeeyayaal bini’aadam ahi ay ku adkaato inay ka soocaan maqaallada ay qoreen bini’aadamku. Waxaan ka doodnay saameynnada bulsho ee ballaaran ee natiijadan iyo GPT‑3 guud ahaan.
Soo kacaya…
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh
Daniel Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, Dario Amodei
Eeg dhamaan


