{"id":1897,"date":"2021-04-19T23:42:16","date_gmt":"2021-04-19T23:42:16","guid":{"rendered":"https:\/\/giuliad10.sg-host.com\/?post_type=news-&#038;p=1897"},"modified":"2024-07-12T23:44:37","modified_gmt":"2024-07-12T23:44:37","slug":"first-amsterdam-ellis-team-participates-in-googles-big-bench-challenge","status":"publish","type":"news-","link":"https:\/\/ivi.fnwi.uva.nl\/ellis\/news-\/first-amsterdam-ellis-team-participates-in-googles-big-bench-challenge\/","title":{"rendered":"First Amsterdam ELLIS team participates in Google&#8217;s BIG-Bench Challenge"},"content":{"rendered":"<p><b>In the spirit of community building, the Amsterdam ELLIS unit is supporting students teams to tackle data challenges, sprints, and hackathons in machine learning topics.<\/b>\u00a0We support diverse teams of students looking to participate in such challenges with coaching from ELLIS faculty members and compute power.<\/p>\n<p>The unit\u2019s first team of PhD, MSc, and BSc students are tackling Google\u2019s BIG-Bench Challenge.<\/p>\n<p>The team, led by Mario Giuglianelli, Jaap Jumelet, and Hugh Mee Wong, includes four PhD, seven MSc, and 2 BSc students. They will additionally receive feedback and coaching from five ELLIS faculty members, who will guide the team as they participate in the challenge.<\/p>\n<p>Google\u2019s\u00a0<a href=\"https:\/\/github.com\/google\/BIG-bench\/blob\/main\/docs\/doc.md#motivation\">Beyond the imitation game Benchmark<\/a>\u00a0(BIG-Bench) is a collaborative benchmarking challenge for large language models. BIG-Bench aims to examine questions on the future and scalability of large language models, and especially to test, find, and determine their capabilities and limitations.<\/p>\n<p>\u201c<i>By soliciting benchmark tasks from the community we hope to provide a diverse and large scale benchmark [\u2026] Our goal is to test model capabilities quantitatively, either establishing or disproving possible limitations of these models.<\/i>\u201d (<a href=\"https:\/\/github.com\/google\/BIG-bench\/blob\/main\/docs\/doc.md#call-for-benchmark-tasks\">Call for benchmark tasks<\/a>).<\/p>\n<p>In the next few weeks, the ELLIS team will work together to\u00a0design tasks that challenge or exceed the capabilities of current models in order to establish or disprove their possible limitations. We wish them luck!<\/p>\n<p>&nbsp;<\/p>\n<p><img fetchpriority=\"high\" decoding=\"async\" class=\"size-medium wp-image-1898 aligncenter\" src=\"http:\/\/giuliad10.sg-host.com\/wp-content\/uploads\/2024\/07\/ELLIS-team-1-300x277.png\" alt=\"\" width=\"300\" height=\"277\" srcset=\"https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-content\/uploads\/2024\/07\/ELLIS-team-1-300x277.png 300w, https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-content\/uploads\/2024\/07\/ELLIS-team-1-1024x945.png 1024w, https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-content\/uploads\/2024\/07\/ELLIS-team-1-768x709.png 768w, https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-content\/uploads\/2024\/07\/ELLIS-team-1-1536x1418.png 1536w, https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-content\/uploads\/2024\/07\/ELLIS-team-1-2048x1891.png 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n","protected":false},"featured_media":0,"template":"","news-or-blog":[15],"class_list":["post-1897","news-","type-news-","status-publish","hentry","news-or-blog-news"],"_links":{"self":[{"href":"https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-json\/wp\/v2\/news-\/1897","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-json\/wp\/v2\/news-"}],"about":[{"href":"https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-json\/wp\/v2\/types\/news-"}],"wp:attachment":[{"href":"https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-json\/wp\/v2\/media?parent=1897"}],"wp:term":[{"taxonomy":"news-or-blog","embeddable":true,"href":"https:\/\/ivi.fnwi.uva.nl\/ellis\/wp-json\/wp\/v2\/news-or-blog?post=1897"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}