Matches in Nanopublications for { <https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion> ?p ?o ?g. }
Showing items 1 to 17 of
17
with 100 items per page.
- assertion comment " Human feedback is critical for aligning LLMs, so why don’t we collect it in the open ecosystem?🧐 We (15 orgs) gathered the key issues and next steps. Envisioning a community-driven feedback platform, like Wikipedia https://www.alphaxiv.org/abs/2408.16961 🧵 https://twitter.com/LChoshen/status/1831708316982231235/photo/1 We define 5 axes of openness: Methodology (how its collected) Access (who can use it) Models (one\many) Contributors (as diverse as its uses?) Time (keeps updating? closed models improve over several feedback iterations, and of course, models change) Is current feedback open?🥶 https://twitter.com/LChoshen/status/1831708319855362549/photo/1 In our paper, we first learn from peer production efforts like wiki and stack overflow. These case studies tell us how important it is to align incentives of different bodies, allow the community to dictate the policies, etc. Then, we hone on 6 crucial areas to develop open human feedback ecosystems: Incentives to contribute, reducing contribution efforts, getting expert and diverse feedback, ongoing dynamic feedback, privacy and legal issues. https://twitter.com/LChoshen/status/1831708324284522965/photo/1 We believe a successful ecosystem must center around feedback loops where anyone can spin up a community model, for storytelling, Bengali or anything else Others can use it, give feedback, and benefit from a model that keeps improving with the contributions https://twitter.com/LChoshen/status/1831708326717161683/photo/1 The feedback from all models will be open and collected in one pool, helping beyond the specialized models created to future research and general improvement This was a huge effort and the paper is packed with ideas thanks to: #deepRead @Shachar_Don @ben_burtenshaw @RamonAstudill12 @cailean_osborne @MimansaJ @tzushengkuo @wzhao_nlp @IdanShenfeld @TheAndiPenguin @Yurochkin_M @Dr_Atoosa @YangsiboHuang @tatsu_hashimoto @YJernite @dvilasuero @AbendOmri @jen_gineered @sarahookr @hannahrosekirk Note, we don't only preach open, this was open with contributions from so many organizations @CohereForAI @MITIBMLab @IBMResearch @huggingface @nlphuji @UniofOxford @MIT_CSAIL @StanfordHAI @turinginst @princeton_nlp @cmuhcii @EdinburghUni @cornell_tech Please ask us anything, share, discuss and talk to us, we are going to make it real! Together! Much much more in the paper: https://www.alphaxiv.org/abs/2408.16961 " assertion.
- assertion summarizes 2408.16961 assertion.
- assertion wasAttributedTo 0000-0002-0085-6496 provenance.
- assertion wasAttributedTo RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts provenance.
- assertion creator RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts assertion.
- assertion wasGeneratedBy activity provenance.
- assertion wasAssociatedWith LChoshen provenance.
- assertion recommends 2408.16961 assertion.
- assertion announcesResource 2408.16961 assertion.
- assertion keywords "LLMs" assertion.
- assertion keywords "communitydriven" assertion.
- assertion keywords "deepRead" assertion.
- assertion keywords "feedbackplatform" assertion.
- assertion keywords "humanfeedback" assertion.
- assertion keywords "interdisciplinary" assertion.
- assertion keywords "openecosystem" assertion.
- assertion linksTo 1831708316982231235 provenance.