BLUE
Profile banner
LC
Leshem Choshen
@lchoshen.bsky.social
🥇 #NLProc researcher 🥈 Opinionatedly Summarizing #ML & #NLP papers 🥉 Good science #scientivism
148 followers107 following317 posts
LClchoshen.bsky.social

Human feedback is critical for aligning LLMs, so why don’t we collect it in the open ecosystem?🧐 We (15 orgs) gathered the key issues and next steps. Envisioning a community-driven feedback platform, like Wikipedia alphaxiv.org/abs/2408.16961 🧵🤖

2
LClchoshen.bsky.social

I was involved in the "more or less", e.g. to avoid reconstruction through a canonical basis as inputs you can use invariances such as sending a permuted network each time

0
LClchoshen.bsky.social

And apparently you can multiply (super fast) by encoding the matrix as a light wave, then the multiplication is the two waves meeting and the output is more or less the only thing you can do.

1
LClchoshen.bsky.social

The basic Idea is that for every multiplication in the network you multiply two symmetric things an input and an output matrix. So, if each side can send a matrix but only read the output each can keep their secret (one the input one the model weights) www.alphaxiv.org/abs/2408.05629

alphaXiv
alphaXiv

Comment directly on top of arXiv papers.

1
LClchoshen.bsky.social

You can not run a closed model yourself, right? well... They prevent information leakage through quantum light properties What?! Simply:you can compute the network outputs but not recreate the weights and the API cannot access your data! 🤖 #NLP#LLM#quantum#machinelearning#ml

1
LClchoshen.bsky.social

Ask your friends directly, it might have been a mistake or have reasoning. (or ask us, we probably know better :P )

0
LClchoshen.bsky.social

Basically, like we evaluate everything else. Measure one thing at a time (don't also test a new model) Have a specific claim (is it language diverse, background,origin) and quantify it Separate it from other constructs like how much data was collected or whether it is biased

0
Profile banner
LC
Leshem Choshen
@lchoshen.bsky.social
🥇 #NLProc researcher 🥈 Opinionatedly Summarizing #ML & #NLP papers 🥉 Good science #scientivism
148 followers107 following317 posts