BLUE
Profile banner
LL
Lisa Ling
@aretvet.bsky.social
OEF/OIF Vet. War will not be made shorter or safer adding remote connectivity, AI, or autonomous weapons. A Western net-centric #KillCloud won’t bring us peace. disruption.institute/ disruptionlab.org/book nationalbirdfilm.com/
26 followers52 following31 posts
LLaretvet.bsky.social

About the Tik Tok Ban Bill: Q: What makes Tik Tok different than any socials? A: Nothing Comprehensive privacy protection legislation covering all social nets and cloud services would be better than an executive branch with the power to selectively ban platforms. This shouldn’t even need saying?

0
LLaretvet.bsky.social

Aaron Bushnell printed in bold white letters on a black background.
0
Reposted by Lisa Ling
MMmmasnick.bsky.social
Reposted by Lisa Ling
EMemilymbender.bsky.social

Coming soon on Mystery AI Hype Theater 3000: Annalee Newitz and Charlie Jane Anders of @ouropinions.bsky.social@alexhanna.bsky.social for a take-down of attempts at principles to govern the use of autonomous agents in Asimov's SF and Biden's US military. Mon, Feb 19, noon PST:

dair_institute - Twitch
dair_institute - Twitch

Twitch account for The Distributed AI Research Institute (DAIR).

0
Reposted by Lisa Ling
EMemilymbender.bsky.social

I feel very vindicated for not making time to answer journalist's queries about papers that "prove" things based on hypothesized graphs and fabricated data.I feel very vindicated for not making time to answer journalist's queries about papers that "prove" things based on hypothesized graphs and fabricated data.

Screenshot: The researchers started by assuming that there exists a hypothetical bipartite graph that corresponds to an LLM’s behavior on test data. To explain the change in the LLM’s loss on test data, they imagined a way to use the graph to describe how the LLM gains skills.

Take, for instance, the skill “understands irony.” This idea is represented with a skill node, so the researchers look to see what text nodes this skill node connects to. If almost all of these connected text nodes are successful — meaning that the LLM’s predictions on the text represented by these nodes are highly accurate — then the LLM is competent in this particular skill. But if more than a certain fraction of the skill node’s connections go to failed text nodes, then the LLM fails at this skill.

Source: https://www.quantamagazine.org/new-theory-suggests-chatbots-can-understand-text-20240122/
Screenshot: The team also automated the process by getting GPT-4 to evaluate its own output, along with that of other LLMs. Arora said it’s fair for the model to evaluate itself because it doesn’t have memory, so it doesn’t remember that it was asked to generate the very text it’s being asked to evaluate. Yasaman Bahri, a researcher at Google DeepMind who works on foundations of AI, finds the automated approach “very simple and elegant.”

Source: https://www.quantamagazine.org/new-theory-suggests-chatbots-can-understand-text-20240122/
Screenshot: Nonetheless, Hinton thinks the work lays to rest the question of whether LLMs are stochastic parrots. “It is the most rigorous method I have seen for showing that GPT-4 is much more than a mere stochastic parrot,” he said. “They demonstrate convincingly that GPT-4 can generate text that combines skills and topics in ways that almost certainly did not occur in the training data.” (We reached out to Bender for her perspective on the new work, but she declined to comment, citing a lack of time.)

Source: https://www.quantamagazine.org/new-theory-suggests-chatbots-can-understand-text-20240122/
7
Reposted by Lisa Ling
DRrightsdissent.bsky.social

Last night at the vigil, @reprashida.bsky.social@coribush.bsky.social delivered moving speeches in memory of journalists murdered by Israel - and called for accountability moving forward. Over 100 journalists have been murdered to date: not one more!

0
Profile banner
LL
Lisa Ling
@aretvet.bsky.social
OEF/OIF Vet. War will not be made shorter or safer adding remote connectivity, AI, or autonomous weapons. A Western net-centric #KillCloud won’t bring us peace. disruption.institute/ disruptionlab.org/book nationalbirdfilm.com/
26 followers52 following31 posts