BLUE
PV
Paul Vierthaler
@vierth.bsky.social
Chinese Lit, DH, Machine Learning
300 followers241 following95 posts
PVvierth.bsky.social

What ever it is, hell yes! Congrats!

1
Reposted by Paul Vierthaler
MJmm-jj-nn.bsky.social

New preprint from one of my colleagues in the Math department studying the dimension and Ricci curvature of the token embedding space in several LLMs, and connecting it in part to differences in model behavior (e.g. GPT2 and Mistral7b embed numerical tokens in very different ways).

The structure of the token space for large language models
The structure of the token space for large language models

Large language models encode the correlational structure present in natural language by fitting segments of utterances (tokens) into a high dimensional ambient latent space upon which the models then ...

1
Reposted by Paul Vierthaler
BTburrata.bsky.social

I wrote the official crossword for next yearā€™s aasasianstudies.bsky.social conference in Columbus. If you work in Asian Studies (in any capacity) and like puzzles, DM me if youā€™re down to test solveā€¦ itā€™s on the easy side. Thanks!

0
PVvierth.bsky.social

Oooh!! If I can swing it Iā€™ll be there!

0
Reposted by Paul Vierthaler
JKjoekatz45.bsky.social

You are being asked, now, to do the absolute smallest thing, the bare minimum, to keep this man out of power.

36
PVvierth.bsky.social

And to be fair, I'm a lit prof, not a history prof! So I suppose it still doesn't count

0
PVvierth.bsky.social

There is huge demand for this kind of course, but I think it may have been the only one of its kind taught at WM during the terms I taught it.

1
PVvierth.bsky.social

When I taught at William & Mary I taught a freshman seminar I called "Electrifying Information in China" which was precisely this. We talked about the development of information tech all the way from oracle bones through to transformer models. It was quite popular!

2
PVvierth.bsky.social

Itā€™s faint, but the aurora is visible in Princeton, NJ!

0
PVvierth.bsky.social

My condolences for your loss. I too would always call my parents when I was leaving on trips. My dad passed a few months after I started my first faculty position (in Europe). Flying home to Kansas for his funeral that first time, I fully broke down knowing I'd never get to call him again.

0
PV
Paul Vierthaler
@vierth.bsky.social
Chinese Lit, DH, Machine Learning
300 followers241 following95 posts