Now I'm thinking about what an ancient Egyptian laborer drank their beer from. Ceramic? Glass?

Pottery is REALLY ancient, so probably that.

Where there's beer, people will find a way

IIRC, there would be a big communal jar and a group of people would stick long reed straws into it. Which sounds super gross, but alcohol would kill the germs? Maybe?