Think like Spider-Man. Watch footage of the recent PS5 Spider-Man games and see if you can figure out where he keeps pulling his phone from.

Aside from that I think your approach with another pair of shorts is handy but defeats the lightweight aspect of the leggings.