So I could set up a bluesky account like this with my record label then correct?

Yes! anyone can do it with an existing domain or buy registering a new domain through any domain registrar.

How to set your domain as your handle

Using a domain as your handle helps with account identity, verification, and portability. Here's how to set your domain as your handle.