I can add to this, technically when you draw "from imagination" youre taking from your visual library of references that you have in your head, using references expands this library. If you struggle with drawing from imagination, use a reference, even if you dont, use a reference, build the library!

Good point! You can also build on that library everyday by just really looking at things around you. No drawing needed. Look at the details, take a mental snapshot.