How are they different? It's still the same brain whether you get there through chanting and meditation, or substances. I guess you could argue the plant spirits are demons giving you fake experiences...

This is the crux of it though there's only a difference in the experience if you believe you're actually leaving your body. If you don't believe astral travel outside of the body is possible then there is literally no difference it's just chemicals in your brain creating a similar experience.