This is something Sea of Thieves has struggled with Day 1 and something I kept bringing up time and time again in the alphas.
One of their main design philosophies is to do without traditional menus, waypoints, mini maps etc. They want you to be very grounded in the world which is also why many objects are actual physical objects in the world you need to physically move and interact with. They want you to use actual maps, landmarks, compass, etc. And its all great but I think they expanded that design too far.
There's certain aspects that just become a hassle. For instance, having some of these tall tale objects be physical can lead to frustration if they get lost or stolen. Or having limited space for voyages and needing people to come to a physical spot to vote or cancel them. Or having to either remember where to go for things, check online, or go through commendations.
Unfortunately it is one of the core design philosophies of the game. It certainly has its strengths but it does lead to a lot of frustration at the expense of immersion.
