Thanks for bringing this up. I will give some thought as to whether I can further improve this flow.
For now, I will leave you with one tip:
If you press the user button (the one with your initials) for a long second or two, it should automatically log you out. This should be easier than opening the user settings to log out and make the switching process smoother, especially if you also have Biometrics enabled for both users.
Let me know what you think!