If I setup Passkey, am I gonna have to whip out my phone every time I boot up the PS5?

Or is it only when it would otherwise ask for my actual password and not just the pin for my profile?