Make vsCode not ask for gitlab ssh passphrase on push

I created the ssh key, added it on gitlab, and followed the instructions. When I do a push from git bash everything works fine, it keeps annoying me to enter the passphrase every time. But when I try to push from vsCode it doesn't ask me for the passphrase and throws an error

Git: git@gitlab.com: Permission denied (publickey,keyboard-interactive).

Is there any way to fix this? And bonus help: how can I stop it from asking me every time for the passphrase.

I know, there are similar questions around for my bonus help, but I couldn't find anything about the vsCode issue. I am using windows 11.

Sorry if the title is misleading.

I think you have given passphrase while creating the keys that is why, you need to supply passphrase everytime you commit something. One solution is that update/ re make the ssh keys without passphase and add it to gitlab.