I can open a new git tab in windows terminal but if I click on the button in the context menu "git bash here" it opens in its own window.
(As of Terminal v1.16)
Besides just changing your default profile to git bash, this currently isn't possible. This is currently tracked in Add a explorer context menu entry to let the user pick the profile they want to "open here", microsoft/terminal#6111