Android: An error occurred while trying to get the sha-256 fingerprint of the keystore file

I'm trying to create an App link but the App links assistant keeps throwing the below error in Step 3 (Associate website) while generating the assetlinks.json.

An error occurred while trying to get the sha-256 fingerprint of the keystore file. Please make sure that your keystore file is correct.

I have tried both the options but getting the same error:

1. Signing config - debug
2. Keystore file - Created a new keystore from Build > Generate signed Bundle/Apk > Apk > Create New

Am I missing something? I'm on Android Studio Arctic Fox | 2020.3.1 Patch 3 Is there a way to create the JSON file without using the App links assistant?

You can use online tool for generating this json: https://developers.google.com/digital-asset-links/tools/generator

Or create it yourself, it's really really simple file, sample: https://developers.google.com/digital-asset-links/v1/getting-started#quick-usage-example