Deactivating a device admin app but button is disabled

I created a device admin app that I have installed for company specific devices but I cannot seem to deactivate it once its installed and enabled as the button is disabled

is there a special manifest permission or something that needs to be added?

doing the command adb shell dpm remove-active-admin does nothing either and I get the error

SecurityException: Attempt to remove non-test admin.

I see other admin apps like Googles Find My Device ass has the button enabled so I am not sure what the difference is.

Any insight would be great

Judging by the description on the screenshot, your device admin is in fact a Device Owner. According to the API documentation :

A device owner app is a special device admin that cannot be deactivated by the user, once activated as a device admin. It also cannot be uninstalled.

The correct way to get rid of it is to wipe the device (if allowed by the said DO)