Cannot delete svn changelist

I recently created a changelist "test" in tortoise svn. I added various pending files with changes to this changelist. I then checked in those files and the changelist disappeared (as expected as there were no more associated files).

The problem started to arise whereby the changelist keeps reappearing randomly when file (that were not ever associated with the changelist) have pending changes.

I have tried everything as listed in the documentation to remove all files from the changelist (thus deleting the changelist) but it always returns again.

I have tried the below commands and while they work temporarily the changelist always reappears at a later date.

svn changelist --remove --recursive --cl "test" .

svn changelist --remove --changelist "test" --depth infinity .

svn st:

No reference to it there

?       .patch
?       path_to_file.java
?       path_to_file.java
M       path_to_file.java
M       path_to_file.properties

--- Changelist 'ignore-on-commit':
M       path_to_file\pom.xml
M       path_to_file\pom.xml

Edit to add imagine of tortoise:

1. Changelist does not exist after you commit it with svn commit --changelist ..., but still present in WC, if you commited just files in CL
2. --remove option doesn't destroy changelist, it just remove files from existing changelist (when properly called)

Check state of you current WC with svn st and show result here - I'm sure, you still have your changelist in it