Is there any way to tell vscode to not autoimport from specific files?
No. VS Code will pick up auto imports from all files in your jsconfig or tsconfig project.
If the file should not be part of your project, you can exclude it using the excludes or includes / files configuration option in the jsconfig or tsconfig