I modified PowerShell script from PowerShell - Batch change files encoding To UTF-8.
# Modified version of https://stackoverflow.com/q/18684793
[Threading.Thread]::CurrentThread.CurrentUICulture = 'en-US'
$Encoding = New-Object System.Text.UTF8Encoding($True) # If UTF8Encoding($False), It will be UTF-8 without BOM
$source = "C:\Users\AKULA\Desktop\SRC" # source directory
$destination = "C:\Users\AKULA\Desktop\DST" # destination directory
if (!(Test-Path $destination)) {
New-Item -Path $destination -ItemType Directory | Out-Null
}
# Delete all previously generated file
Get-ChildItem -Path $destination -Include * -File -Recurse | ForEach-Object {$_.Delete()}
# Recursively convert all files into UTF-8
foreach ($i in Get-ChildItem $source -Force -Recurse -Exclude "desktop.ini") {
if ($i.PSIsContainer) {
continue
}
$name = $i.Fullname.Replace($source, $destination)
$content = Get-Content $i.Fullname
if ($null -ne $content) {
[System.IO.File]::WriteAllLines($name, $content, $Encoding)
} else {
Write-Host "No content from: $i"
}
}
But after using it, I've found that PS cannot handle [
or ]
well.
I made some test files that has diversity in name/content.
Get-Content : An object at the specified path C:\Users\AKULA\Desktop\SRC\FILENAME[[[[[[]]]]]]]].txt does not exist, or
has been filtered by the -Include or -Exclude parameter.
At C:\Users\AKULA\Desktop\Convert_to_UTF-8.ps1:24 char:16
+ $content = Get-Content $i.Fullname
+ ~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : ObjectNotFound: (System.String[]:String[]) [Get-Content], Exception
+ FullyQualifiedErrorId : ItemNotFound,Microsoft.PowerShell.Commands.GetContentCommand
Since I cannot embed images in question, here is link of IMGUR album.
Full image list: https://i.sstatic.net/LtSBS.jpg
These are what I've tested:
'
,
[]
. Also made up different language(Japanese, Korean).How can I make my script handle [
or ]
in file name well?
tl;dr
Indeed, use of the -LiteralPath
parameter is the best solution (in PowerShell (Core) v6+, you can shorten to -lp
):
$content = Get-Content -LiteralPath $i.Fullname
-LiteralPath
ensures that $i.Fullname
is taken verbatim (literally); that is, [
and ]
in the path are interpreted as themselves rather than having special meaning, as they would have as a -Path
argument, due to being interpreted as a wildcard expression - note that -Path
is positionally implied if you only pass a value (a string) as the first argument, as you did (Get-Content $i.FullName
)
Note: This answer analogously applies to all cmdlets that have both -Path
and -LiteralPath
parameters, such as Set-Content
, Out-File
, and Set-Location
.
As for what you tried:
$content = Get-Content $i.Fullname
is effectively the same as:
$content = Get-Content -Path $i.Fullname
That is, the (first) positional argument passed to Get-Content
is implicitly bound to the
-Path
parameter.
The -Path
parameter accepts wildcard expressions to allow matching paths by patterns; in addition to support for *
(any run of characters) and ?
(exactly 1 character), [...]
inside a wildcard pattern denotes a character set or range (e.g., [12]
or [0-9]
).
Therefore an actual path that contains [...]
, e.g., foo[10].txt
, is not recognized as such, because the [10]
is interpreted as a character set matching a single character that is either 1
or 0
; that is foo[10].txt
would match foo0.txt
and foo1.txt
, but not a file literally named foo[10].txt
.
When (implicitly) using -Path
, it is possible to escape [
and ]
instances that should be interpreted verbatim, namely via the backtick (`
), but note that this can get tricky to get right when quoting and/or variable references are involved.
If you know a path to be a literal path, it is best to form a habit of using -LiteralPath
(which in PowerShell Core you can shorten to -lp
).
However, if your path contains literal [
and ]
and you also need wildcard matching, you must use `
-escaping - see this answer.