I'm trying to scrape bing images using bulk-bing-image-downloader. I have a csv file that contains keywords and folder names in which I want the images to be saved:
keyword,folder,search
dog's house,animal,1
book.end,read,0
key chains,house,1
I'd like to use the values under keyword and folder as arguments to search and download images, and the value under search as a conditional statement, where if it is 1, then the code performs the search, but not if it is 0. The basic bulk-bing-image-downloader code is:
./bbid.py -s "keyword" --limit 10 --adult-filter-off -o "folder"
where keyword and folder is where I'd like to loop through each row in the csv file. I currently have the bash command set up as, but I'm super new to shell commands and have zero idea how the awk works..help please?:
awk '
BEGIN {
-F,
FPAT = "([^,]+)|(\"[^\"]+\")"
}
{
if ($1 != "keyword") {
printf("%s\n", $1)
./bbid.py -s $1 --limit 10 --adult-filter-off -o $1
}
}
' test.csv
Since you mentioned you have zero idea how awk works - get the book "Effective AWK Programming", 5th Edition, by Arnold Robbins and it will teach you how to use AWK. The most important thing for you to understand given the command you posted, though, is this: awk is not shell. Awk and shell are 2 completely different tools with completely different purposes and their own syntax, semantics, and scope. Awk is a tool for manipulating text while shell is a tool for creating/destroying files and processes and sequencing calls to tools. Awk is the tool that the people who invented shell also invented for shell to call when necessary to manipulate text.
This shell script might be what you're trying to do:
while IFS=',' read -r k f _; do
echo ./bbid.py -s "$k" --limit 10 --adult-filter-off -o "$f"
done < <(tail -n +2 file)
./bbid.py -s dog's house --limit 10 --adult-filter-off -o animal
./bbid.py -s book.end --limit 10 --adult-filter-off -o read
./bbid.py -s key chains --limit 10 --adult-filter-off -o house
Remove the echo when you're done with initial testing.