rcompressionxzvroom

Compressing files through vroom and piping to pixz


I would like to write the mtcars data.frame to file using compression (xz in my case) using the vroom package and pixz but I can't get it to write a file. It complains that pixz does not exist even though it is installed locally.

According to the vroom vignette (https://vroom.r-lib.org/articles/vroom.html): To compress using a single thread:

vroom_write(mtcars, "mtcars.tsv.xz")

to compress using a parallel implementation and piping to pixz

vroom_write(mtcars, pipe("pixz > mtcars.tsv.xz"))


sh: pixz: command not found

Solution

  • Check that the pixz command can be found.

    You can express the full path ("/opt/homebrew/bin/pixz") or add to the default paths (variable $PATH). https://osxdaily.com/2014/08/14/add-new-path-to-path-command-line/