I want to install Puppeteer on ec2 server. So Do I need to install puppeteer and chromium on each machine on which I need to scrape data.
You'll only need to install puppeteer. puppeteer auto-downloads a version of Chromium that works with it - everything works together out of the box!
So once you've got puppeteer installed, you're already good to go!
See the puppeteer readme for more info:
https://github.com/GoogleChrome/puppeteer#readme