As part of an ongoing project, I'm using a subscription-based scraping service to collect video metadata and links from various public platforms. I'm applying it to several content categories, which quickly increases costs.
I'm looking for more affordable alternatives, or ideally, technical solutions that I could host myself. Here are my main needs:
Scraping videos or metadata from (public) video platforms.
Support for multiple categories or themes.
Ability to filter and structure data according to simple criteria.
I'm open to:
Recommended libraries or frameworks (Python, Node.js, etc.).
More affordable services.
Or collaborating with developers who can create custom functions/scripts.
I should point out that I don't scrape any private content or content protected by access restrictions.
Thank you in advance for your feedback or ideas.
You can significantly cut costs by hosting your own solution. Here are some options:
Python Libraries:
yt-dlp: For YouTube and many other platforms.
BeautifulSoup + requests or Scrapy: For metadata scraping from HTML.
youtube-search-python: For structured YouTube metadata.