How to make scully.io work on github pages?

I'm trying to add scully to my portfolio hosted on github pages. When I'm disabling javascript in the browser, everything stops working (website is not rendered at all). Github requires all deployable files to be in /docs folder, I've put all my scully files there. You can find the repo structure here: https://github.com/jakub-wisniowski/portfolio

and the website here: https://jakub-wisniowski.github.io/portfolio/

Any ideas how to fix it?

Try to use Scully Publish GitHub Action - https://github.com/marketplace/actions/scully-publish

name: Scully Publish

on:
  push:
    branches:
      - master

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v1
      - uses: cmgriffing/scully-gh-pages-action@v1
        with:
          access-token: ${{ secrets.ACCESS_TOKEN }}