Can I force pip to install dependencies for x86_64 architecture in powershell to make Lambda layer?

I'm trying to create a lambda layer that includes pydantic/pydantic_core (Lambda python 3.11, x86_64) but getting the following error: "Unable to import module 'reddit_lambda': No module named 'pydantic_core._pydantic_core'"

For context, I'm installing this on a windows x64 machine.

From reading up about it here, here and here, it seems that pip installing pydantic for an incompatible architecture (win_amd64).

Install log:

Using cached pydantic-2.4.2-py3-none-any.whl (395 kB)
Using cached pydantic_core-2.10.1-cp311-none-win_amd64.whl (2.0 MB)

My question: Is there a way to force pip to install packages into a directory for a specific architecture in powershell?

I saw an old discussion here, that this is possible for Linux but not sure how to do it on powershell.

FYI: I also tried adding pydantic_core from binary (tried pydantic_core-2.10.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl and pydantic_core-2.10.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl) but I'm a bit confused about which version to choose?


  • It is possible as part of the options provided by the pip CLI.

    For example given a requirements.txt file containing the necessary dependencies, you can run:

    # Create layer based on requirements.txt in python/ directory
    pip install -r requirements.txt --platform manylinux2014_x86_64 --target ./python --only-binary=:all:

    This command will create a directory named python that will contain the packages downloaded to satisfy the requirements in the requirements.txt file for the manylinux2014_x86_64 platform.

    You can change the value provided to the --platform flag according to your needs, you can see examples of available platforms in the examples here