pysparkamazon-emr

Python version running on EMR 6.8


What version of Python does EMR 6.8 support?

It looks like previous versions of EMR supported Python 3.7 which will be deprecated in 6 months.

EMR 6.8 runs Spark 3.3.0 which supports Python up to 3.9.

I can't find the answer on the official release guide: https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-680-release.html


Solution

  • Since this question was asked, they have updated the page at https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-app-versions-6.x.html with the information you are looking for. There is now a line item for included Python version.

    emr-6.8.0 includes Python versions 2.7, 3.7.

    As of today, the latest EMR version is emr-6.14.0 which still only includes Python 3.7.