pythonapache-flinkflink-streamingflink-sqlpyflink

Unable to start a pyFlink job from savepoint


I'm using Flink 1.20.0, and try to submit a pyFlink job and start it from aan existed savepoint, I execute in command line:

flink run --fromSavepoint s3a://.../1a4e1e73910e5d953183b8eb1cd6eb84/chk-1 -py flink_job.py -pyFiles requirements.txt --table my_table --bucket my_bucket --secret my_secret

But Flink raise exception:

Python command line option detected but the flink-python module seems to be missing or not working as expected.

If I drop the --fromSavePoint, the job could be submitted successfully, but if I add --fromSavepoint, it will failed with exception.

What's the proper way to start a pyFlink job from savepoint?


Solution

  • I downgraded my Flink to 1.16.0, and it works fine now