I'm using Flink 1.20.0, and try to submit a pyFlink job and start it from aan existed savepoint, I execute in command line:
flink run --fromSavepoint s3a://.../1a4e1e73910e5d953183b8eb1cd6eb84/chk-1 -py flink_job.py -pyFiles requirements.txt --table my_table --bucket my_bucket --secret my_secret
But Flink raise exception:
Python command line option detected but the flink-python module seems to be missing or not working as expected.
If I drop the --fromSavePoint
, the job could be submitted successfully, but if I add --fromSavepoint
, it will failed with exception.
What's the proper way to start a pyFlink job from savepoint?
I downgraded my Flink to 1.16.0, and it works fine now