linuxunixsshamazon-ec2broken-pipe

EC2 ssh broken pipe terminates running process

I'am using a EC2 instance to run a large job that I estimate to take approx 24 hours to complete. I get the same issue described here ssh broken pipe ec2

I followed the suggestion/solutions in the above post and in my ssh session shell I launched my python program by the following command:

nohup python myapplication.py > myprogram.out 2>myprogram.err

Once I did this the connection remained intact longer than if I didn't use the nohup but it eventually fails with broken pipe error and I'm back to square one. The process 'python myapplication.py' is terminated as a result.

Any ideas on what is happening and what I can do to prevent this from occuring?

Solution

  • You should try screen.

    Install

    Ubuntu:

    apt-get install screen

    CentOS:

    yum install screen

    Usage

    Start a new screen session by

    $> screen

    List all screen sessions you had created

    $>screen -ls
There is a screen on:
        23340.pts-0.2yourserver    (Detached)
1 Socket in /var/run/screen/S-root.

    Next, restore your screen

    $> screen -R 23340
$> screen -R <screen-id>