bashshellsed

Removing current line in bash during read

I'm using bash to read a file and after doing opeation on particular line ,i need to delete that line from input file.

Can you please suggest some way to do so using sed or any other way ?

i've tried using sed command like this :-

#!/bin/sh

file=/Volumes/workplace/GeneratedRules.ion

while read line;do
printf "%s\n" "$line"
sed  '1d' $file
done <$file

my aim in this program is to read one line and then deleting it.

Input :-

AllIsWell
LetsHopeForBest
YouCanMakeIt

but the output , i got is more weird than i thought.

output :-

AllIsWell
LetsHopeForBest
YouCanMakeIt
LetsHopeForBest
LetsHopeForBest
YouCanMakeIt
YouCanMakeIt
LetsHopeForBest
YouCanMakeIt

but i need to output as :

AllIsWell 
LetsHopeForBest
YouCanMakeIt

as i want to delete line after reading it.

NOTE :- i have simplified my problem here . The actual usecase is :-

I need to perform some bunch of operation on line except reading that and the input file is too long and my operation got fails in some way in between .So i want those lines which i have read to be deleted so that if i start the process again , it will not start from the beginning but at the point where it got stuck.

please help.

Solution

  • You effectively said you want your process to be restartable. Depending upon how you define the successful completion of an iteration of your while loop, you should store a line number in a separate file, x, that indicates how many lines you have successfully processed. If the file doesn't exist, then assume you would start reading at line 1.

    Otherwise, you would get the content of x into variable n and then you would start reading $file at line $n + 1.

    How you start reading at a particular line depends on constraints we don't know yet.

    One way you could do it is to use sed to put lines $n + 1 into a temporary file, remove $file and then move the temporary file to $file before your while loop begins.

    There are other solutions but each one might not elegantly satisfy your constraints.

    But you'll want to carefully consider what happens if some other process is modifying the content of $file and when it is changing the content. If it only changes the content before or after your bash script is running, then you're probably ok to continue down this path. Otherwise, you have a synchronization problem to solve.