Performing atomic write operations in a file in bash
It seems you need to use flock
as in the example from man (http://linux.die.net/man/1/flock)
(
flock -x 200
# Put here your commands that must do some writes atomically
) 200>/var/lock/mylockfile
And put all your commands that must be atomic in ().
flock
is one of the ways of interlocking operations. The utility is part of the util-linux toolset and is only available for Linux. Other utilities, available across a wider range of platforms, are based around Daniel J. Bernstein's setlock
utility from his daemontools package:
setlock
from daemontoolssetlock
from Bruce Guenter's daemontools-encores6-setlock
from Laurent Bercot's s6chpst
from Gerrit Pape's runitrunlock
from Wayne Marshall's perpsetlock
from my nosh toolset
These tools operate with a slightly different paradigm to that used in M. Kurenkov's answer (one that flock
can also employ, but does not in that answer). One invokes the setlock
program to chain load to the command that must be interlocked. setlock
itself opens and locks the lock file, and leaves a file descriptor for it open in its process. The lock persists for as long as that process does (unless the subsequent command chained to explicitly releases the lock by finding and closing the open file descriptor).
For the case in the question one must interlock the command that produces the output line, being aware that this invokes an external echo
in place of a shell built-in echo
command:
setlock mylockfile echo "$RESULT" >> ./$TEMP_DIR/$OUT_FILE
In this case it is not necessary to interlock opening the output file in append mode. If it were, one would have to open that file within the lock, which necessitates either using programs like fdredir
/redirfd
:
setlock mylockfile fdredir --append 1 "./$TEMP_DIR/$OUT_FILE" echo "$RESULT"which one can turn into a shell function if one wants:
outfile() { setlock mylockfile fdredir --append 1 "./$TEMP_DIR/$OUT_FILE" "$@" ; }or sticking with the shell syntax and having it interpreted by a second shell running under the interlock, requiring some non-trivial quoting if one's shell variables are not exported as environment variables:
[…]
outfile echo "$RESULT"
setlock mylockfile sh -c 'echo '"$RESULT"' >> "./'$TEMP_DIR'/'$OUT_FILE'"'
This of course generalizes to things other than writing to output files:
setlock mylockfile sh -c '… interlocked ; stuff …'