How to pipe command output to other commands?

88

46

Example:

ls | echo prints nothing ( a blank line, actually ). I'd expect it to print a list of files.

ls | grep 'foo', on the other hand, works as expected ( prints files with 'foo' in their name ).

What I do in these situations is something like: ls | while read OUT; do echo $OUT; done but this is rather cumbersome.

Why does piping work with some commands, but not with others ? How can I circumvent this issue ?

Mihai Rotaru

Posted 2010-09-16T13:40:08.950

Reputation: 2 299

3What do you expect ls | echo to do? why not simply run ls? – theomega – 2010-09-16T13:46:30.477

12I used the simplest example that illustrates my point. I actually encountered this problem when I was trying to make a one-liner that would show git objects in the object store and their type. So, I piped object ID's to git cat-file, but it just didn't work. Apparently, echo has the same behaviour, so I used it as an example. – Mihai Rotaru – 2010-09-16T14:10:56.137

also look at the -n command for xargs, it says how many arguments to put on subcommand. ... | xargs -n1 git cat-file – Rich Homolka – 2010-09-16T22:05:23.227

Answers

123

There is a distinction between command line arguments and standard input. A pipe will connect standard output of one process to standard input of another. So

ls | echo

Connects standard output of ls to standard input of echo. Fine right? Well, echo ignores standard input and will dump its command line arguments - which are none in this case to - its own stdout. The output: nothing at all.

There are a few solutions in this case. One is to use a command that reads stdin and dumps to stdout, such as cat.

ls | cat

Will 'work', depending on what your definition of work is.

But what about the general case. What you really want is to convert stdout of one command to command line args of another. As others have said, xargs is the canonical helper tool in this case, reading its command line args for a command from its stdin, and constructing commands to run.

ls | xargs echo

You could also convert this some, using the substitution command $()

echo $(ls)

Would also do what you want.

Both of these tools are pretty core to shell scripting, you should learn both.

For completeness, as you indicate in the question, the other base way to convert stdin to command line args is the shell's builtin read command. It converts "words" (words as defined by the IFS variable) to a temp variable, which you can use in any command runs.

Rich Homolka

Posted 2010-09-16T13:40:08.950

Reputation: 27 121

1xargs may have been what OP was looking for. – Iktys – 2015-12-16T09:03:45.497

1A very helpful an informative answer, thank you ! I'm currently learning bash, and I've seen both xargs and the $(*) notation before, but didn't pay much attention to them. Now I know just how important they are, and will definitely look into them. – Mihai Rotaru – 2010-09-16T14:41:43.207

19

ls | echo prints just a blank line because echo reads no input; the last command of the pipeline is actually echo that prints nothing but a blank line.

Generally:

a | b

makes sure that the output of a become the input of b. I suggest you to read the Pipelines section of man bash.


If you really want to use ls and echo together here's some (pretty useless) examples:

ls | xargs -L 1 echo
echo `ls`
for i in `ls` ; do echo $i ; done

cYrus

Posted 2010-09-16T13:40:08.950

Reputation: 18 102

13

If you want to echo the ls command try:

ls | xargs echo

This will call echo with the output of ls.

Nathan Fellman

Posted 2010-09-16T13:40:08.950

Reputation: 8 152

4Or ls | xargs -I {} echo {} if you want it to be called for each line individually – Alex Abdugafarov – 2014-08-25T08:25:24.600

3

Why not simply use:

echo `ls`

Or much safer:

echo "`ls -lrt`"

Urbwzrd

Posted 2010-09-16T13:40:08.950

Reputation: 31

4Or even just echo *. – Kazark – 2012-11-10T03:59:37.247