-->

Saturday, April 20, 2013

remove duplicate words in lines


simple line that *should* remove duplicate words from a text file by looking at each line independently:

while read l; do echo ${l} | tr ' ' '\n' | sort  | uniq  | tr '\n' ' ';echo ""; done < lists/challenges_test_pos_contains_duplicates.labl > lists/challenges_test_pos.labl



NOTE WELL: test it before using it

No comments:

Post a Comment