simple line that *should* remove duplicate words from a text file by looking at each line independently:
while read l; do echo ${l} | tr ' ' '\n' | sort | uniq | tr '\n' ' ';echo ""; done < lists/challenges_test_pos_contains_duplicates.labl > lists/challenges_test_pos.labl
NOTE WELL: test it before using it
No comments:
Post a Comment