Eliminate duplicate rows / show unique rows (only)

[Jim Biwer]

Is there a build in function that will eliminate duplicate rows automatically?
It should have to sort that data, then eliminate duplicate rows.

Example, given:
aaa
zzz
bbb
zzz
ccc
jjj
jjj

Return the following:
aaa
bbb
ccc
jjj
zzz

Thank you!

[dail]

Select all the data, do Edit > Line Operations > Sort Lines Lexicographically Ascending (or sort it by some other method in the menu). Then do a find replace in regex mode with:

Search: ^(.+?)\R(\1\R?)+
Replace: \1\r\n

This assumes you are using Windows line endings. Also I believe it is possible to record all this as a macro so then you’d be able to do it with a simple menu command or shortcut.

[greenzest]

Hi,

An easier way is to install the “TextFX Characters” plugin through the plugin manager; then Plugins > TextFx > TextFx Tools check the options : Sort ascending and Sort outputs only UNIQUE, click on Plugins > TextFx > TextFx Tools > Sort lines case insensitive et voilà :)

The options are saved so you will only need to click the sort lines next time

[Jim Biwer]

Thank you! I tried the TestFX option, it worked great. Thanks again!