Eliminate duplicate rows / show unique rows (only)



  • Is there a build in function that will eliminate duplicate rows automatically?
    It should have to sort that data, then eliminate duplicate rows.

    Example, given:
    aaa
    zzz
    bbb
    zzz
    ccc
    jjj
    jjj

    Return the following:
    aaa
    bbb
    ccc
    jjj
    zzz

    Thank you!



  • Select all the data, do Edit > Line Operations > Sort Lines Lexicographically Ascending (or sort it by some other method in the menu). Then do a find replace in regex mode with:

    Search: ^(.+?)\R(\1\R?)+
    Replace: \1\r\n

    This assumes you are using Windows line endings. Also I believe it is possible to record all this as a macro so then you’d be able to do it with a simple menu command or shortcut.



  • Hi,

    An easier way is to install the “TextFX Characters” plugin through the plugin manager; then Plugins > TextFx > TextFx Tools check the options : Sort ascending and Sort outputs only UNIQUE, click on Plugins > TextFx > TextFx Tools > Sort lines case insensitive et voilà :)

    The options are saved so you will only need to click the sort lines next time



  • Thank you! I tried the TestFX option, it worked great. Thanks again!


Log in to reply