Community
    • Login

    How to compare 2 text files and delete duplicates

    Scheduled Pinned Locked Moved Help wanted · · · – – – · · ·
    13 Posts 6 Posters 749 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • pnedevP
      pnedev
      last edited by

      Hi @JAK ,

      You can use ComparePlus but from the menu choose Find Unique Lines command. It will mark all unique lines in a file (that are not found in the other file).
      Then use Diff Visual Filters... to hide all diffs (this will hide all unique lines). Don’t worry if there is still one visible diff line on top - first document line cannot be hidden but it is not a problem for the next operation.
      Then select the file from which you’d like to remove duplicating lines (set the focus/caret in that file) and execute Delete all/selected visible lines from the ComparePlus plugin menu.
      This will do what you are trying to accomplish.

      BR

      1 Reply Last reply Reply Quote 5
      • Phil pascalP
        Phil pascal @JAK
        last edited by

        @JAK If you have done any programming, look at Lazarus, it is a very good IDE for Free Pascal, which comes with it. It is free. It has a very easy way to read a text file into a string list (1 line per list entry, used like an array). To do this sort of comparison is basic programming. And great learning a language when there is a real world example to go by.

        1 Reply Last reply Reply Quote -1
        • guy038G guy038 referenced this topic on
        • JAKJ
          JAK @PeterJones
          last edited by JAK

          @PeterJones
          Hello that first option won’t work as I’ll have no idea which duplicates were removed.
          Tried method 2, showered red for all entries that were different and white for duplicate, so used hide matches instead of hide all diffs, this his the white entries, need to do some more examples to be certain.
          When I perform these actions it appears to change the file entries, in the text file does that make sense.

          Just re-read your post, not sure if I’ve made myself clear about what I need.
          I have 2 files, DocMaster with all my music, a second DocNewMusic, which has a list of new music but also contains some tracks already listed in DocMaster, so I want to delete all entries in DocNewMusic that already exist in DocMaster, think we are on the right track, but not certain, the procedure is deleting the correct entries.
          Thanks so much for your perseverance and help. I know some visual basic, but not enough experience to write a plug in, my son writes in Unity, if he had the source code for the Compare plus plugin, maybe he could make a plugin to do what I need in one action.

          Thanks

          CennoxXC 1 Reply Last reply Reply Quote 0
          • CennoxXC
            CennoxX @JAK
            last edited by

            @JAK
            It works like PeterJones said, it’s just the other way around, let’s say DocMaster is

            old
            data
            that
            was
            already
            there
            

            and DocNewMusic is

            old
            and
            new
            data
            that
            was
            not
            already
            there
            

            Then copy the content of DocNewMusic under DocMusic

            old
            data
            that
            was
            already
            there
            ###
            old
            and
            new
            data
            that
            was
            not
            already
            there
            

            File > Line Operations > Remove Duplicate Lines
            and you are left with

            old
            data
            that
            was
            already
            there
            ###
            and
            new
            not
            

            That is DocMaster and beneath that a list of the newly added lines, the correct entries are deleted.

            JAKJ 1 Reply Last reply Reply Quote 1
            • JAKJ
              JAK @CennoxX
              last edited by

              @CennoxX
              Thank you, that’s a very simple way of achieving what I need, will definitely try this. Only downside is that I want to keep thd Master file as is, to use for comparison with future new music lists. Could make a copy for your procedure, then add the new music to it, for the next new music comparison.
              However today I used this procedure, works well, adapted it from the one posted.

              With new music file
              1-use Edit Sort lines lexicographically Ascending, just for clarity
              2-Highlight all lines then use plugins ‘remove Duplicate lines’, as there are always some duplicates
              3-open original Master file and new music file for comparison
              4-Use compare plus and ‘Compare’
              5-Then use Diff Visual Filters… to hide matches
              6-Use find unique lines
              7-copy all selected visible lines from New Music, paste into a new file, to keep them separate, then copy into the Master file, for comparison with the next New music file.

              Hope that makes sense

              This gives me a new file with all new music without any duplicates that exist in the Master file

              1 Reply Last reply Reply Quote 1
              • guy038G
                guy038
                last edited by guy038

                Hello, @jak, @peterjones, @pnedev, @phil-pascal and All,

                @jak, from this site https://www.americanmusicpreservation.com/100Songsofthe20thCentury.htm I extracted 40 songs, since 1950, that I sorted in randomize order ( Edit > Line Operations > Randomize Line Order ) and listed below :. This will represent our DocMaster.txt file

                "Maria"                                1957         w: Stephen Sondheim / m: Leonard Bernstein
                "Camelot"                              1960         w: Alan Jay Lerner / m: Frederick Loewe
                "Small World"                          1959         w: Stephen Sondheim / m: Jule Styne
                "I Will Always Love You"               1974 / 1992  w & m: Dolly Parton / arr. Whitney Houston
                "I Want to Hold Your Hand"             1964         w & m: John Lennon & Paul McCartney
                "Mack the Knife"                       1955 / 1959  w: Bertold Brecht (trans. by Marc Blitzstein) / m: Kurt Weill
                "Call Me Irresponsible"                1963         w: Sammy Cahn / m: James Van Heusen
                "Earth Angel"                          1954         w & m: Curtis Williams
                "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                "Candle in the Wind"                   1973 / 1997  w & m: Bernie Taupin & Elton John / arr.E. John
                "All the Way"                          1957         w: Sammy Cahn / m: James Van Heusen
                "Moon River"                           1961         w: Johnny Mercer / m: Henry Mancini
                "Beauty and the Beast"                 1991         w: Howard Ashman / m: Alan Menken
                "The Look of Love"                     1967         w: Hal David / m: Burt Bacharach
                "Your Cheatin' Heart"                  1952         w & m: Hank Williams
                "Three Coins in the Fountain"          1954         w: Sammy Cahn / m: Jule Styne
                "Night Fever"                          1978         w & m: Barry, Maurice and Robin Gibb
                "Goodnight Irene"                      1950         w & m: Huddie (Leadbelly) Ledbetter & Alan Lomax
                "We Are The World"                     1985         w & m: Michael Jackson & Lionel Richie
                "The Way We Were"                      1973         w: Alan & Marilyn Bergman / m: Marvin Hamlisch
                "Sincerely"                            1955         w & m: Harvey Fuqua & Alan Freed
                "True Love"                            1956         w & m: Cole Porter
                "On the Street Where You Live"         1956         w: Alan Jay Lerner / m: Frederick Loewe
                "Rock Around the Clock"                1955         w & m: Max Freedman and Jimmy DeKnight
                "The First Time Ever I Saw Your Face"  1972         w & m: Ewan MacColl
                "Just the Way You Are"                 1978         w & m: Billy Joel
                "Crazy                                 1961         w & m: Willie Nelson
                "American Pie"                         1971         w & m: Don McLean
                "Don't Be Cruel"                       1956         w & m: Otis Blackwell
                "My Way"                               1969         w: Paul Anka / m: Jacques Reveaux and Claude Francois
                "You Are the Sunshine of My Life"      1973         w & m: Stevie Wonder
                "You Belong to Me"                     1952         w & m: Pee Wee King, Redd Stewart, Chilton Price
                "What the World Needs Now is Love"     1965         w: Hal David / m: Burt Bacharach
                "High Noon"                            1952         w: Ned Washington / m: Dimitri Tiomkin
                "Yesterday"                            1965         w & m: John Lennon & Paul McCartney
                "The Shadow of Your Smile"             1965         w: Paul Francis Webster /m: Johnny Mandel
                "That's What Friends Are For"          1985         w & m: Carole Bayer Sager & Burt Bacharach
                "Hey Jude"                             1968         w & m: John Lennon & Paul McCartney
                "My Heart Will Go On"                  1997         w: Will Jennings / m: James Horner
                

                On the other hand, from this site https://collider.com/best-songs-21st-century-ranked/ I copied all the songs, that I sorted in randomize order too and listed below. This will represent our DocNewMusic.txt file !

                "All Too Well"               2021  Taylor Swift
                "Electric Feel"              2008  MGMT
                "Hey Ya!"                    2003  Outkast
                "Bad Guy"                    2019  Billie Eilish
                "Run Away with Me"           2015  Carly Rae Jepsen
                "Seven Nation Army"          2003  The White Stripes
                "Casimir Pulaski Day"        2005  Sufjan Stevens
                "Bad Romance"                2009  Lady Gaga
                "Swimming Pools (Drank)"     2012  Kendrick Lamar
                "Heartbeats"                 2002  The Knife
                "Good Luck, Babe!"           2024  Chappell Roan
                "Toxic"                      2004  Britney Spears
                "Wolf Like Me"               2006  TV on the Radio
                "Oblivion"                   2012  Grimes
                "Crazy in Love"              2003  Beyoncé & Jay-Z
                "Since I Left You"           2000  The Avalanches
                "Umbrella"                   2007  Rihanna & Jay-Z
                "Us"                         2004  Regina Spektor
                "Neighborhood #1 (Tunnels)"  2004  Arcade Fire
                "Pyramids"                   2012  Frank Ocean
                "Dancing on My Own"          2010  Robyn
                "On Melancholy Hill"         2010  Gorillaz
                "Mr. Brightside"             2003  The Killers
                "All My Friends"             2007  LCD Soundsystem
                "Runaway"                    2010  Kanye West & Pusha T
                

                As you can verify, DocMaster.txt contains songs before the 21th century ONLY and DocNewMusic.txt contains songs of the 21th century ONLY

                Now, let’s suppose that we add, on purpose, 10 songs, whose 2 are duplicates, from the DocMaster.txt file, within the DocNewMusic.txt file. We get this updated DocNewMusic.txt file, below :

                "Rock Around the Clock"                1955         w & m: Max Freedman and Jimmy DeKnight
                "All Too Well"               2021  Taylor Swift
                "Electric Feel"              2008  MGMT
                "Hey Ya!"                    2003  Outkast
                "Bad Guy"                    2019  Billie Eilish
                "Run Away with Me"           2015  Carly Rae Jepsen
                "Candle in the Wind"                   1973 / 1997  w & m: Bernie Taupin & Elton John / arr.E. John
                "Seven Nation Army"          2003  The White Stripes
                "Casimir Pulaski Day"        2005  Sufjan Stevens
                "Bad Romance"                2009  Lady Gaga
                "Swimming Pools (Drank)"     2012  Kendrick Lamar
                "I Want to Hold Your Hand"             1964         w & m: John Lennon & Paul McCartney
                "Heartbeats"                 2002  The Knife
                "Good Luck, Babe!"           2024  Chappell Roan
                "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                "Toxic"                      2004  Britney Spears
                "All the Way"                          1957         w: Sammy Cahn / m: James Van Heusen
                "Wolf Like Me"               2006  TV on the Radio
                "Oblivion"                   2012  Grimes
                "Crazy in Love"              2003  Beyoncé & Jay-Z
                "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                "Since I Left You"           2000  The Avalanches
                "Umbrella"                   2007  Rihanna & Jay-Z
                "Night Fever"                          1978         w & m: Barry, Maurice and Robin Gibb
                "Us"                         2004  Regina Spektor
                "Neighborhood #1 (Tunnels)"  2004  Arcade Fire
                "Pyramids"                   2012  Frank Ocean
                "Dancing on My Own"          2010  Robyn
                "Yesterday"                            1965         w & m: John Lennon & Paul McCartney
                "On Melancholy Hill"         2010  Gorillaz
                "Mr. Brightside"             2003  The Killers
                "All My Friends"             2007  LCD Soundsystem
                "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                "Runaway"                    2010  Kanye West & Pusha T
                

                If I understand you correctly, You would like to delete all lines of the present DocNewMusic.txt which ALSO belong to DocMaster.txt


                I’m going to describe two methods to achieve your goal. For the second one, see my next post !

                (1) By running a search/ replacement with regular expressions :

                • At the end of the DocNewMusic.txt file, add a simple line with, at least, 3 equal signs

                • Append all the contents of the DocMaster.txt file, right after that line of equal signs

                So, the DocNewMusic.txt is temporarily changed as below :

                "Rock Around the Clock"                1955         w & m: Max Freedman and Jimmy DeKnight
                "All Too Well"               2021  Taylor Swift
                "Electric Feel"              2008  MGMT
                "Hey Ya!"                    2003  Outkast
                "Bad Guy"                    2019  Billie Eilish
                "Run Away with Me"           2015  Carly Rae Jepsen
                "Candle in the Wind"                   1973 / 1997  w & m: Bernie Taupin & Elton John / arr.E. John
                "Seven Nation Army"          2003  The White Stripes
                "Casimir Pulaski Day"        2005  Sufjan Stevens
                "Bad Romance"                2009  Lady Gaga
                "Swimming Pools (Drank)"     2012  Kendrick Lamar
                "I Want to Hold Your Hand"             1964         w & m: John Lennon & Paul McCartney
                "Heartbeats"                 2002  The Knife
                "Good Luck, Babe!"           2024  Chappell Roan
                "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                "Toxic"                      2004  Britney Spears
                "All the Way"                          1957         w: Sammy Cahn / m: James Van Heusen
                "Wolf Like Me"               2006  TV on the Radio
                "Oblivion"                   2012  Grimes
                "Crazy in Love"              2003  Beyoncé & Jay-Z
                "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                "Since I Left You"           2000  The Avalanches
                "Umbrella"                   2007  Rihanna & Jay-Z
                "Night Fever"                          1978         w & m: Barry, Maurice and Robin Gibb
                "Us"                         2004  Regina Spektor
                "Neighborhood #1 (Tunnels)"  2004  Arcade Fire
                "Pyramids"                   2012  Frank Ocean
                "Dancing on My Own"          2010  Robyn
                "Yesterday"                            1965         w & m: John Lennon & Paul McCartney
                "On Melancholy Hill"         2010  Gorillaz
                "Mr. Brightside"             2003  The Killers
                "All My Friends"             2007  LCD Soundsystem
                "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                "Runaway"                    2010  Kanye West & Pusha T
                ===============
                "Maria"                                1957         w: Stephen Sondheim / m: Leonard Bernstein
                "Camelot"                              1960         w: Alan Jay Lerner / m: Frederick Loewe
                "Small World"                          1959         w: Stephen Sondheim / m: Jule Styne
                "I Will Always Love You"               1974 / 1992  w & m: Dolly Parton / arr. Whitney Houston
                "I Want to Hold Your Hand"             1964         w & m: John Lennon & Paul McCartney
                "Mack the Knife"                       1955 / 1959  w: Bertold Brecht (trans. by Marc Blitzstein) / m: Kurt Weill
                "Call Me Irresponsible"                1963         w: Sammy Cahn / m: James Van Heusen
                "Earth Angel"                          1954         w & m: Curtis Williams
                "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                "Candle in the Wind"                   1973 / 1997  w & m: Bernie Taupin & Elton John / arr.E. John
                "All the Way"                          1957         w: Sammy Cahn / m: James Van Heusen
                "Moon River"                           1961         w: Johnny Mercer / m: Henry Mancini
                "Beauty and the Beast"                 1991         w: Howard Ashman / m: Alan Menken
                "The Look of Love"                     1967         w: Hal David / m: Burt Bacharach
                "Your Cheatin' Heart"                  1952         w & m: Hank Williams
                "Three Coins in the Fountain"          1954         w: Sammy Cahn / m: Jule Styne
                "Night Fever"                          1978         w & m: Barry, Maurice and Robin Gibb
                "Goodnight Irene"                      1950         w & m: Huddie (Leadbelly) Ledbetter & Alan Lomax
                "We Are The World"                     1985         w & m: Michael Jackson & Lionel Richie
                "The Way We Were"                      1973         w: Alan & Marilyn Bergman / m: Marvin Hamlisch
                "Sincerely"                            1955         w & m: Harvey Fuqua & Alan Freed
                "True Love"                            1956         w & m: Cole Porter
                "On the Street Where You Live"         1956         w: Alan Jay Lerner / m: Frederick Loewe
                "Rock Around the Clock"                1955         w & m: Max Freedman and Jimmy DeKnight
                "The First Time Ever I Saw Your Face"  1972         w & m: Ewan MacColl
                "Just the Way You Are"                 1978         w & m: Billy Joel
                "Crazy                                 1961         w & m: Willie Nelson
                "American Pie"                         1971         w & m: Don McLean
                "Don't Be Cruel"                       1956         w & m: Otis Blackwell
                "My Way"                               1969         w: Paul Anka / m: Jacques Reveaux and Claude Francois
                "You Are the Sunshine of My Life"      1973         w & m: Stevie Wonder
                "You Belong to Me"                     1952         w & m: Pee Wee King, Redd Stewart, Chilton Price
                "What the World Needs Now is Love"     1965         w: Hal David / m: Burt Bacharach
                "High Noon"                            1952         w: Ned Washington / m: Dimitri Tiomkin
                "Yesterday"                            1965         w & m: John Lennon & Paul McCartney
                "The Shadow of Your Smile"             1965         w: Paul Francis Webster /m: Johnny Mandel
                "That's What Friends Are For"          1985         w & m: Carole Bayer Sager & Burt Bacharach
                "Hey Jude"                             1968         w & m: John Lennon & Paul McCartney
                "My Heart Will Go On"                  1997         w: Will Jennings / m: James Horner
                
                • Select the DocNewMusic.txt file

                • Open the Replace dialog ( Ctrl + H )

                • Uncheck all box options

                • SEARCH (?x-is) ^ (.+\R) (?= (?s) .+? ^===+ .+ ^ \1) | (?s) ^ ===.+

                • REPLACE Leave EMPTY

                • Tick the Wrap around option

                • Select the Regular expression search mode ( IMPORTANT )

                • Click on the Replace All button

                You should get the new DocNewMusic.txt file, below :

                "All Too Well"               2021  Taylor Swift
                "Electric Feel"              2008  MGMT
                "Hey Ya!"                    2003  Outkast
                "Bad Guy"                    2019  Billie Eilish
                "Run Away with Me"           2015  Carly Rae Jepsen
                "Seven Nation Army"          2003  The White Stripes
                "Casimir Pulaski Day"        2005  Sufjan Stevens
                "Bad Romance"                2009  Lady Gaga
                "Swimming Pools (Drank)"     2012  Kendrick Lamar
                "Heartbeats"                 2002  The Knife
                "Good Luck, Babe!"           2024  Chappell Roan
                "Toxic"                      2004  Britney Spears
                "Wolf Like Me"               2006  TV on the Radio
                "Oblivion"                   2012  Grimes
                "Crazy in Love"              2003  Beyoncé & Jay-Z
                "Since I Left You"           2000  The Avalanches
                "Umbrella"                   2007  Rihanna & Jay-Z
                "Us"                         2004  Regina Spektor
                "Neighborhood #1 (Tunnels)"  2004  Arcade Fire
                "Pyramids"                   2012  Frank Ocean
                "Dancing on My Own"          2010  Robyn
                "On Melancholy Hill"         2010  Gorillaz
                "Mr. Brightside"             2003  The Killers
                "All My Friends"             2007  LCD Soundsystem
                "Runaway"                    2010  Kanye West & Pusha T
                
                • Save these modifications which represents your expected DocNewMusic.txt file.

                Here you are ! You can verify that it remains ONLY songs of the 21th century and that all the songs from the 20th century, belonging to the DocMaster.txt file, are gone from the DocNewMusic.txt file !

                Continuation on next post

                guy038

                1 Reply Last reply Reply Quote 0
                • guy038G
                  guy038
                  last edited by guy038

                  Hi, @jak and All,

                  (2) By using the ComparePlus plugin

                  So, we start with the file DocMaster.txt, below :

                  "Maria"                                1957         w: Stephen Sondheim / m: Leonard Bernstein
                  "Camelot"                              1960         w: Alan Jay Lerner / m: Frederick Loewe
                  "Small World"                          1959         w: Stephen Sondheim / m: Jule Styne
                  "I Will Always Love You"               1974 / 1992  w & m: Dolly Parton / arr. Whitney Houston
                  "I Want to Hold Your Hand"             1964         w & m: John Lennon & Paul McCartney
                  "Mack the Knife"                       1955 / 1959  w: Bertold Brecht (trans. by Marc Blitzstein) / m: Kurt Weill
                  "Call Me Irresponsible"                1963         w: Sammy Cahn / m: James Van Heusen
                  "Earth Angel"                          1954         w & m: Curtis Williams
                  "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                  "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                  "Candle in the Wind"                   1973 / 1997  w & m: Bernie Taupin & Elton John / arr.E. John
                  "All the Way"                          1957         w: Sammy Cahn / m: James Van Heusen
                  "Moon River"                           1961         w: Johnny Mercer / m: Henry Mancini
                  "Beauty and the Beast"                 1991         w: Howard Ashman / m: Alan Menken
                  "The Look of Love"                     1967         w: Hal David / m: Burt Bacharach
                  "Your Cheatin' Heart"                  1952         w & m: Hank Williams
                  "Three Coins in the Fountain"          1954         w: Sammy Cahn / m: Jule Styne
                  "Night Fever"                          1978         w & m: Barry, Maurice and Robin Gibb
                  "Goodnight Irene"                      1950         w & m: Huddie (Leadbelly) Ledbetter & Alan Lomax
                  "We Are The World"                     1985         w & m: Michael Jackson & Lionel Richie
                  "The Way We Were"                      1973         w: Alan & Marilyn Bergman / m: Marvin Hamlisch
                  "Sincerely"                            1955         w & m: Harvey Fuqua & Alan Freed
                  "True Love"                            1956         w & m: Cole Porter
                  "On the Street Where You Live"         1956         w: Alan Jay Lerner / m: Frederick Loewe
                  "Rock Around the Clock"                1955         w & m: Max Freedman and Jimmy DeKnight
                  "The First Time Ever I Saw Your Face"  1972         w & m: Ewan MacColl
                  "Just the Way You Are"                 1978         w & m: Billy Joel
                  "Crazy                                 1961         w & m: Willie Nelson
                  "American Pie"                         1971         w & m: Don McLean
                  "Don't Be Cruel"                       1956         w & m: Otis Blackwell
                  "My Way"                               1969         w: Paul Anka / m: Jacques Reveaux and Claude Francois
                  "You Are the Sunshine of My Life"      1973         w & m: Stevie Wonder
                  "You Belong to Me"                     1952         w & m: Pee Wee King, Redd Stewart, Chilton Price
                  "What the World Needs Now is Love"     1965         w: Hal David / m: Burt Bacharach
                  "High Noon"                            1952         w: Ned Washington / m: Dimitri Tiomkin
                  "Yesterday"                            1965         w & m: John Lennon & Paul McCartney
                  "The Shadow of Your Smile"             1965         w: Paul Francis Webster /m: Johnny Mandel
                  "That's What Friends Are For"          1985         w & m: Carole Bayer Sager & Burt Bacharach
                  "Hey Jude"                             1968         w & m: John Lennon & Paul McCartney
                  "My Heart Will Go On"                  1997         w: Will Jennings / m: James Horner
                  

                  And the file DocNewMusic, below :

                  "Rock Around the Clock"                1955         w & m: Max Freedman and Jimmy DeKnight
                  "All Too Well"               2021  Taylor Swift
                  "Electric Feel"              2008  MGMT
                  "Hey Ya!"                    2003  Outkast
                  "Bad Guy"                    2019  Billie Eilish
                  "Run Away with Me"           2015  Carly Rae Jepsen
                  "Candle in the Wind"                   1973 / 1997  w & m: Bernie Taupin & Elton John / arr.E. John
                  "Seven Nation Army"          2003  The White Stripes
                  "Casimir Pulaski Day"        2005  Sufjan Stevens
                  "Bad Romance"                2009  Lady Gaga
                  "Swimming Pools (Drank)"     2012  Kendrick Lamar
                  "I Want to Hold Your Hand"             1964         w & m: John Lennon & Paul McCartney
                  "Heartbeats"                 2002  The Knife
                  "Good Luck, Babe!"           2024  Chappell Roan
                  "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                  "Toxic"                      2004  Britney Spears
                  "All the Way"                          1957         w: Sammy Cahn / m: James Van Heusen
                  "Wolf Like Me"               2006  TV on the Radio
                  "Oblivion"                   2012  Grimes
                  "Crazy in Love"              2003  Beyoncé & Jay-Z
                  "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                  "Since I Left You"           2000  The Avalanches
                  "Umbrella"                   2007  Rihanna & Jay-Z
                  "Night Fever"                          1978         w & m: Barry, Maurice and Robin Gibb
                  "Us"                         2004  Regina Spektor
                  "Neighborhood #1 (Tunnels)"  2004  Arcade Fire
                  "Pyramids"                   2012  Frank Ocean
                  "Dancing on My Own"          2010  Robyn
                  "Yesterday"                            1965         w & m: John Lennon & Paul McCartney
                  "On Melancholy Hill"         2010  Gorillaz
                  "Mr. Brightside"             2003  The Killers
                  "All My Friends"             2007  LCD Soundsystem
                  "Blowin' in the Wind"                  1962         w & m: Bob Dylan
                  "Bridge Over Troubled Water"           1970         w & m: Paul Simon
                  "Runaway"                    2010  Kanye West & Pusha T
                  

                  • First, use the Plugins > ComparePlus > Diff Visual Filters... option

                  • Check the Hide added/removed lines option and valid this choice with the OK button

                  • Then, use the specific option Plugins > ComparePlus > Find Unique lines

                  • Now, select the DocNewMusic.txt file ( IMPORTANT )

                  • Run the Plugin > ComparePlus > Delete all/selected visible lines option

                  • Run the Plugin > ComparePlus > Clear Active Compare option

                  • Finally, save the modifications of the DocNewMusic.txt file ( IMPORTANT )

                  Again, you should see that, after process, the saved version of the DocNewMusic.txt file does not contain any song of the 20th century !

                  Best Regards,

                  guy038

                  JAKJ 1 Reply Last reply Reply Quote 2
                  • JAKJ
                    JAK @guy038
                    last edited by

                    @guy038
                    Hello
                    I really appreciate all your hard work.

                    I’ve been trying myself to achieve what I need.
                    In your 2nd example, you say that the ‘modified’ new music file doesn’t have any 20th century tracks, but to get what I need, it Must have Only the 20th century tracks, as these do not appear in the master file.

                    Hope this will explain clearer what I need.

                    ​Hi

                    Just realised that I’ve not made myself clear.

                    I have 2 text files

                    1-original music collection

                    2-new music

                    What I actually need is a modified file or list of the new music file, with any tracks that exist in the original file removed.

                    So if the original file has

                    -Coldplay yellow

                    -Elton John Rocket man

                    -Beatles abbey road

                    -Beatles Love me do

                    -Beatles hey Jude

                    -Monkees daydream believer

                    And the new music file has

                    -Beatles abbey road

                    -Beatles Love me do

                    -Beatles hey Jude

                    -Monkees daydream believer

                    -The move blackberry way

                    Then the ‘modified’ new music file would only have

                    -The move blackberry way

                    'So that the ‘modified’ new music file Only has any entries that are Not in the ‘original’ file
                    👍

                    1 Reply Last reply Reply Quote 0
                    • guy038G
                      guy038
                      last edited by guy038

                      Hi, @jak, @peterjones, @pnedev, @phil-pascal and All,

                      Ah…, OK :! But it’s quite funny, @jak, because it’s exactly what I proposed in my last two posts !!!

                      Giving the initial contents of your two files :

                      • The Original Music Collection which contains :
                      Coldplay yellow
                      Elton John Rocket man
                      Beatles abbey road
                      Beatles Love me do
                      Beatles hey Jude
                      Monkees daydream believer
                      
                      • The New Music file which contains :
                      Beatles abbey road
                      Beatles Love me do
                      Beatles hey Jude
                      Monkees daydream believer
                      The move blackberry way
                      

                      (1) By running a search/ replacement with regular expressions :

                      I append, at the very end of the New music file, the contents of the Original Music Collection file, after a line of, at least, 3 equal signs, giving this temporary New music file :

                      Beatles abbey road
                      Beatles Love me do
                      Beatles hey Jude
                      Monkees daydream believer
                      The move blackberry way
                      ==========
                      Coldplay yellow
                      Elton John Rocket man
                      Beatles abbey road
                      Beatles Love me do
                      Beatles hey Jude
                      Monkees daydream believer
                      

                      Now :

                      • Switch to the New Music file

                      • Open the Replace dialog ( Ctrl + H )

                      • Uncheck all box options

                      • SEARCH (?x-is) ^ (.+\R) (?= (?s) .+? ^===+ .+ ^ \1) | (?s) ^ ===.+

                      • REPLACE Leave EMPTY

                      • Tick the Wrap around option

                      • Select the Regular expression search mode ( IMPORTANT )

                      • Click on the Replace All button

                      => You should get your expected New Music file, below :

                      The move blackberry way
                      
                      • Save the modification of the New Music file

                      (2) By using the ComparePlus plugin :

                      • First, use the Plugins > ComparePlus > Diff Visual Filters... option

                      • Check the Hide added/removed lines option and valid this choice with the OK button

                      • Then, use the specific option Plugins > ComparePlus > Find Unique lines

                      • Now, select the New Music file ( IMPORTANT )

                      • Run the Plugins > ComparePlus > Delete all/selected visible lines option

                      • Run the Plugins > ComparePlus > Clear Active Compare option

                      • Finally, save the modifications of the New Music file ( IMPORTANT )

                      Best Regards,

                      guy038

                      JAKJ 1 Reply Last reply Reply Quote 2
                      • JAKJ
                        JAK @guy038
                        last edited by

                        @guy038
                        Thanks for all the help and suggestions
                        But found Vovsoft compare two lists i
                        Which is much simpler and works perfectly

                        Thanks again for all your help

                        1 Reply Last reply Reply Quote 1
                        • guy038G
                          guy038
                          last edited by

                          Hi, @jak and All,

                          Refer to this post :

                          https://community.notepad-plus-plus.org/post/105114

                          BR

                          guy038

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post
                          The Community of users of the Notepad++ text editor.
                          Powered by NodeBB | Contributors