Marked text manipulation



  • Hey all,

    I know this topic is quite old, anyway decided to share solution I’ve discovered (I’m not so technical, so Python script isn’t the option for me). So, long story short, I’ve extracted a long JSON response and needed to copy 95 URLs from it only and ignore everything else. Like in @Suncatcher’s case, everything was stored in a single line.

    So, I did the following:

    1. Search for https://site.com/project/(.*?) regexp and replace all matches with \r\nhttps://site.com/project/$1\r\n so URLs were moved to separate lines;

    2. Afterward, switch to “Mark” tool, check “Bookmark line” option and mark all https://site.com/project/(.*?)
      Mark.png

    3. Finally, click “Search” menu => Bookmark => Remove unmarked lines

    That’s it, list of necessary items only (URLs in my case) was created 🎉 My case is easier comparing to topic’s author, anyway hope this will be helpful for someone in the future, cheers!

    P.S. @guy038 thanks for mentioning Bookmark feature, I’ve never used it before and it’s super helpful



  • More old thread revival…

    So I recently had a need for what is discussed in this thread, but I needed it embedded in a Pythonscript, and all I really needed was the logic conveyed by @guy038 with this solution:

    73e429e2-ebad-4f9e-afa6-4fc20ed9f426-image.png

    So I figured out the Your regex to match part for my data; I’ll use Bob|Ted here for that for purposes of illustration, and of course some sample data:

    Alice Carol Alan Bob Ted
    Ted Bob
    Bob Carol Ted
    Ted Carol
    Alice Carol
    Alice Bob
    Bob
    Alan Carol
    Alan Alice
    Bob Carol Alan
    Alice
    Bob Ted Alan
    Alice Ted
    Alan Ted
    Ted Alan Alice Carol
    Bob Ted Alice Carol
    Bob Alan Alice Carol
    Alan
    Bob Ted Alan Carol
    Ted
    Alan Bob
    Alice Carol Ted
    Alice Bob Alan
    Alice Bob Carol
    Bob Carol
    Bob Ted Alan Alice
    Alice Ted Alan
    Carol
    Alice Carol Alan
    Alice Bob Ted
    Carol Ted Alan
    

    and I coded up the Pythonscript one-liner for it based on @guy038 's regex:

    editor.rereplace(r'(?s)^.*?(Bob|Ted)|(?s).*\z', r'(?1\1\r\n)')
    

    and I thought I would end up with a number of lines with either Bob or Ted on them. What actually happened was that I ended up with a single-line result of Alice! Clearly, INCORRECT! Or at least not what I needed.

    Digging in and working on it a bit, I found a correct way to achieve it in a Pythonscript replacement, and that is:

    editor.rereplace(r'(?s)(Bob|Ted)|(?:.+?(?=(?1)))|(?:.+\z)', r'?1\1\r\n')
    

    which, for the sample data above, yields the expected:

    Bob
    Ted
    Ted
    Bob
    Bob
    Ted
    Ted
    Bob
    Bob
    Bob
    Bob
    Ted
    Ted
    Ted
    Ted
    Bob
    Ted
    Bob
    Bob
    Ted
    Ted
    Bob
    Ted
    Bob
    Bob
    Bob
    Bob
    Ted
    Ted
    Bob
    Ted
    Ted
    

    So, long story LONG, but I wanted to share that if anyone tries this technique using a script, the search regex to use might need to be altered to:

    SEARCH (?s)( Your regex to match)|(?:.+?(?=(?1)))|(?:.+\z)

    The REPLACE part is unchanged from what @guy038 provided.

    Note that I also tested it interactively in Notepad++'s Replace window and it works fine there as well, at least for my sample data.



  • Hello, @alan-kilborn and All,

    I’m really sorry, because it’s just my fault and you wouldn’t have had to look for an alternative solution :-( Indeed, the regex S/R, that I gave in my post, below, does contains an error which is not important when using the Notepad++ Replace dialog, but which seems critical when you run a Python script, involving regexes !

    https://community.notepad-plus-plus.org/topic/12710/marked-text-manipulation/8

    I suppose that this fact should be related to this “small” point, located at the end of the description of the editor.rereplace helper method :

    http://npppythonscript.sourceforge.net/docs/latest/scintilla.html?highlight=editor.rereplace#Editor.rereplace

    An small point to note, is that the replacements are first searched, and then all replacements are made. This is done for performance and reliability reasons. Generally this will have no side effects, however there may be cases where it makes a difference. (Author’s note: If you have such a case, please post a note on the forums such that it can be added to the documentation, or corrected).


    To understand the problem , let’s just use the beginning of your example text, pasted in a new N++ tab

    Alice Carol Alan Bob Ted
    Ted Bob
    Bob Carol Ted
    Ted Carol
    Alice Carol
    Alice Bob
    

    If my generic regex S/R, below, with your regex choice (Bob|Ted) is used, against this text :

    SEARCH (?s)^.*?(Bob|Ted)|(?s).*\z

    REPLACE ?1\1\r\n

    We get, after a click on the Replace All button or several clicks on the Replace button, and with the Wrap around option ticked, the following correct result :

    Bob
    Ted
    Ted
    Bob
    Bob
    Ted
    Ted
    Bob
    

    Note that I use the ^ assertion which forces the regex engine to search a range of chars beginning a line. Of course, in case of replacement, no trouble at all ! Indeed, due to the \r\n syntax, any match \1 is rewritten with a line-break. So, the next search, with the (?s) mode, automatically matches right after that line-break, added by the replacement !

    Now, let’s get back the initial text ( with Ctrl + Z ) and let’s suppose that we just want to trace the different matches of that regex S/R, using the Find Next button only. In that case, we get only 2 matches !!??

    • Obviously, the first match is :
    Alice Carol Alan Bob
    

    But the second and final match is :

     Ted
    Ted Bob
    Bob Carol Ted
    Ted Carol
    Alice Carol
    Alice Bob
    

    Why ? Well, after the first match, the caret location is right after the word Bob of the first line. So, it cannot match the string space + Ted because this string should begin the current line, due to, both, the ^ symbol and the grouping parentheses

    As the first alternative (?s)^.*?(Bob|Ted) cannot match, at this location, the regex engine tries the other alternative (?s).*\z, which, of course, matches all the remaining characters of current file, beginning with space + Ted of the 1st line !!

    BTW, I don’t understand, Alan why you got a match Alice. Indeed, when running :

    editor.rereplace(r'(?s)^.*?(Bob|Ted)|(?s).*\z', r'?1\1\r\n')
    

    I personally only get the forename Bob, which is the first word matched of the text !


    Now, it’s easy to imagine the correct regex S/R to use : it should not contain any ^ assertion and be as below :

    SEARCH (?s).*?(Bob|Ted)|(?s).*\z

    REPLACE ?1\1\r\n ( or ?1\1\n for an Unix file )

    This time, if you click, successively, on the Find Next button, you’ll be able to see the different matches of the search regex !

    And, I did verify that the one-line script, below, without the ^ symbol, gives the expected text ;-))

    editor.rereplace(r'(?s).*?(Bob|Ted)|(?s).*\z', r'?1\1\r\n')
    

    Best Regards

    guy038

    Two more points :

    • Your new regex S/R :
    editor.rereplace(r'(?s)(Bob|Ted)|(?:.+?(?=(?1)))|(?:.+\z)', r'?1\1\r\n')
    

    works correctly because it does not contain any ^ assertion !

    but, would you had added the ^ symbol, like below :

    editor.rereplace(r'(?s)(Bob|Ted)|(?:^.+?(?=(?1)))|(?:.+\z)', r'?1\1\r\n')
    

    it would had changed all your multi-lines example text as :

    Bob
    
    • The lesson of that story is :

    If you can properly visualize the different matches of a regex expression, as you expect to, when using the Find Next button, it’s likely that any replacement process, run from within a S/R script command, should work nicely, too ;-))



  • @guy038

    Thank you for the further analysis.

    I’m really sorry, because it’s just my fault and you wouldn’t have had to look for an alternative solution

    No worries at all! :-)

    I don’t understand, Alan why you got a match (of only) “Alice”. I personally only get the forename “Bob”

    Indeed! I guess “something happened” because if I re-run it now the same way I for sure get “Bob” as well! Sorry for that confusion.

    Other comments:

    I did not realize (obviously) that it was merely a case of a problem with the ^ in the original expression. :-(
    I totally jumped in to an almost wholly different solution, based upon something related I was working on.

    The lesson of that story is…

    Nice to know!



  • Hello, @alan-kilborn and All,

    So, as the result of our discussion :

    This old post    https://community.notepad-plus-plus.org/topic/12710/marked-text-manipulation/8

    have been updated    https://community.notepad-plus-plus.org/topic/19189/need-a-copy-marked-lines-feature/7

    Cheers,

    guy038



  • Semi-related info:

    Part of this current thread is about how to copy text that one has marked via Marking that requires use of a PythonScript.

    In a POST in another thread, I provide a script that will select text given conditions specified by user input. That selected text can then be copied.

    Similar results thru some different methods; enough to warrant a cross-link, I guess.



  • Can anyone explain quickly how to use the python script? As in which steps I need to do in Notepad++ to run the script.



  • @Laura-Lucas-Alday

    1. Install PythonScript using Plugins > Plugins Admin
    2. Plugins > Python Script > New Script
    3. Paste the contents and save under someName (whatever name you want)
    4. Plugins > Python Script > Scripts > someName
    5. To add a keyboard shortcut for the script:
    6. Plugins > Python Script > Configuration,
    7. select the someName script and Add to the menu
    8. Restart Notepad++
    9. someName will now be in the main Plugins > Python Script menu, not just in the Scripts submenu
    10. Settings > Shortcut Mapper > Plugin Commands will see the script, and you can assign a keyboard shortcut


  • @Laura-Lucas-Alday

    Peter maybe only made it 99.9999% clear. Perhaps the newbie 0.0001% might still be left wondering…

    Peter’s step 4 would be how you actually run the script.

    Be advised that in this particular case, you need to have some red-marked text for the script to operate on (hopefully this part is clear).

    I think there is an open issue that would make this script’s functionality a native part of Notepad++. I will try to find it…



  • This may be the issue to which I was referring: https://github.com/notepad-plus-plus/notepad-plus-plus/issues/6095



  • At the time of the earlier discussions, there was no way to copy marked text natively in Notepad++, meaning without resorting to scripting. Now (7.9.1-ish) there is:

    77ec89fb-3ad9-4602-b8ee-4d574195eebe-image.png

    Just press the indicated button after you already have marked some text.

    Note: I have added similar information in this somewhat-related other THREAD.



  • @Alan-Kilborn

    My preferred solution would have been to select all marked text because this provides more flexibility. This way the user could

    • copy
    • cut
    • delete
    • change

    the marked search results.

    To achieve that I wrote the following Lua script (intended to be used with, well, the LuaScript plugin).

    -- =============================================================================
    -- Add menu entry to select all items marked by find marks
    -- =============================================================================
    
    npp.AddShortcut("Select Marked", "", function()
      local indicatorIdx
      local pos, markStart, markEnd
      local hasMarkedItems
    
      -- Search find marks have indicator number 31
      SCE_UNIVERSAL_FOUND_STYLE = 31
    
      -- Remove selection but do not change cursor position
      editor.Anchor  = editor.CurrentPos
      hasMarkedItems = false
    
      -- Search find mark indicators and select marked text
      pos = 0
      
      while pos < editor.TextLength do
        if editor:IndicatorValueAt(SCE_UNIVERSAL_FOUND_STYLE, pos) == 1 then
          markStart = editor:IndicatorStart(SCE_UNIVERSAL_FOUND_STYLE, pos)
          markEnd   = editor:IndicatorEnd(SCE_UNIVERSAL_FOUND_STYLE, pos)
    
          if editor.SelectionEmpty or not editor.MultipleSelection then
            editor:SetSelection(markEnd, markStart)
          else
            editor:AddSelection(markEnd, markStart)
          end
    
          pos            = markEnd
          hasMarkedItems = true
        end
        
        pos = pos + 1
      end
    
      -- Scroll last selected element into view. This is only because
      -- Npp/Scintilla will do that anyway when moving the cursor next time
      if hasMarkedItems then
        editor:ScrollCaret()
      end
    end)
    

    After adding this code to the startup.lua file and restarting Notepad++, the plugin’s submenu provides a new entry Select Marked which can be assigned to a keyboard shortcut.



  • @dinkumoil said in Marked text manipulation:

    select all marked text because this provides more flexibility. This way the user could

    copy
    cut
    delete
    change

    That’s a good idea as well, especially for delete and change (although those can be achieved, on a one-off basis, by replace-with-nothing and replace-with something ops).

    Copy and cut of selected text would jam all of the text together if it were on a selection basis (probably not really useful that way).

    I noticed this new Copy Marked Text command inserts a line-ending between the individual globs of marked text, which seems to make it useful, although to tell the truth I haven’t had a real application for it myself, yet.



  • @Alan-Kilborn said in Marked text manipulation:

    Copy and cut of selected text would jam all of the text together if it were on a selection basis (probably not really useful that way).

    Yes, you are right. Up to now, I’ve used my script only for deleting and editing the selections. But especially being able to multi-edit all occurences of a search term or overwrite them by multi-paste vastly increases productivity.