regex: Parsing html tags in other tags / links and titles

Reply to regex: Parsing html tags in other tags / links and titles on Fri, 12 Mar 2021 08:20:51 GMT

Robin Cruise — Fri, 12 Mar 2021 08:20:51 GMT

of course there are others, but only @guy038 helped me and all notepad++ community with so hard to find solutions.

and I am using notepad++ and grepWin (and as for the Batch Process I using a great tool named TextCrawler)

Reply to regex: Parsing html tags in other tags / links and titles on Fri, 12 Mar 2021 02:47:43 GMT

guy038 — Fri, 12 Mar 2021 02:47:43 GMT

Hi, @robin-cruise and All,

You said :

I believe, you are the best regex developer in the entire word.

I would say definitively not the best !

For instance, just think of this man here and here.

Jan Goyvaerts :

Created the fantastic regular-expression.info site and still maintains it !
Developed all these valuable regex tools : PowerGREP, RegexBuddy, RegexMagic and EditPad Pro

This is just an example of the many developers, involved in regular expressions !

guy038

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 19:36:30 GMT

Robin Cruise — Thu, 11 Mar 2021 19:36:30 GMT

@guy038 thank you, I knew that you can do it. I believe, you are the best regex developer in the entire word.

I understood one thing. Never say “it can’t be done” and even if it can’t be done in one way, you can always find another way. Be open to another programs.

Much more important: if you give someone a new perspective, that someone will be able to see clearly the problem and to find the solution much easy.

So, my friends. Thanks a lot, from now on I know that many people understood also the power of PowerShell, and it can be used very often to modify files by integrate regex.

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 18:57:48 GMT

Alan Kilborn — Thu, 11 Mar 2021 18:57:48 GMT

@guy038

Hi Guy… it is too funny.
Now, before solving a problem, you have to solve another problem: What the problem actually is!
It’s good that you have the talent and perseverance to do that; well, it’s good for the OP I suppose.

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 19:46:56 GMT

guy038 — Thu, 11 Mar 2021 19:46:56 GMT

Hello, @robin-cruise, @alan-kilborn and All,

OMG, now I understand the all story ! In fact, you’re did not express your needs correctly, in your first post ! The File-2.tml is useless and we just can go from the result_1.hmtl file to the result.html file !

Indeed, in your first post, you said :


    Page 1 (34)
    Page 2 (29)
    Page 3 (11)

MUST BECOME:

can something like this be done with regex?

But… you SHOULD have written :


    Page 1 (34)
    Page 2 (29)
    Page 3 (11)

MUST BECOME

can something like this be done with regex?

And yes, this transformation can, indeed, be solved with ONE regex S/R only !!!

What misled me was the fact that your output file contained other values than the ones indicated in the initial file ! ( Page 66 27, Page 67 24, Page 68 07... which are completely out of scope :-(( I vainly looked for a link between, for example, the strings "Page 1">Page 1 (34) and Page 66 27 !

So, Robin, now, it’s fairly easy to get the right regex S/R !

From this initial text

===========================================================================================================================================

    Page 1 (34)
    Page 2 (29)
    Page 3 (11)

===========================================================================================================================================

with the following regex S/R :

SEARCH (?-i)^\h*

.+?\((.+?)\)

|<(ul id="myNavigation"|/ul)>\R

REPLACE ?4:

\r\n\x20\x20\x20\r\n\x20\x20\x20\x20\2\x20\3 \r\n\x20\x20\x20\r\n

we do get the expected text, totally identical to your result.html contents ! Moreover, you do not need the Powershell script any more !

===========================================================================================================================================

   
    Page 1 34 
   


   
    Page 2 29 
   


   
    Page-3 11 
   

===========================================================================================================================================

Et voilà !

Notes :

The groups used are :
- Group 1 : the part after website.com/ till the double quote, not included
- Group 2 : the title part
- Group 3 : the string between parentheses, before
- Group 4 : either the literal string
  , which must be deleted, in replacement
Ths regex string \x20\x20\x20 occurs three times, in the replacement regex, and correspond to the needed leading spaces in each
section. Changed it as desired !

Best Regards,

guy038

P.S. :

And, if you want to change the lines

.........

, ONLY inside the sections, use this second regex S/R, derived of the generic regex S/R, discussed in other topics :

SEARCH (?s-i)(?:

|(?!\A)\G)(?:(?!

).)*?\K^\h*.+?\((.+?)\)

REPLACE

\r\n\x20\x20\x20\r\n\x20\x20\x20\x20\2\x20\3 \r\n\x20\x20\x20\r\n

Now, end the job, getting rid of the literal string

literal

, with, simply :

SEARCH (?-i)<(ul id="myNavigation"|/ul)>\R

REPLACE Leave EMPTY

We need consecutive regexes S/R because the values

are used as anchors, in the first generic S/R and must not be deleted during the first regex process !

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 15:24:38 GMT

Robin Cruise — Thu, 11 Mar 2021 15:24:38 GMT

the single problem in PowerShell is that not every regex formulas that works in notepad++ works there. Seems that PowerShell don’t like \K or \G or replacement such as (?2\2)

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 15:13:19 GMT

Robin Cruise — Thu, 11 Mar 2021 15:13:19 GMT

@guy038 this is the result.html after run the PowerShell code

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 15:09:00 GMT

guy038 — Thu, 11 Mar 2021 15:09:00 GMT

Hi, @robin-cruise,

OK but could you provide the result.html file AFTER running the Powershell script !

guy038

Sorry, with my old XP SP3 machine is a bit out of date !

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 15:06:05 GMT

Robin Cruise — Thu, 11 Mar 2021 15:06:05 GMT

@guy038 result.html is just a blank file, put in the same folder with File1.html and File2.html

After you run the code in PowerShell, the output result will appear into result.html

please test the PowerShell code. You will see in result.html the structure html from the File2.html but with the values extracted from File1.html

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 15:01:32 GMT

Robin Cruise — Thu, 11 Mar 2021 15:01:32 GMT

@Alan-Kilborn said in regex: Parsing html tags in other tags / links and titles:

but this is really off-topic for a Notepad++ forum

No, sir. Is an opportunity to understand that a problem has many solution, even if people told you that isn’t possible.

By the way, the same problem can be done in LINUX, much easier…with bash script, but that’s another story.

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 15:01:47 GMT

guy038 — Thu, 11 Mar 2021 15:01:47 GMT

Hi, @robin-cruise,

But, could you provide, also, the result.html file ?

Thanks

guy038

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 14:56:51 GMT

Robin Cruise — Thu, 11 Mar 2021 14:56:51 GMT

File1.html


    Page 1 (34)
    Page 2 (29)
    Page 3 (11)

File2.html

@guy038 @Alan-Kilborn
Thank you. Please understand that finding this solution, was not easy.

First, I knew that @guy038 is one of the best REGEX developer on earth. He already gave a solution, in another post, to a PARSING html. so I thought he would succeed.

Second, in another post, someone else gave a solution with PowerShell, of another problem. I remember also that post.

So, I knew that this problem can be resolve, but I had to try both options.

Now, maybe will be a better way to handle regex and files, by integrate notepad++ them into another program such as PowerShell.

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 12:43:30 GMT

guy038 — Thu, 11 Mar 2021 12:43:30 GMT

Hi, @Robin-cruise,

Nice ! So you, finally, got a working solution.

Out of curiosity, could you provide me a short sample of your initial files file1.html with several sections and file2.html and the corresponding result.html file, created by your Powershell script

This could help me to understand which you really wanted to achieve and why I could not imagine about suitable and useful regexes !

Thanks for your cooperation !

Best Regards,

guy038

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 12:31:07 GMT

Alan Kilborn — Thu, 11 Mar 2021 12:31:07 GMT

@Robin-Cruise said in regex: Parsing html tags in other tags / links and titles:

This is the solution. Yes, it can be done with regex, but must integrated in powershell.

Ok… but this is really off-topic for a Notepad++ forum.
Whatever you’re doing could I’m sure be done in many different ways.
This isn’t a general “data manipulation” forum.

Reply to regex: Parsing html tags in other tags / links and titles on Thu, 11 Mar 2021 09:25:19 GMT

Robin Cruise — Thu, 11 Mar 2021 09:25:19 GMT

@guy038 @Alan-Kilborn This is the solution. Yes, it can be done with regex, but must integrated in powershell. Works super !

$file1 = 'c:\Folder1\file1.html'
$file2 = 'c:\Folder1\file2.html'
$result = 'c:\Folder1\result.html'
$link=@()
$title=@()
$number=@()
Get-Content -Path $file1 -Delimiter ''|ForEach-Object{
    $_|ForEach-Object{
        if($_ -match '(?<=href=").+?(?=")'){$link += $Matches.Values}
        if($_ -match '(?<=title=").+?(?=")'){$title += $Matches.Values}
        if($_ -match '(?<=\()\d+(?=\))'){$number += $Matches.Values}
    }
}
$content = Get-Content -Path $file2 -Delimiter ''
for($i=0;$i -lt $content.Count;$i++){
    $content[$i] | ForEach-Object{
        if($_ -match '(?<=href=").+?(?=")'){$link2 = $Matches.Values}
        if($_ -match '(?<=title=").+?(?=")'){$title2 = $Matches.Values}
        if($_ -match '(?<=)\d+(?=)'){$number2 = $Matches.Values}
    }
    $content[$i] -replace $link2, $link[$i] -replace $title2, $title[$i] -replace $number2, $number[$i] | Out-File -FilePath $result -Append
}

Source: https://docs.microsoft.com/en-us/answers/questions/307621/powershell-copy-strings-from-some-html-tags-to-ano.html

Reply to regex: Parsing html tags in other tags / links and titles on Tue, 09 Mar 2021 22:05:09 GMT

guy038 — Tue, 09 Mar 2021 22:05:09 GMT

Hello @Robin-cruise,

If you want me to test your two regex S/R ( Let’s say respectively, S/R A and S/R B )

I need an exact raw text which must be processed with the SR A
I need any additional action, if any, which is to be done, after processing S/R A and before processing S/R B
I need an exact raw text which must be processed with the S/R B ( Of course, it may be the result of the S/R A on the initial text )

guy038

Reply to regex: Parsing html tags in other tags / links and titles on Tue, 09 Mar 2021 21:39:12 GMT

Robin Cruise — Tue, 09 Mar 2021 21:39:12 GMT

@guy038 yes, sir. Thank you. You succeded to transform the part 1 with part 2.

My problem, or I didn’t understand to good, are those ••••

How can I change those many •••• with different words and numbers ? If I have 200 lines, I need 2 months to change those ••••

I return to my regex,

please .matches newlines and run this 2 regex

FIND: (

REPLACE BY:  \1\3\2\4
and
FIND: (title="(.*?)">.*?)(mr-1"> ).*?()
REPLACE BY:  \1\3\2 \4
With this 2 regex, I manage to make a parsing. I copy a information from part 1 to part 2. Of course, is an example of how the formula should work



Reply to regex: Parsing html tags in other tags / links and titles on Tue, 09 Mar 2021 19:46:19 GMT
guy038 — Tue, 09 Mar 2021 19:46:19 GMT
Hi, @Robin-cruise and All,
When I said, in my previous post :

More generally, you would like that any line, as below, in a 
 section :


¤¤¤¤••••



is changed into :



¤¤¤¤
¤¤¤¤ •••• •••• 
¤¤¤¤



This can be achieved with the following regex S/R, without any group :
SEARCH ^\h*
.+?

REPLACE 
\r\n    \r\n    •••••••• 
\r\n    \r\n

So, from any initial line, inside a 
 section, as below :
            ••••

You get these output lines :

    
    •••••••• 
    


Just try it out !

Now, the problem is HOW to perform this S/R, ONLY on lines inside these 
 sections, below  :

....
....
....


To do that, we’ll use, again, the generic regex, already discussed, with :
BSR = 


ESR = (?!
)

SR = ^\h*.+?

RR = \r\n    \r\n     •••• •••• 
\r\n    \r\n
Leading to this general S/R :
SEARCH (?s-i)(
|(?!\A)\G)((?!
).)*?\K^\h*.+?
REPLACE 
\r\n    \r\n    •••••••• 
\r\n    \r\n

Notes :


You must use N++ v7.9.1 or a later release, which correctly handles the \A assertion !


In replacement, everything is literal, but the parts \r\n, standing for Windows EOL


Of course, AFTER the replacement, you’ll have to change any •••• zone with its exact contents !



Let’s try this final regex S/R :

Place this sample text, below, in a N++ new tab :

...
...

    ••••
    ••••
    ••••
....
....
....
    ••••


    ••••
    ••••
    ••••


    ••••
....
....
....
    ••••
    ••••
    ••••



    ••••
    ••••
    ••••



Perform the last regex S/R, above


You’re left with the expected text :


...
...


    
    •••••••• 
    


    
    •••••••• 
    


    
    •••••••• 
    

....
....
....

    
    •••••••• 
    



    ••••
    ••••
    ••••



    
    •••••••• 
    

....
....
....

    
    •••••••• 
    


    
    •••••••• 
    


    
    •••••••• 
    




    ••••
    ••••
    ••••


You can verify that the remaining lines 
••••
 are only lines, which are outside a ............ multi-lines section, so not replaced at all !
Best Regards,
guy038
Oups !! I forgot to delete, either, the lines 
 and 
. Quite easy with :
SEARCH (?-i)<(ul id="myNavigation"|/ul)>\R
REPLACE Leave EMPTY



Reply to regex: Parsing html tags in other tags / links and titles on Tue, 09 Mar 2021 14:43:52 GMT
Robin Cruise — Tue, 09 Mar 2021 14:43:52 GMT
also, the same basic formula, for another part:
FIND: (title="(.*?)">.*?)(mr-1"> ).*?()
REPLACE BY: \1\3\2 \4
Check this 2 regex formulas I wrote in the last 2 posts, and see what has changed



Reply to regex: Parsing html tags in other tags / links and titles on Tue, 09 Mar 2021 14:37:48 GMT
Robin Cruise — Tue, 09 Mar 2021 14:37:48 GMT
simple, with the formula:
FIND: (FROM-HERE(.*?)TO-HERE.*?)(FROM-HERE).*?(TO HERE)
REPLACE BY  \1\3\2\4
for example, the first part:

    Page 1 (34)


and this:

   
    Page 66 27 
  


Please test this formula, and you will see that the link from the first text will be parse/copy to the second text.
FIND: (
REPLACE BY:  \1\3\2\4
Now, the problem is that I must replace each part differently.



Reply to regex: Parsing html tags in other tags / links and titles on Sun, 07 Mar 2021 18:06:04 GMT
Alan Kilborn — Sun, 07 Mar 2021 18:06:04 GMT
…and then some of the takers don’t even think through the logistics of their problem first, before asking for help, so the net result is that they waste the time of the helpers and any of the thread’s readers.  :-(



Reply to regex: Parsing html tags in other tags / links and titles on Sun, 07 Mar 2021 17:41:51 GMT
guy038 — Sun, 07 Mar 2021 17:41:51 GMT
Hi, @robin-cruise,
Sorry, but I still do not see what you want to achieve ??!!
How, on earth, do you think a regular expression can make the link between Page 1 and Page 66 or between numbers (34) and 27 ??
BR
guy038



Reply to regex: Parsing html tags in other tags / links and titles on Sun, 07 Mar 2021 17:01:13 GMT
Robin Cruise — Sun, 07 Mar 2021 17:01:13 GMT
@Robin-Cruise said in regex: Parsing html tags in other tags / links and titles:

https://my-website.com/page-66.html” title=“Page 66”>

hello. So, basicaly, this line is almost the same in both parts, having:  and title=, even the name of the link and the name of the title is different. For this it can be done a parsing.



with this


the last part is a little tricky, I have to import the values PAGE and NUMBER OF THE PAGE, for one place to another:
Page 1 (34) must become   Page 66 
and
(34) should become  27