Parse html file - Ideas wanted

Reply to Parse html file - Ideas wanted on Fri, 05 Apr 2019 12:13:00 GMT

Alan Kilborn — Fri, 05 Apr 2019 12:13:00 GMT

Where can i find some informations about the formatting options to separate the needed data?

This is a good starting point: https://notepad-plus-plus.org/community/topic/15765/faq-desk-where-to-find-regex-documentation

Reply to Parse html file - Ideas wanted on Fri, 05 Apr 2019 08:13:46 GMT

peterelli — Fri, 05 Apr 2019 08:13:46 GMT

Thanks to everyone, It works :-)
Unfortunately I tried the first region only to see that the html files for the other regions are a little different formatted. I have the geocode part extracted. I would love to change the script by myself to learn this thing as i have such a job more often to do.
So at the moment i try to understand -> regex = “lat:\s*(\d+.\d+?),\R\slon:\s(\d+.\d+?),\R\stitle:\s’(.+)',$”
Where can i find some informations about the formatting options to separate the needed data?

Big Thanks to @Ekopalypse for your Time and Effort.

You find the full souce under [Abbruzzo(https://www.ilturista.info/ch/borghi_castelli/abruzzo/) -> then right clic on the map and show source.

{
lat:41.7552493,lon:13.9920420,title:‘Barrea’,html:‘

Barrea » Leggi la guida
Barrea (Abruzzo): il lago e la visita al borgo fortificato

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.3566311,lon:13.6883765,title:‘Calascio’,html:‘

Calascio » Leggi la guida
Calascio (Abruzzo): la Rocca e il borgo sul Gran Sasso

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.267972,lon:13.7508313,title:‘Capestrano’,html:‘

Capestrano » Leggi la guida
Capestrano (Abruzzo): il Castello Piccolomini e la visita al borgo

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.1572699,lon:14.0029290,title:‘Caramanico Terme’,html:‘

Caramanico Terme » Leggi la guida
Caramanico Terme, cure termali nel parco della Majella

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.5192407,lon:14.0601666,title:‘Città Sant'Angelo’,html:‘

Città Sant'Angelo » Leggi la guida
Città Sant'Angelo (Abruzzo), visita al borgo lungo le sue rue

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:41.7664259,lon:13.9437777,title:‘Civitella Alfedena’,html:‘

Civitella Alfedena » Leggi la guida
Civitella Alfedena, il borgo medievale e le piste del Passo Godi

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:41.9136454,lon:13.4286243,title:‘Civitella Roveto’,html:‘

Civitella Roveto » Leggi la guida
Civitella Roveto (Abruzzo): visita al borgo della Marsica

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.8722360,lon:13.8672728,title:‘Colonnella’,html:‘

Colonnella » Leggi la guida
Colonnella (Abruzzo), week end nel borgo

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.5195408,lon:13.9724141,title:‘Elice’,html:‘

Elice » Leggi la guida
Elice (Abruzzo): visita al borgo della provincia di Pescara

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.1898146,lon:14.2199462,title:‘Guardiagrele’,html:‘

Guardiagrele » Leggi la guida
Guardiagrele (Abruzzo): visita al centro del borgo sulla Maiella

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.5821386,lon:13.6272978,title:‘Montorio al Vomano’,html:‘

Montorio al Vomano » Leggi la guida
Montorio al Vomano, il borgo in Abruzzo ai piedi del Gran Sasso

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.2359938,lon:13.7284432,title:‘Navelli’,html:‘

Navelli » Leggi la guida
Navelli (Abruzzo): visita al borgo e all'altopiano dello zafferano

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.2849815,lon:13.4741662,title:‘Ocre’,html:‘

Ocre » Leggi la guida
Ocre (Abruzzo): il Monastero fortezza di Santo Spirito e la visita al borgo

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.3569090,lon:14.4052100,title:‘Ortona’,html:‘

Ortona » Leggi la guida
Ortona (Abruzzo), vacanza nel suo mare e sulla sua spiaggia

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.0514154,lon:13.9929105,title:‘Pacentro’,html:‘

Pacentro » Leggi la guida
Pacentro (Abruzzo): alla scoperta del borgo medievale di Madonna

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:41.8885916,lon:14.0642726,title:‘Pescocostanzo’,html:‘

Pescocostanzo » Leggi la guida
Pescocostanzo: visita al Borgo Abruzzese, tra sci e natura

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.5230484,lon:13.5533933,title:‘Pietracamela’,html:‘

Pietracamela » Leggi la guida
Pietracamela, visita al borgo e al Gran Sasso d'Italia

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:41.9344729,lon:13.9774741,title:‘Rocca Pia’,html:‘

Rocca Pia » Leggi la guida
Rocca Pia (Abruzzo), visita al borgo nel Parco della Majella

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},{lat:42.2155397,lon:14.0244141,title:‘Roccamorice’,html:‘

Roccamorice » Leggi la guida
Roccamorice, visita al borgo e all'Eremo di San Bartolomeo in Legio

’,zoom:11,icon:‘/2014/images/ico_borghi_castelli.png’},

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 16:44:33 GMT

Ekopalypse — Thu, 04 Apr 2019 16:44:33 GMT

Thank you to you both for jumping in.

@Alan-Kilborn

Those things happen if you in hurry.
To quickly test scripts I use editor1 for the data and editor2 for the scripts.
Like here

@peterelli - here a slightly modified version - faster if huge files are needed to be scanned.

matches = []
regex = "lat:\s*(\d+\.\d+?),\R\s*lon:\s*(\d+\.\d+?),\R\s*title:\s*'(.+)',$"


def extract_matches(match):
    text = [match.group(i) for i in range(1, match.lastindex + 1)]
    matches.append(text)


editor.research(regex, extract_matches)
new_text = '\r\n'.join([','.join(match) for match in matches])

notepad.new()
editor.setText(new_text)

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 15:41:00 GMT

Alan Kilborn — Thu, 04 Apr 2019 15:41:00 GMT

@peterelli said:

Then i have to open the source file and use the script to extract the data? How?

With the “source file” active, do this:

Plugins (menu) > Pythonscript > Scripts > gpx

I would think that would do it.

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 15:31:33 GMT

peterelli — Thu, 04 Apr 2019 15:31:33 GMT

Thank You very much for your help. Python is now installed. How can i see if it is working?

Now i struggle a little with the script above.
I placed in the scripts folder as gpx.py
Then i have to open the source file and use the script to extract the data? How?

Please excuse my questions. If somebody has later the same situation he or she can find a solution in ths thread.

Kind Regards
Peter

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 14:56:40 GMT

Meta Chuh — Thu, 04 Apr 2019 14:56:40 GMT

@peterelli

Do i need to install something to get this script working?

yes, you need to install the pythonscript plugin.

if you are on notepad++ 7.6.3 or above you can use this:
Guide: How to install the PythonScript plugin on Notepad++ 7.6.3, 7.6.4 and above

on 7.5.9 and below you can install it using the old plugin manager.

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 12:11:40 GMT

Alan Kilborn — Thu, 04 Apr 2019 12:11:40 GMT

@Ekopalypse

What’s up with using editor1 instead of simply editor in a couple of places?

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 11:14:12 GMT

Ekopalypse — Thu, 04 Apr 2019 11:14:12 GMT

@peterelli

with a python script like this, which means you have to use PythonScript plugin,
it should create a new file with your text.
Lunch break over, as said, will follow up later today.

matches = []
regex = "lat:\s*(\d+\.\d+?),\R\s*lon:\s*(\d+\.\d+?),\R\s*title:\s*'(.+)',$"

def extract_matches(match):
    if match.lastindex > 0: 
        text = [editor1.getTextRange(*match.span(i)) for i in range(1, match.lastindex + 1)]
        matches.append(text)
            
    
editor1.research(regex, extract_matches)

new_text = ''
for match in matches:
    new_text += ','.join(match)
    new_text += '\r\n'

notepad.new()
editor.setText(new_text)

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 11:13:13 GMT

peterelli — Thu, 04 Apr 2019 11:13:13 GMT

Thank You but take your Time. Tomorrow is perfect.
Do i need to install something to get this script working?

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 11:05:59 GMT

Ekopalypse — Thu, 04 Apr 2019 11:05:59 GMT

@peterelli

ok, I hope I can finished it within my lunch break otherwise, if not someone else is
stepping in, I have to follow up later today.

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 11:05:16 GMT

peterelli — Thu, 04 Apr 2019 11:05:16 GMT

maybe it is possible to select a folder containing multiple files to combine everything in a new Notepad file or using all actual open Notepad files.
But it is optional.

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 10:56:16 GMT

peterelli — Thu, 04 Apr 2019 10:56:16 GMT

Yes, and without the last comma in every row
It looks beautiful

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 10:47:04 GMT

Ekopalypse — Thu, 04 Apr 2019 10:47:04 GMT

@peterelli

and the result you want to have is like this

45.929866,10.8264056,Canale di Tenno,
46.3756037,11.0769321,Casez,

without the single quotes sorounding the place like Casez?

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 10:42:58 GMT

peterelli — Thu, 04 Apr 2019 10:42:58 GMT

Its the souce text from the map: link text
In this case the name is the title. Excuse me.

Thank You for your Help.

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 10:33:54 GMT

Ekopalypse — Thu, 04 Apr 2019 10:33:54 GMT

I see, the markdown didn’t come through, the ** are the fields you are looking for.
But is it really a html file or something converted from json?

Reply to Parse html file - Ideas wanted on Thu, 04 Apr 2019 10:24:31 GMT

Ekopalypse — Thu, 04 Apr 2019 10:24:31 GMT

@peterelli

Looks like this might be a json file, isn’t it?
I see lat and lon but where is name? Is this the title?
Colud you give a complete example about what you have and what you want based on the example?