Regex or something for hosts lines sorting

dultojorze

Hello,

Could you please help me the the following search-and-replace problem I am having?

I have hosts file with list of domains form ZeroDot1

Here is the data I currently have (“before” data):

0.0.0.0 0.0.0.0ah.api.cryptopool.eu
0.0.0.0 0.0.0.0air.api.cryptopool.eu
0.0.0.0 0.0.0.0air.cryptopool.eu
0.0.0.0 0.0.0.0am.dashminer.com
0.0.0.0 0.0.0.0amsterdam.bytecoins.world
0.0.0.0 0.0.0.0antispam.api.cryptopool.eu
0.0.0.0 0.0.0.0antispam.cryptopool.eu
0.0.0.0 0.0.0.0antispam.suremine.com
0.0.0.0 0.0.0.0ap.veriblockpool.com
0.0.0.0 0.0.0.0api.bcn.unipool.pro
0.0.0.0 0.0.0.0api.bytecoins.world

Here is how I would like that data to look (“after” data):

0.0.0.0 cryptopool.eu
0.0.0.0 dashminer.com
...
etc

OR
cryptopool.eu
dashminer.com
...
etc

I tried manually with .*cryptopool.eu \n ctrl+c/ctrl+v, replace it all with blank, but there is like 250k lines.
Could you please help me with simple regex line that give only one domain, there could be lines like “hostmaster.hostmaster.hostmaster.hostmaster.hostmaster.hostmaster.hostmaster.pon4ek.triplemining.com”
Need to be “triplemining.com”. I can add 0.0.0.0 later.
I tried to understand the faq and readme but suck at english.
Thank you.

Neil Schipper

@dultojorze

Hi. If you’re confident every line starts with that exact 17 character sequence, we could start by matching that (for removal) with one of these:
^\Q0.0.0.0 0.0.0.0.\E
^.{17}

From there, we want to match the trailing “word1.word2” on the right (you’re confident that in every case exactly that form is what needs to be preserved, right? so zero cases like “hello.world.com”, right?), so we’d want to match (and capture) that after skipping everything to the left just before the second last word: .*<(\w+.\w+)

So altogether, and enforcing start & end of line boundaries, we can use this regex for Find
^.{17}.*<(\w+.\w+)$
and then we’ll replace it either without the prefix
\1
or we’ll replace it with the prefix
0.0.0.0 \1

After that, you can use Remove Duplicate Lines, a command in the Line Op group under the Edit menu. And you should be good.

guy038

Hello, @dultojorze, @neil-schipper and All,

Personnaly, from your INPUT text, below :

0.0.0.0 0.0.0.0ah.api.cryptopool.eu
0.0.0.0 0.0.0.0air.api.cryptopool.eu
0.0.0.0 0.0.0.0air.cryptopool.eu
0.0.0.0 0.0.0.0am.dashminer.com
0.0.0.0 0.0.0.0amsterdam.bytecoins.world
0.0.0.0 0.0.0.0antispam.api.cryptopool.eu
0.0.0.0 0.0.0.0antispam.cryptopool.eu
0.0.0.0 0.0.0.0antispam.suremine.com
0.0.0.0 0.0.0.0ap.veriblockpool.com
0.0.0.0 0.0.0.0api.bcn.unipool.pro
0.0.0.0 0.0.0.0api.bytecoins.world

I would use this regex S/R :

SEARCH ^.*\.(?=\w+\.\w+$)
REPLACE 0.0.0.0\x20
Tick the Wrap around option
Select the Regular expression search mode
Click once only, on the Replace All button

giving the temporary OUTPUT text :

0.0.0.0 cryptopool.eu
0.0.0.0 cryptopool.eu
0.0.0.0 cryptopool.eu
0.0.0.0 dashminer.com
0.0.0.0 bytecoins.world
0.0.0.0 cryptopool.eu
0.0.0.0 cryptopool.eu
0.0.0.0 suremine.com
0.0.0.0 veriblockpool.com
0.0.0.0 unipool.pro
0.0.0.0 bytecoins.world

Then, I would use the menu option Edit > Line operations > Remove Duplicate Lines

And you get your expected OUTPUT :

0.0.0.0 cryptopool.eu
0.0.0.0 dashminer.com
0.0.0.0 bytecoins.world
0.0.0.0 suremine.com
0.0.0.0 veriblockpool.com
0.0.0.0 unipool.pro

Voilà !

The nice thing to remember is that this command may act upon a selection of lines only !

Best Regards,

guy038

Neil Schipper

@dultojorze and @guy038,

Shame on me! My intention was that my reply be completely embedded in a literal text box!

If you're confident every line starts with that exact 17 character sequence, we could start by matching that (for removal) with one of these:
^\Q0.0.0.0 0.0.0.0.\E
^.{17}

From there, we want to match the trailing "word1.word2" on the right (you're confident that in every case exactly that form is what needs to be preserved, right? so zero cases like "hello.world.com", right?), so we'd want to match (and capture) that after skipping everything to the left just before the second last word: .*\<(\w+\.\w+)

So altogether, and enforcing start & end of line boundaries, we can use this regex for Find
^.{17}.*\<(\w+\.\w+)$
and then we'll replace it either without the prefix
\1
or we'll replace it with the prefix
0.0.0.0 \1

After that, you can use Remove Duplicate Lines, a command in the Line Op group under the Edit menu. And you should be good.

Anyway, now there are two tested solutions.