Finding multiple lines in multiple files and deleting just those lines

Steve Wilson

I’m probably not explaining myself very well. I created a simple test file to try. It was just

this is line 1
this is line 2
this is line 3
this is line 4

Trying for test purposes to get rid of lines 1 and 3 I put “this is line 1 \n this is line 3” in the “Find what” box. In the “Replace with” box I just clicked the mouse and hit the spacebar. Then I clicked on "Replace in files. I set search mode to regular expression and extended. I tried with no spaces before and after the \n. And I tried with using \n, instead of \n. I’m doing something wrong, but damned if I can figure out what.

Thanks again

Scott Sumner

@Steve-Wilson

I’m doing something wrong, but damned if I can figure out what.

You are doing a lot of things wrong… :-)

Say you had this text in a file:

abcdefghijklmnop

What you are currently trying in your “for test purposes” data is the equivalent of using a Find what of abcghi on the above text…and wondering why it doesn’t match.

We could give you something that would delete your desired lines in your sample text, but that would probably just elicit from you a “That’s great but the same technique doesn’t work on my real data”.

So why don’t you cough up some real data and someone will probably help you do what you want…?

Steve Wilson

I’m not sure what you’re talking about here. I used that test file just to simplify and show what I was trying to do. I’m NEVER trying to remove characters or parts of a line. I’m trying to remove lines that may be in some files and may not be in other files. Complete lines. The files are subtitles. For instance, a directory containing 200 subtitles. SOME of these subtitles contain the lines. I’d want to keep lines 1 and 2, but I’d want to get rid of line 3.

6
00:01:42,614 --> 00:01:52,950
Sync by honeybunny - corrected by chamallow35

Other subtitle files might contain the lines

16
00:01:22,611 --> 00:01:32,611
Sync by yyets.net - corrected by chamallow35

Again, I’d want to remove line 3 of that, but leave the other two lines.

So all I’m looking for is a way to tell NP++ to remove
Sync by honeybunny - corrected by chamallow35
and
Sync by yyets.net - corrected by chamallow35

and any other COMPLETE lines unnecessary in the file without my having to search and replace one line at a time. I’m NEVER trying to remove text from within a line.

Thanks again

Scott Sumner

@Steve-Wilson

It’s cool. The large font didn’t help my understanding (still quite confused), but maybe someone else will jump in. I’m out. Cheers, bro.

Steve Wilson

Sorry. I’ve got no idea what caused the large font. I assure you I didn’t do it on purpose.

But thanks again!

Steve Wilson

Okay, I think I’m making my request/explanation confusing and over-complicated. Say I have the following file:

1
00:00:06,000 --> 00:00:12,074
Sync by honeybunny - corrected by chamallow35 [line to remove]
www.Addic7ed.Com [line to remove]

2
00:00:12,920 --> 00:00:14,420
Now we’re talking. Yeah, please.

3
00:00:15,870 --> 00:00:16,980
Right here, baby. Aw…

4
00:00:20,580 --> 00:00:21,480
Over here.

5
00:00:21,480 --> 00:00:23,140
Over here, yeah, yeah.

6
00:00:32,020 --> 00:00:32,990
Over here, Kelli.

7
00:00:33,990 --> 00:00:35,810
Sync by yyets.net - corrected by chamallow35 [line to remove]
www.addic7ed.com [line to remove]

8
00:00:36,010 --> 00:00:38,390
Over here, Kelli. You
look beautiful. Right here.

9
00:00:38,390 --> 00:00:40,190
Please rate this subtitle at www.osdb.link/6hdjt [line to remove]
Help other users to choose the best subtitles [line to remove]

And in that file I’m trying to remove just the lines that I’ve marked with [line to remove].

I’m just trying to figure out what I would put in the “Find what” box, the “Replace with” box and what I would have the “Search mode” set to. I can’t figure it out.

Thanks

10
00:00:44,180 --> 00:00:45,170
Bupkes.

guy038

@steve-wilson, @scott-sumner, @terry-r and All,

Thanks for your last post which gives us useful information. However there is still a point unclear !

You previously said that you wanted to get rid of line 3. But, from your last post, it seems that your want to get rid, also, of all lines, located after the line 3 ! Am I right about it ?

Anyway, the regex S/R, below, supposes that you want to get rid of all lines :

Containing the Sync by string, with that exact case

OR

Containing the string www., of an Internet address

as well as any subsequent lines, until a true empty line

So, assuming your example, placed in a N++ new tab :

1
00:00:06,000 --> 00:00:12,074
<font color="#ffff00">Sync by honeybunny - corrected by chamallow35</font> [line to remove]
<font color="#ffff00">www.Addic7ed.Com</font> [line to remove]

2
00:00:12,920 --> 00:00:14,420
Now we’re talking. Yeah, please.

3
00:00:15,870 --> 00:00:16,980
Right here, baby. Aw…

4
00:00:20,580 --> 00:00:21,480
Over here.

5
00:00:21,480 --> 00:00:23,140
Over here, yeah, yeah.

6
00:00:32,020 --> 00:00:32,990
Over here, Kelli.

7
00:00:33,990 --> 00:00:35,810
Sync by yyets.net - corrected by chamallow35 [line to remove]
www.addic7ed.com [line to remove]

8
00:00:36,010 --> 00:00:38,390
Over here, Kelli. You
look beautiful. Right here.

9
00:00:38,390 --> 00:00:40,190
Please rate this subtitle at www.osdb.link/6hdjt [line to remove]
Help other users to choose the best subtitles [line to remove]


10
00:00:44,180 --> 00:00:45,170
Bupkes.

Open the Replace dialog ( CTRL + H )
Type, or copy/paste the regex (?-s)^.*\b(Sync by\x20|www\.).*\R(.+\R)+ in the Find what: zone
Leave the Replace with: zone EMPTY
Ticked the Wrap around option
Select the Regular expression search mode
Click once, on the Replace All button

You should obtain the expected text :

1
00:00:06,000 --> 00:00:12,074

2
00:00:12,920 --> 00:00:14,420
Now we’re talking. Yeah, please.

3
00:00:15,870 --> 00:00:16,980
Right here, baby. Aw…

4
00:00:20,580 --> 00:00:21,480
Over here.

5
00:00:21,480 --> 00:00:23,140
Over here, yeah, yeah.

6
00:00:32,020 --> 00:00:32,990
Over here, Kelli.

7
00:00:33,990 --> 00:00:35,810

8
00:00:36,010 --> 00:00:38,390
Over here, Kelli. You
look beautiful. Right here.

9
00:00:38,390 --> 00:00:40,190


10
00:00:44,180 --> 00:00:45,170
Bupkes.

Voilà !

If we’re not far from the goal, I could, next time, explain my search regex !

Best Regards,

guy038

Steve Wilson

No. I’m simply trying to get rid of the lines I’ve marked in that example with [line to remove] at the end of the line. <sigh> I’m not making myself clear. What I’m trying to do is, I think, really simple. I simply want to remove multiple lines of text from within files without having to remove them one at a time.

i said I wanted to get rid of line 3 simply to indicate that it was the third line of text that I was attempting to remove. Not the third and fourth, fifth, etc. Multiple lines containing specific text strings. In my last example I indicated those lines by appending [line to be removed] to the end of the line/string that I was wanting to be gone.

Thanks

Alan Kilborn

I would go with a find field of ^.+?\[line to remove\].*?\R and a replace box that is totally empty. That should eliminate all of the desired to be deleted lines.

guy038

Hi, @steve-wilson, @alan-kilborn, @scott-sumner, @terry-r and All,

Many thanks, Alan ! Oh my god, so simple ! Then, Steve, actually, you would like to get rid of all lines containing the literal string [line to remove], wouldn’t you ? Is it, really, the single rule needed for the regex ?

If so, of course, the Alan’s regex works fine. You could, also use, the regex (?-is)^.+\[line to remove\].*\R, which :

Catches single-line text, only, due to the (?-s) modifier
Matches the literal string [line to remove], with that exact case, due to the (?-i) modifier

Remember that the Replace with: zone remains Empty

Cheers

guy038

Steve Wilson

Could I use the regex “(?-is)^.+[first line to remove][second line to remove].*\R” (etc on the lines to remove? There are probably at least a dozen or more lines I’m trying to remove from a lot of files. I just want to avoid having to do it one file (or one line) at a time.

And, many thanks.

Steve Wilson

So, if I want to get rid of each of the following lines that may be contained
"
Sync by honeybunny - corrected by chamallow35
www.Addic7ed.Com
Sync by yyets.net - corrected by chamallow35
www.addic7ed.com
Please rate this subtitle at www.osdb.link/6hdjt
Help other users to choose the best subtitles
"
could I just use the regex (?-is)^.+Sync by honeybunny - corrected by chamallow35\www.Addic7ed.Com\Sync by yyets.net - corrected by chamallow35\www.addic7ed.com\Please rate this subtitle at www.osdb.link/6hdjt\Help other users to choose the best subtitles.*\R

guy038

Hi, @steve-wilson,

Ah, yes ! Of course, if you already placed strings, like First line to remove or Second line to remove…, in your files, just change my previous regex, as below :

(?-is)^.+\[.*line to remove\].*\R

Notes :

The modifiers (?-is) were explained previously
Then the regex matches, from beginning of line ( ^ ), any non-empty range of standard characters ( .+ ), ending with an opening square bracket symbol ( \[ )
Then matching any range, possibly empty, of standard characters ( .*), ending with the string line to remove, with that exact case, and the ending square bracket symbol ( \] )
And, finally, matching any remaining range of characters, possibly empty, of the current line ( .* ) , along with its End of Line characters ( \R ), which may be \r\n for Windows files, \n for Unix files or \r for Macintosh files
And, as the Replacement field is empty, the complete matched line, with its line-break, is, thus, deleted

Remarks :

The square bracket symbols, being regex symbols, must be escaped to be considered as literals !
Any syntax [...... line to remove], whatever text is, between the [ symbol and the string line to remove will be taken in account by the regex and the corresponding line selected for deletion

Cheers,

guy038

Steve Wilson

I REALLY do appreciate all the time you’ve put in here. I’m just not getting it. I’m going to need to input at least a dozen lines that I want gone, but if you could show me an example of a regex to remove the following six lines, it’d be terribly helpful.

Sync by honeybunny - corrected by chamallow35
www.Addic7ed.Com
Sync by yyets.net - corrected by chamallow35
www.addic7ed.com
Please rate this subtitle at www.osdb.link/6hdjt
Help other users to choose the best subtitles

I DO appreciate it. I’m just not getting it.

Terry R

I’ll quickly wade in here.
Of the examples provided and knowing that the subtitle files are for movies I’d suggest you can group some of the lines you wish to remove. For example it’s very unlikely some dialogue would include www. or <font color or even Sync by. So in effect you may not need to actually write out the lines in full. you just need enough information to uniquely identify the lines you want to remove.

May I also suggest you combine ALL the files together, order them and remove duplicates. Look at what’s left. This could quickly identify what you’re trying to remove. Then using that information you get a regex to run over the original files.

Terry

guy038

@steve-wilson, and All,

Very sorry, because we posted, rather simultaneously :-((

Your last post goes towards a completely different direction ! The syntax, that you described, cannot be used in that form !! The regex would be quite invalid :-((

So, first, are you searching these six sentences, below, with that exact syntax ?

<font color="#ffff00">Sync by honeybunny - corrected by chamallow35</font>
<font color="#ffff00">www.Addic7ed.Com</font>
Sync by yyets.net - corrected by chamallow35
www.addic7ed.com
Please rate this subtitle at www.osdb.link/6hdjt
Help other users to choose the best subtitles

I mean, could it be that, sometimes, you get lines with chamallow73 instead of chamallow35, OR these six lines never change, in all your files ?

If these 6 lines have a fix form, the generic regex, to use, is :

SEARCH (?-is)^(.*\Q...Line 1 Contents...\E.*|.*\Q...Line 2 Contents...\E.*|.*\Q...Line 3 Contents...\E.*|..........|.*\Q...Line 6 Contents...\E.*)\R

Notes :

...Line #n Contents... represents any the exact part, of the nth line, what you want to search
The \Q and \E escaped sequences ensure you that any text placed between these two boundaries, is taken, literally
The | symbol is a regex symbol to separate different alternatives to search, simultaneously
The .* syntaxes, located, before \Q and after \E are the areas, possibly empty, located before and after your different sentences to search. Note that, if a sentence represents all the contents of a line, you may suppress these .* syntaxes, in the corresponding alternative
Finally, any possible alternative, between parentheses, must begin a line ( ^ ) and ends with its line-break characters ( \R )

If we apply this generic regex to your real example, we get the following regex :

(?-is)^(.*\QSync by honeybunny - corrected by chamallow35\E.*|.*\Qwww.Addic7ed.Com\E.*|.*\QSync by yyets.net - corrected by chamallow35\E.*|.*\Qwww.addic7ed.com\E.*|.*\QPlease rate this subtitle at www.osdb.link/6hdjt\E.*|.*\QHelp other users to choose the best subtitles\E.*)\R

Et voilà :-))

Cheers,

guy038

P.S. :

I strongly advice you to read this FAQ post, on regexes, below :

https://notepad-plus-plus.org/community/topic/15765/faq-desk-where-to-find-regex-documentation/1

Terry R

The search mode is regular expression and wrap around is ticked.

Note that I haven’t included the complete line as I think the strings I’m searching for are unique enough. The .+\R sequence at the end means as long as it starts with one of the strings, also grab the remainder of the line. The ^ at the start makes sure we are starting a search at the start of a line. Thus if these strings are NOT at the start of the line, they will not be removed.

The regex includes a pipe character between the different strings (|), this allows the regexe to look for different strings all within the one expression, so you would only need to run it once to get all those alternatives removed. You can extend the regex by adding more pipe characters and other strings to search for.

Terry

Steve Wilson

Many Many thanks. I’ve managed to remove a few hundred bothersome lines from a few hundred srt files. Much faster than doing it one by one.

I DO appreciate it.

Steve

Steve Wilson

OK. Many thanks again. And I DID read that documentation. It explained a lot, but I didn’t see an answer to this:
I’ve got the following regex.

It works, but since the list of lines I’d like to remove grows, for the sake of simplicity I’d like to use this regex - it has the same expressions but the lines are separate. And reason that wouldn’t work?

That way I could easily scan to see if a line already existed and if not just put it in before the last line followed by a macro for \E .|.\Q

Thanks

Terry R

The following regex will get every one of those lines and it doesn’t care about the case of the character.

So the search is an ‘insensitive’ search, it doesn’t care whether it’s an a or an A. So first off that would save you looking for ‘WWW.’ and ‘www.’ with 2 sub expressions.

You see, there isn’t a need to type every single line you need to search for individually. If you tried you would quickly find you exceeded the limit of the regex allowed. My example identifies a complete line so long as it has the characters defined within each sub expression. They are shown between the ‘|’ characters.

As a couple of the lines are very similar to possible dialogue I’ve made the sub expression look for 2 words with ‘something’ between them. I don’t care what the ‘something’ is, only that the 2 words appear on the same line. This may also be something you wish to try.

The only issue with my example is that it will NOT grab the very last line if that is one of the lines you want. That’s because the last line doesn’t finish on a ‘\R’. I don’t think that would be a problem though, these ‘advertising’ lines would generally be in the first 100 or so lines of each subtitle file I think.

The last 3 tests (advertise your, \.com and million dollar) might potentially occur within dialogue, so you may want to expand on those, but you still should not need to include the WHOLE line.

As to why you expression didn’t work, I found it hard to read, far too much text. I just found it easier to do an example for you, maybe also because I think you are trying too hard to identify the lines. Regex is all about trying to bunch groups/strings of characters into neat buckets, that’s where it’s power lies. In your case you’re removing most of that power and trying to search for each unique line individually.

Terry

Finding multiple lines in multiple files and deleting just those lines

6 00:01:42,614 --> 00:01:52,950 <font color=“#ffff00”>Sync by honeybunny - corrected by chamallow35</font>

Other subtitle files might contain the lines

16 00:01:22,611 --> 00:01:32,611 Sync by yyets.net - corrected by chamallow35

Okay, I think I’m making my request/explanation confusing and over-complicated. Say I have the following file:

9 00:00:38,390 --> 00:00:40,190 Please rate this subtitle at www.osdb.link/6hdjt [line to remove] Help other users to choose the best subtitles [line to remove]

6
00:01:42,614 --> 00:01:52,950
<font color=“#ffff00”>Sync by honeybunny - corrected by chamallow35</font>

16
00:01:22,611 --> 00:01:32,611
Sync by yyets.net - corrected by chamallow35

9
00:00:38,390 --> 00:00:40,190
Please rate this subtitle at www.osdb.link/6hdjt [line to remove]
Help other users to choose the best subtitles [line to remove]