Remove unicode characters within range
-
I have a large text document that includes accented characters like æøåáäĺćçčéđńőöřůýţžš. I am trying to remove all unicode characters between 0 and 96 with the intention of leaving behind these characters only so I can make sure that when I process text like these that I know what special characters I need to be able to handle.
This regular expression I would expect to work but the accented letters are still removed. I presume it’s using unicode hex code rather than number?
[\u0001-\u0096,-]I don’t see a n++ character class that would work either. Any sugestions?
-
As the manual says,
\u####notation is for Extended Search Notation, not regular expression match by character code notation. Extended search does not have range notation. Make sure you use it in the right situation.In regular expression, you use
\x{####}for four-nibble unicode characters.
[\x{0001}-\x{0096}]will match from'START OF HEADING' (U+0001)to'START OF GUARDED AREA' (U+0096)… an odd range to pick for your stated goals, but whatever makes you happy on that.And, BTW, the
,-is useless, since comma and hyphen are already in that Unicode range.With regular expression mode and regular expression syntax, it matches the right characters.
-
@PeterJones Thank you so much for not only the answer but explaining the difference notation. I may need to adjust my range but it felt like a good place to start to see what I get back from these documents.
