• Login
Community
  • Login

Insert Unicode characters not working - please help

Scheduled Pinned Locked Moved Help wanted · · · – – – · · ·
19 Posts 6 Posters 6.2k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Z
    ZsoltKántor
    last edited by Jul 11, 2021, 9:12 AM

    Hello!
    I followed this topic to insert unicode characters in Notepad++
    https://community.notepad-plus-plus.org/topic/17775/how-to-quick-insert-unicode-characters-in-notepad/2?_=1625994482993

    but for me it is not working.

    E.g. want to insert U+22d5 which is the symbol ⋕
    When I write Alt-+22d5 a ♣ symbol is inserted instead.
    My document is UTF-8, I’m using Notepad++ 8.1.1

    What am I doing wrong? please help!

    1 Reply Last reply Reply Quote 0
    • G
      guy038
      last edited by guy038 Jul 11, 2021, 11:27 AM Jul 11, 2021, 11:10 AM

      Hello, @zsolt-kántor-0 and All,

      You did a small mistake !

      In order to get the character of Unicode code-point U+22D5 :

      • Preferably, ensure that the Numlock key is enabled !

      • Hold down the Alt key

      • First, press the + key of the numeric keypad ( Important ! )

      • Then press, successively, on each digit of the hexadecimal code :

        • If it’s a number, between 0 and 9, press the corresponding key on the numeric keypad

        • if it’s a letter, between A and F, press the corresponding key on the main keyboard

      • Release the Alt key

      => The ⋕ character should appear at caret position !


      You probably forgot to press, first, the + key on the numeric keypad. So, your OS thought you were typing a classical Alt and 0nnn sequence ( with 000 < nnn < 255 ) which can produce all the characters of your ANSI encoding, visible with the Edit > Character Panel N++ menu option !

      And, as letters are not allowed in the sequence, because nnn is a 3-digits number, the OS just considered the sequence ALT and 5, which finally returns the ♣ character !

      Refer to the 3 chapters DOS, Windows and Transition to Unicode of the page :

      https://en.wikipedia.org/wiki/Alt_code

      Best Regards,

      guy038

      1 Reply Last reply Reply Quote 2
      • Z
        ZsoltKántor
        last edited by Jul 11, 2021, 1:59 PM

        Thanks for the explanation @guy038 , but I think the problem is different. There are unicode characters which can’t be displayed in Np++?
        Also, I pressed the + (plus) on the Num pad, so that is not a problem.

        Try to print U+0388, that is Έ
        Here we have no characters, and still trying to insert that character I end up inserting: „ (a quotation mark)

        Can you try please U+0388 on your side?
        Thanks!

        1 Reply Last reply Reply Quote 0
        • G
          guy038
          last edited by Jul 11, 2021, 9:03 PM

          Hi, @zsolt-kántor-0 and All,

          I don’t understand why you cannot achieve this operation ?

          • If I press, successively, the +, 0, 3, 8 and 8 keys, on the numeric keypad, while holding down the Alt key, I do get the Έ character ( GREEK CAPITAL LETTER EPSILON WITH TONOS ), once the Alt key released !

          Refer to https://www.unicode.org/charts/PDF/U0370.pdf

          • If I press, successively, the 0, 3, 8 and 8 keys, on the numeric keypad, I do get the „ character ( DOUBLE LOW-9 QUOTATION MARK ). Why ? Because :

            • First the decimal input 0388 is evaluated modulo 256 so, giving the decimal value 0132

            • Then, the character, of numeric value 132 ( and hex value 84 ) is the ANSI character „, which stands for the Unicode character of code-point U+201E ( DOUBLE LOW-9 QUOTATION MARK )


          Thus, may be, your system don’t have the recent Unicode input method ! In that case, you’ll have to edit the Registry and follow the method described in the Transition to Unicode chapter of this page :

          https://en.wikipedia.org/wiki/Alt_code

          which says :

          So a method was developed to enter Unicode, in Windows, using the hexadecimal code point. To enable it, a user must :

          • Set or create a string, of type (REG_SZ), value called EnableHexNumpad in the registry key HKEY_CURRENT_USER\Control Panel\Input Method\
          • Assign the value data 1 to this key
          • Reboot or log out/in

          => A leading +, on the numeric keypad, then allows entry of a hexadecimal Unicode value (using the main keyboard for A–F )

          b30b3c3b-814b-4a3c-a6fe-f35ec680fcb5-image.png

          Best Regards,

          guy038

          D 1 Reply Last reply Aug 27, 2024, 5:39 AM Reply Quote 2
          • Z
            ZsoltKántor
            last edited by ZsoltKántor Jul 12, 2021, 12:16 AM Jul 12, 2021, 12:14 AM

            Thank you! The registry editing method solved my problem.
            Probably in Windows 7 (what I use) this kind of unicode input is not enabled by default. I did not mentioned what Windows version I use, because I did not even imagine that Win7 does not supports this by default.

            Thanks again!

            1 Reply Last reply Reply Quote 0
            • Z
              ZsoltKántor
              last edited by Jul 12, 2021, 12:34 AM

              I observed a strange behavior of Np++
              There are some unicode chars that are not displayed in the editor, but are well displayed in the Windows notepad.exe

              e.g.:
              U+2230 ( ∰ ) volume integral symbol
              U+2231 ( ∱ ) clockwise integral symbol

              In Np++ a box appears instead the symbol:
              Clipboard01.jpg

              In notepad.exe symbols look fine:
              Clipboard02.jpg

              1 Reply Last reply Reply Quote 0
              • G
                guy038
                last edited by guy038 Jul 12, 2021, 1:23 AM Jul 12, 2021, 1:18 AM

                Hi, @zsolt-kántor-0 and All,

                The fact that you see small boxes, instead of real characters, means that :

                • Your current N++ font cannot handle these characters

                • Your OS did not find out a substitute font to display the character glyphs

                • Finally, your OS did not find out a fallback font, too !


                As for me, I generally use the monospaced font Consolas and the current version of this font ( on my old Win XP SP3 laptop ! ) just displays boxes with an question mark inside !

                But , if I change the default font in Settings > Style configurator... > Global Styles > Default style > Font style > Font name and choose, for instance, Lucida Sans Unicode or Microsoft Sans Serif or Tahoma, I do get the characters ∰ and ∱ :-))

                I bet your Notepad.exe current font is Microsoft Sans Serif, isn’t it ?

                Best Regards

                guy038

                1 Reply Last reply Reply Quote 2
                • Z
                  ZsoltKántor
                  last edited by Jul 12, 2021, 7:07 AM

                  Thanks for the detailed explanations and for your help.
                  It is strange, but notepad.exe font is Lucida Console and for Np++ is the same. And notepad.exe do displays those symbols but Np++ does not with the same font configuration.

                  PeterJonesP 1 Reply Last reply Jul 12, 2021, 1:20 PM Reply Quote 0
                  • PeterJonesP
                    PeterJones @ZsoltKántor
                    last edited by Jul 12, 2021, 1:20 PM

                    @Zsolt-Kántor-0 said in Insert Unicode characters not working - please help:

                    notepad.exe font is Lucida Console and

                    Lucida Console does not have those glyphs, as of the version that came with my Windows 10 machine:
                    76712ed2-5d20-4744-8221-100e08e9b575-image.png

                    Lucida Sans Unicode does have them.
                    f849434d-c9a7-4009-94c8-819794220883-image.png

                    As @guy038 explained, Windows sometimes chooses a fallback font compared to the font you have set in a given application… But I’ve found that Windows favors doing that substitution in built-in Microsoft apps; whereas in externally-produced applications like Notepad++, Windows OS seems less-likely to apply the fallback fonts.

                    Sites like fileformat.info will show lists of fonts that do contain a glyph for a particular

                    • U+2230 ( ∰ ) volume integral symbol @ https://www.fileformat.info/info/unicode/char/2230/fontsupport.htm
                    • U+2231 ( ∱ ) clockwise integral symbol @ https://www.fileformat.info/info/unicode/char/2231/fontsupport.htm

                    So if you can find a monospace font there that meets your font licensing requirements, you could download that font and set it as the font you use in Notepad++. (What annoys me is that all of the Deja Vu fonts, except the Deja Vu Sans Mono that I use in NPP, support those glyphs.)

                    1 Reply Last reply Reply Quote 2
                    • Z
                      ZsoltKántor
                      last edited by Jul 12, 2021, 10:55 PM

                      Thank you @PeterJones , you helped me a lot (@guy038 also). It is clear now for me how symbols/glyphs are displayed. I’ve also tested Lucida sans unicode and those symbols do appear in Np++

                      Alan KilbornA 1 Reply Last reply Jul 15, 2021, 7:18 PM Reply Quote 0
                      • Alan KilbornA
                        Alan Kilborn @ZsoltKántor
                        last edited by Jul 15, 2021, 7:18 PM

                        @ZsoltKántor

                        You may also want to try this setting enabled for your situation:

                        5a735017-788a-44ca-9d79-5eb2bffbbb96-image.png

                        PeterJonesP Z 2 Replies Last reply Jul 15, 2021, 7:34 PM Reply Quote 2
                        • PeterJonesP
                          PeterJones @Alan Kilborn
                          last edited by PeterJones Jul 15, 2021, 7:36 PM Jul 15, 2021, 7:34 PM

                          @Alan-Kilborn said in Insert Unicode characters not working - please help:

                          You may also want to try this setting enabled for your situation

                          Checking for confirmation: When I pasted the text into my v8.1.1 with DirectWrite checked, it showed the fancy integral characters; if I have DirectWrite unchecked (and re-start NPP, of course) then it doesn’t render. And both of those were with the same Deja Vu Sans Mono font, which doesn’t natively have those glyphs. (Same results with a fresh unzip with Courier New selected). So yes, I think there’s a good chance that turning on the DirectWrite option will help the @ZsoltKántor, even if the active font doesn’t have them.

                          I wonder if there’s ever a good reason for having that option off? Should we lobby Don to change the default state of that option for future versions? (it might head off questions like this in the future)

                          Alan KilbornA PeterJonesP 2 Replies Last reply Jul 15, 2021, 7:41 PM Reply Quote 1
                          • Alan KilbornA
                            Alan Kilborn @PeterJones
                            last edited by Alan Kilborn Jul 15, 2021, 7:42 PM Jul 15, 2021, 7:41 PM

                            @PeterJones said in Insert Unicode characters not working - please help:

                            I wonder if there’s ever a good reason for having that option off? Should we lobby Don to change the default state of that option for future versions? (it might head off questions like this in the future)

                            I think I saw some discussion somewhere that having it on can cause performance issues.

                            So maybe it is 6-of-one, half-a-dozen of the other: Do we want more my-characters-don’t-display questions, or more my-N++ -is-slow questions? :-)

                            I always run with DirectWrite on, but I don’t do a lot of things with file types that appear to be cycle-hogs (e.g. XML). But, thinking about it now, even careting through N++'s config file xml stuff is rather slow for me – perhaps it is related to DirectWrite? Hmmm…

                            1 Reply Last reply Reply Quote 1
                            • PeterJonesP
                              PeterJones @PeterJones
                              last edited by PeterJones Jul 15, 2021, 7:44 PM Jul 15, 2021, 7:44 PM

                              @PeterJones said in Insert Unicode characters not working - please help:

                              I wonder if there’s ever a good reason for having that option off?

                              A quick search of the forum shows:

                              • some find DirectWrite more fuzzy
                              • LineWrap issue
                              • Split-line Margin issues
                                …

                              After those three, I stopped following the links. I can see that whatever the default state of that toggle, we’re going to get questions about why NPP works the way it does (or outright complaints about how awful the most recent change was). No point in changing the default, I guess. :-)

                              Alan KilbornA 1 Reply Last reply Jul 15, 2021, 8:22 PM Reply Quote 1
                              • Alan KilbornA
                                Alan Kilborn @PeterJones
                                last edited by Jul 15, 2021, 8:22 PM

                                @PeterJones said in Insert Unicode characters not working - please help:

                                No point in changing the default

                                It’s always a “hard sell” to get a default changed anyway. :-)

                                1 Reply Last reply Reply Quote 1
                                • Z
                                  ZsoltKántor @Alan Kilborn
                                  last edited by Jul 16, 2021, 1:19 PM

                                  @Alan-Kilborn said in Insert Unicode characters not working - please help:

                                  @ZsoltKántor

                                  You may also want to try this setting enabled for your situation:

                                  5a735017-788a-44ca-9d79-5eb2bffbbb96-image.png

                                  Thanks @Alan-Kilborn , this works, the two downsides what I observed is that the characters overall are a little bit thicker, and np++ start up a bit slower.
                                  But good to know about this option :)

                                  H 1 Reply Last reply Aug 30, 2024, 8:08 AM Reply Quote 2
                                  • D
                                    dada a @guy038
                                    last edited by Aug 27, 2024, 5:39 AM

                                    @guy038 said in Insert Unicode characters not working - please help:

                                        Set or create a string, of type (REG_SZ), value called EnableHexNumpad in the registry key HKEY_CURRENT_USER\Control Panel\Input Method\
                                    
                                        Assign the value data 1 to this key
                                    

                                    I was looking for a long time for solution to this. Thank you!
                                    It’s weird that is not a default thing after so many years.
                                    Cheers

                                    1 Reply Last reply Reply Quote 3
                                    • H
                                      hfrmobile @ZsoltKántor
                                      last edited by Aug 30, 2024, 8:08 AM

                                      @ZsoltKántor said in Insert Unicode characters not working - please help:

                                      @Alan-Kilborn said in Insert Unicode characters not working - please help:

                                      @ZsoltKántor

                                      You may also want to try this setting enabled for your situation:

                                      5a735017-788a-44ca-9d79-5eb2bffbbb96-image.png

                                      Thanks @Alan-Kilborn , this works, the two downsides what I observed is that the characters overall are a little bit thicker, and np++ start up a bit slower.
                                      But good to know about this option :)

                                      Solved issue for me as well, thanks a lot! The odd thing is, that this setting was true per default on one machine, but false on others… so hat the issue on some machines, even same NP++ version, same file etc. tried everything but nothing worked, until found this post!

                                      Alan KilbornA 1 Reply Last reply Aug 30, 2024, 10:46 AM Reply Quote 0
                                      • Alan KilbornA
                                        Alan Kilborn @hfrmobile
                                        last edited by Aug 30, 2024, 10:46 AM

                                        @hfrmobile said in Insert Unicode characters not working - please help:

                                        that this setting was true per default on one machine, but false on others

                                        It would depend on what version was first installed on each of these machines.
                                        Recently, DirectWrite was defaulted to On for new installs, whereas on older versions, it was defaulted to Off.
                                        So yes, “true per default on one” and “false on others” is perfectly understandable.

                                        1 Reply Last reply Reply Quote 3
                                        • First post
                                          Last post
                                        The Community of users of the Notepad++ text editor.
                                        Powered by NodeBB | Contributors