Library: UTF-8 (OMUTF8) Import: omutf8.xmd

Return type: Integer Returns: An integer value corresponding to the specified UTF-8 character.

Declaration

export integer function 
        code-point                of value string              utf8-string
                   overlong-handling value error-handling-type overlong-handling optional 
     elsewhere
    

The function utf8.code-point converts a string containing a single UTF-8 character to the character number it encodes.

If the string does not consist of a single UTF-8 encoded character, the character number of the Unicode Replacement Character (U-FFFD) is returned instead. By default, overlong values for UTF8 encodings will return U-FFFD. If the argument overlong-handling is specified as not-allowed-with-throw, overlong sequences will trigger a throw to utf8.overlong-sequence. If overlong-handling is allowed, utf8.code-point will convert an overlong value to a value which might not be valid Unicode.

The following program converts a UTF-8 encoded file to a long character encoding (2 bytes for every character):

  import "omutf8.xmd" prefixed by utf8.
  
  process
     submit #main-input
  
  find utf8.char => char
     output "2f0b" % utf8.code-point of char
          

Related Topics Character set encoding

Other Library Functions utf8.byte-order-mark utf8.char utf8.code-point utf8.encoding utf8.invalid-code-point utf8.multi-byte-char utf8.omutf8-version utf8.overlong-sequence utf8.single-byte-char

[ INDEX ] [ CONCEPTS ] [ TASKS ] [ SYNTAX ] [ LIBRARIES ] [ LEGACY LIBRARIES ] [ ERRORS ]