The utf8 module provides operations for working with UTF-8 text, including counting characters, converting between characters and code points, reversing strings, and iterating through encoded text.

utf8.len

function utf8

Signature

function utf8.len(str)

Description

The function len provides the number of UTF-8 characters in a string.

Parameters

str
A string

Returns

The number of characters

Example

import utf8

// Basic usage
print(utf8.len("hello"))      // 5
print(utf8.len("héllo"))      // 5
print(utf8.len("こんにちは"))  // 5

// Compare with byte length
var text = "café"
print("Characters: " + utf8.len(text))  // Characters: 4

// Validate user input length
var username = "José"
if utf8.len(username) < 3
{
    print("Username too short")
}
else
{
    print("Username accepted")
}

utf8.char

function utf8

Signature

function utf8.char(n)

Description

The function char provides the UTF-8 string corresponding to a Unicode code point.

Parameters

n
A unicode code point as an integer

Returns

The UTF-8 encoded character

Example

import utf8

// Basic usage
print(utf8.char(65))       // A
print(utf8.char(233))      // é
print(utf8.char(12354))    // あ
print(utf8.char(128512))   // 😀

// Build a string from code points
var message = ""
var codes = [72, 101, 108, 108, 111]
for const c in codes
{
    message += utf8.char(c)
}
print(message)  // Hello

// Generate an emoji
print(utf8.char(0x1F600))  // 😀

utf8.ord

function utf8

Signature

function utf8.ord(c)

Description

The function ord provides the Unicode code point of the first character in a string.

Parameters

c
A string containing a single UTF-8 character.

Returns

The Unicode code point as an integer

Example

import utf8

// Basic usage
print(utf8.ord("A"))     // 65
print(utf8.ord("é"))     // 233
print(utf8.ord("あ"))    // 12354
print(utf8.ord("😀"))    // 128512

// Round-trip conversion
var original = "ñ"
var code = utf8.ord(original)
print(utf8.char(code))   // ñ

// Inspect the first character of a string
var word = "tea"
print("First code point: " + utf8.ord(word))  // First code point: 116

utf8.reverse

function utf8

Signature

function utf8.reverse(str)

Description

The function reverse provides a string with its UTF-8 characters in reverse order.

Parameters

str
A string.

Returns

The reversed string

Example

import utf8

// Basic usage
print(utf8.reverse("hello"))      // olleh
print(utf8.reverse("abc"))        // cba

// Works correctly with multibyte characters
print(utf8.reverse("café"))       // éfac
print(utf8.reverse("こんにちは"))  // はちにんこ

// Reverse an emoji string
print(utf8.reverse("😀😁😂"))      // 😂😁😀

// Practical example: check for palindromes
var word = "level"
if word == utf8.reverse(word)
{
    print(word + " is a palindrome")
}
else
{
    print(word + " is not a palindrome")
}

utf8.iter

function utf8

Signature

function utf8.iter(str)

Description

The function iter provides an iterator over the UTF-8 characters of a string.

Parameters

str
A string.

Returns

An iterator function

Example

import utf8

// Basic usage
for const c in utf8.iter("hello")
{
    print(c)
}
// h
// e
// l
// l
// o

// Iterate over multibyte characters
for const c in utf8.iter("café")
{
    print(c + " -> " + utf8.ord(c))
}
// c -> 99
// a -> 97
// f -> 102
// é -> 233

// Count characters manually
var count = 0
for const c in utf8.iter("こんにちは")
{
    count += 1
}
print("Character count:", count)  // 5

// Process each character with its index
var index = 0
for const c in utf8.iter("tea")
{
    print("[" + index + "] " + c)
    index += 1
}