Work in progress · AI for Good · Rokid Glasses
A real pen. A sheet of paper. A handwriting guide that appears where you’re practicing.
I’m building ScriptGuide to explore how augmented reality can support the physical act of learning to write. Animated strokes viewed through Rokid Glasses show the movement of each letter, while the practice happens on real paper.
It’s an early experiment in AI and AR for good. I’m working with Codex to move between interaction design, Kotlin development, and testing on the glasses. AI supports the development process; AR brings the guidance into the learner’s view.
01 / The experience
Three ways
to say hello.
The prototype demonstrates English cursive, Japanese こんにちは, and Hebrew שלום. A blinking start point gives you time to prepare, then an animated pen tip traces each stroke.
A tap locks the detected page in place. Another starts the lesson. Swipe to adjust the scale, or tap to pause and resume.
Each writing system brings a different rhythm: connected cursive, separate Japanese strokes, and Hebrew written from right to left. Timing, direction, and pen lifts all become part of the interaction.
Through the glasses, the script and moving guide dot align with the pen tip from the wearer’s viewpoint. This video is captured from the camera’s viewpoint, not through the wearer’s eyes, so the overlay appears offset from the pen and paper in the recording.
02 / The challenge
Keeping the guide
on the page.
Finding the paper is only a starting point. The camera and your eyes see from different positions, and head movement changes where the guide appears. I’m refining paper detection, orientation tracking, and optical alignment through repeated hardware tests.
The small monochrome-green display also shapes the design: clear strokes, minimal text, and carefully timed cues. Every test reveals another detail to improve.
03 / What comes next
A prototype with a purpose.
The next steps are more reliable alignment, comfortable interaction, and testing whether the guidance helps people practice. ScriptGuide currently demonstrates strokes; it does not evaluate the learner’s handwriting.
For me, AI and AR for good starts here: exploring a useful role for technology in an everyday activity, with the pen, the paper, and the person at the center.