Skip to content

R2: Immersive Text Environments

Project Leaders: Pope, Dragut, Jakobs, Constituent Board

Child touching a cereal box attached to the wall. The text "Immersive Text" is overlayed.

Slide showing the problems that this project is intending to address.

Problems Addressed: AAC users are often excluded from traditional literacy learning opportunities, especially emerging language learners. Currently, most people who need or use AAC only have access to picture symbol based AAC systems. Literacy can open so many more doors!

Goals of the project:

  1. Explore methods for learning reading skills through text embedded within activities in the environment.
  2. Develop and AAC app feature to support learning the process of writing.
Child is pointing at the word "window" taped to a window. Slide also includes the goals of the project.

Slide describing the 3 parts of this project and has pictures of door labeled as a door, a child wearing smart glasses, and a sample of how an encoding feature may work.

How will we accomplish these goals?

  1. Explore using low-tech print labeling in the environment during interactive activities for communication and word reading.
  2. Develop wearable technology to overlay print within the environment to support word reading (e.g., program smart glasses technology to superimpose written words over the wearer’s field of view)
  3. Develop a technology feature that can be embedded within existing AAC software to model the process of spelling.

Updates

Additional Information