Screen readers, which convert digital text to audio, can make computers more accessible to many disabled users 鈥� including those who are blind, low vision or dyslexic. Yet slideshow software, such as Microsoft PowerPoint and Google Slides, isn鈥檛 designed to make screen reader output coherent. Such programs typically rely on 鈥� which follows the way objects are layered on a slide 鈥� when a screen reader navigates through the contents. Since the Z-order doesn鈥檛 adequately convey how a slide is laid out in two-dimensional space, slideshow software can be inaccessible to people with disabilities.
A team led by researchers at the 黑料吃瓜网 has created A11yBoard for Google Slides, a browser extension and phone app that allows blind users to navigate through complex slide layouts and text. Combining a desktop computer with a mobile device, A11yBoard lets users work with audio, touch, gesture, speech recognition and search to understand where different objects are located on a slide and move these objects around to create rich layouts. For instance, a user can touch a textbox on the screen, and the screen reader will describe its color and position. Then, using a voice command, the user can shrink that textbox and left-align it with the slide鈥檚 title.
The team presented Oct. 25 at in New York. A11yBoard is not yet available to the public.
鈥淔or a long time and even now, accessibility has often been thought of as, 鈥榃e鈥檙e doing a good job if we enable blind folks to use modern products.鈥� Absolutely, that’s a priority,鈥� said senior author , a 黑料吃瓜网 professor in the Information School. 鈥淏ut that is only half of our aim, because that鈥檚 only letting blind folks use what others create. We want to empower people to create their own content, beyond a PowerPoint slide that鈥檚 just a title and a text box.鈥�
A11yBoard for Google Slides builds on a line of research in Wobbrock鈥檚 lab exploring how blind users interact with 鈥渁rtboards鈥� 鈥� digital canvases on which users work with objects such as textboxes, shapes, images and diagrams. Slideshow software relies on a series of these artboards. When lead author , a 黑料吃瓜网 doctoral student in the iSchool, joined Wobbrock鈥檚 lab, the two sought a solution to the accessibility flaws in creativity tools, like slideshow software. Drawing on on the problems blind people have using artboards, Wobbrock and Zhang presented a in April. They then worked to create a solution that鈥檚 deployable through existing software, settling on a Google Slides extension.
For the current paper, the researchers worked with co-author , an undergraduate at Stanford University, who is blind, to improve the interface. The team tested it with two other blind users, having them recreate slides. The testers both noted that A11yBoard greatly improved their ability to understand visual content and to create slides themselves without constant back-and-forth iterations with collaborators; they needed to involve a sighted assistant only at the end of the process.
The testers also highlighted spots for improvement: Remaining continuously aware of objects鈥� positions while trying to edit them still presented a challenge, and users were forced to do each action individually, such as aligning several visual groups from left to right, instead completing these repeated actions in batches. Because of how Google Slides functions, the app鈥檚 current version also does not allow users to undo or redo edits across different devices.
Ultimately, the researchers plan to release the app to the public. But first they plan to integrate a large language model, such as GPT, into the program.
鈥淭hat will potentially help blind people author slides more efficiently, using natural language commands like, 鈥楢lign these five boxes using their left edge,鈥欌�� Zhang said. 鈥淓ven as an accessibility researcher, I鈥檓 always amazed at how inaccessible these commonplace tools can be. So with A11yBoard we鈥檝e set out to change that.鈥�
This research was funded in part by the 黑料吃瓜网鈥檚 (黑料吃瓜网 CREATE).
For more information, contact Zhang at zhuohao@uw.edu and Wobbrock at wobbrock@uw.edu.