Low Vision Assistive Tool

2024

Creating A “Visually Impaired” Character Recognition Model for Text Accessibility Assessment

ARVO 2024

Qingying Gao Roberto Manduchi Pradeep Y Ramulu Gordon E Legge Yingzi Xiong

KEYWORDS: Low Vision, Computer Vision

Low vision individuals use their residual vision in their daily life to read text such as price tags, street signs, medicine labels. However, there is no objective tool for evaluating text accessibility for low vision. … We aim to design a new framework combining OCR and human contrast sensitivity functions (CSF) to simulate the text recognition capability of low vision.


Grow AI like a Child

2024

Vision Language Models See What You Want but not What You See

2024

Qingying Gao Yijiang Li Haiyun Lyu Haoran Sun Dezhi Luo Hokin Deng

KEYWORDS: VLM, Cognitive development

Knowing others’ intentions and taking others’ perspectives are two core components of human intelligence that are typically considered to be instantiations of theory-of-mind. Infiltrating machines with these abilities is an important step towards building human-level artificial intelligence. … We find VLMs achieving high performance on intentionality understanding but lower performance on perspective-taking. This challenges the common belief in cognitive science literature that perspective-taking at the corresponding modality is necessary for intentionality understanding.


Augmented Reality

2023

Mixed Reality Guided Root Canal Therapy

AE-CAI Workshop 2023

Fangjie Li* Qingying Gao* Nengyu Wang Nicholas Greene Tianyu Song Omid Dianat Ehsan Azimi

* Co-first author

KEYWORDS: Mixed Reality, Root Canal Therapy, Navigation, Augmented Reality

Root Canal Therapy (RCT) is a widely performed procedure in dentistry, with over 25 million individuals undergoing it annually. This procedure is carried out to address inflammation or infection within the root canal system of affected teeth. However, accurately aligning CT scan information with the patient’s tooth has posed challenges, leading to errors in tool positioning and potential negative outcomes. To overcome these challenges, we have developed a mixed reality application using an Optical See-Through Head-Mounted Display (OST-HMD)…