Papers and Articles
Low Vision Assistive Tool
2024
Creating A “Visually Impaired” Character Recognition Model for Text Accessibility Assessment
ARVO 2024
Qingying Gao | Roberto Manduchi | Pradeep Y Ramulu | Gordon E Legge | Yingzi Xiong |
KEYWORDS: Low Vision, Computer Vision
Low vision individuals use their residual vision in their daily life to read text such as price tags, street signs, medicine labels. However, there is no objective tool for evaluating text accessibility for low vision. … We aim to design a new framework combining OCR and human contrast sensitivity functions (CSF) to simulate the text recognition capability of low vision.
Grow AI like a Child
2024
Vision Language Models See What You Want but not What You See
2024
Qingying Gao | Yijiang Li | Haiyun Lyu | Haoran Sun | Dezhi Luo | Hokin Deng |
KEYWORDS: VLM, Cognitive development
Knowing others’ intentions and taking others’ perspectives are two core components of human intelligence that are typically considered to be instantiations of theory-of-mind. Infiltrating machines with these abilities is an important step towards building human-level artificial intelligence. … We find VLMs achieving high performance on intentionality understanding but lower performance on perspective-taking. This challenges the common belief in cognitive science literature that perspective-taking at the corresponding modality is necessary for intentionality understanding.
Augmented Reality
2023
Mixed Reality Guided Root Canal Therapy
AE-CAI Workshop 2023
Fangjie Li* | Qingying Gao* | Nengyu Wang | Nicholas Greene | Tianyu Song | Omid Dianat | Ehsan Azimi |
* Co-first author
KEYWORDS: Mixed Reality, Root Canal Therapy, Navigation, Augmented Reality
Root Canal Therapy (RCT) is a widely performed procedure in dentistry, with over 25 million individuals undergoing it annually. This procedure is carried out to address inflammation or infection within the root canal system of affected teeth. However, accurately aligning CT scan information with the patient’s tooth has posed challenges, leading to errors in tool positioning and potential negative outcomes. To overcome these challenges, we have developed a mixed reality application using an Optical See-Through Head-Mounted Display (OST-HMD)…