Welcome To The Audio Sight

There is a significant research gap in the field of Mobile Base Sinhala Book Readers for Visually Impaired Students. Specifically, there is a lack of comprehensive user-centered design and usability studies. Although there is a general understanding of the importance of these tools for improving educational accessibility, there is limited empirical research that explores the specific needs, preferences, and challenges of visually impaired students in Sri Lanka. It is crucial to comprehend how these users interact with mobile-based Sinhala book readers, what design features work best for them, and how to ensure optimal usability. Conducting user-centered studies would help fill this gap and inform the design and development of more accessible and tailored mobile book readers for this target audience.

1. Sinhala Optical Character Recognition (OCR)

* One possible research gap in the OCR component is the need for a more accurate and efficient OCR engine specifically designed for the Sinhala language.

* Existing OCR programs are designed for English and industrial use, so this application is mainly for the Sinhala language.

2. Sinhala Text-to-Speech (TTS) Synthesizer

* Without the speech of an outside person, Sinhala text converts into clear speech and makes it easy for visually impaired students to here.

* Given visually impaired students the opportunity to listen to the audiobook at the end of each book.

* Blind user can change book reading speed and he can read book Male or Female voice.

3. Sinhala Object Detection & Sinhala Voice Navigation System

* The primary issue at hand is the absence of a Sinhala-specific object detection.

* Sinhala voice navigation system tailored to the needs of blind students.

* Existing solutions predominantly cater to English-speaking users, rendering them ineffective for Sinhala-speaking individuals who require navigation assistance in their native language.

4. Sinhala Image Identification

* This study aims to address the accessibility gap by developing an image detection system capable of providing comprehensive and culturally relevant descriptions in Sinhala within a student books.

* The reading app, catering specifically to visually impaired students.

The main research problem here is the difficulty of accessing printed materials with braille technology for visually impaired individuals.

There is no proper mobile application for sinhala book reading.

Obtaining educational materials and resources that meet the language needs of visually impaired Sinhala-speaking individuals is a significant challenge. The lack of a comprehensive educational access program designed specifically for this group of people poses major problems. Their educational opportunities are limited due to this deficiency, which in turn hinders their socioeconomic prospects.

Access to Sinhala-language educational resources is limited for speakers of Sinhala, as most assistive technology currently in use is designed for English-language materials. Additionally, translating printed Sinhala text into natural-sounding speech is challenging due to the intricate script and subtle syntax of the Sinhala language, which poses difficulties for text-to-speech (TTS) and optical character recognition (OCR) systems. Moreover, people with visual impairments face difficulties accessing visual content that is frequently included in educational resources, as a crucial component of picture interpretation is still absent.

Our research aims to create an inclusive educational access system that enables efficient access to educational content for visually impaired Sinhala speakers.

Main Objective

Our research goals are aimed at providing a comprehensive solution to the issue previously mentioned. Firstly, we aim to improve OCR and TTS technologies, particularly for Sinhala. This will enable these technologies to accurately extract text in Sinhala from different sources and provide natural-sounding voice synthesis that is appropriate for the context. Secondly, we intend to develop an image interpretation component that can identify and describe images in content written in the Sinhala language. We recognize the importance of image interpretation in instructional materials.

It is important to make visual content accessible to visually challenged individuals, as it allows them to have access to a more engaging educational environment. To ensure usability, we are dedicated to creating a navigation system that is user-friendly, with haptic and auditory cues to aid in effective content discovery. This guarantees that individuals who are blind or visually impaired can effortlessly navigate through the textual and visual components of instructional resources.

We aim to continuously improve our solution based on customer feedback and experiences. To achieve this, we plan to conduct comprehensive testing and collect user feedback. Our main objective is to remove the existing barriers to educational material access and provide visually impaired Sinhala speakers with an inclusive and creative educational solution. This will enhance their educational opportunities and socio-economic prospects.

Sub Objectives

Sinhala Optical Character Recognition (OCR)

Sinhala Text-to-Speech (TTS) Synthesizer

Sinhala Voice Navigation System

Sinhala Object Detection

Sinhala Image Identification

The methodology for studying mobile-based Sinhala book readers for visually impaired students involves a mixed-methods approach. Firstly, we will conduct qualitative research by interviewing visually impaired students and holding focus groups to gain insights into their needs, preferences, and challenges when using mobile-based book readers. Secondly, we will conduct a quantitative phase by surveying a larger sample of visually impaired students to gather data on their usage patterns and assess the impact of these tools on their academic performance.

Additionally, we will conduct usability testing to evaluate the user-friendliness of existing readers. We will also review available mobile-based Sinhala book readers to assess their current features and accessibility options.

We will analyze the combined data to identify areas of improvement, customization, and enhanced language support, which can inform the development of more effective and user-centered tools for visually impaired students.

Android Studio

Java 8

Python 3.8

Jupyter Notebook

Anaconda Navigator

Postman API Platform

VS Code

Figma UI/UX

GitLab

ngrok server