YouSee Mobile App

Purpose

Navigating through a building as a blind person could be detrimental. The purpose of our application is to help alleviate the implications of potential risk or create a better ecosystem for visionless people.

Project Documentation Download

Project Outline

I. Summary

Blind people should be able to navigate indoors, from one location in a building to another location in the same building or a different building. For example, a blind student or a blind visitor may need to go from one classroom to another classroom, from one office to a lab, from a lab to a classroom or a washroom, etc. To reach the destination location, a blind person may need to figure out what the source (starting) location is, walk in the hallway, turn at the right place, continue to walk, and stop at the destination location. Safety would be an important concern, which implies, for example, detecting obstacles and avoiding collisions. The time that it takes to reach the destination might also be a concern, especially if there is not much time available to reach the destination. Familiarity with the route to be taken may also be a concern, among other things.

Blind people traditionally have used a dog, a cane, possibly with the help of braille indicators on the wall, oftentimes beside doors. These aids may be used together since they could be complementary to each other. There seems to be a great need for blind people to have some aid that can think, see, hear, and speak.

Our team will build a smartphone app called YouSee. The app will be a way for volunteers to assist blind people navigate indoors using video calls. Users will be able to choose if they are a blind person or willing to volunteer. This will lead to a volunteer and blind person pair being matched to allow the volunteer to help the blind person by acting as their eyes and ears using the phones camera.

II. YouSee: Preliminary Definition

II.1 The Domain, Stakeholders, Functional and Non-Functional Objectives

For this smartphone app, the domain will be indoors, which can consist of ground floor, this floor should have classrooms, offices, washrooms, lounges, etc. The primary stakeholder would be a blind person who needs to navigate indoors. Secondary stakeholders will involve a caretaker (an assistive person) – e.g., a family member - who sets the configuration of the smartphone app and comes to aid the blind person in case the blind person is lost or injured. Secondary stakeholders might also include people at the accessibility department and the police, this especially in an emergency. Another secondary stakeholder would be the volunteer users.

Functional objectives would include foremost navigating indoors, primarily going from one location to another location in the same or different buildings that are connected to each other. This is done by interacting with the user interface to have video calls between blind people and volunteers.

Non-functional objectives would include safe navigation, fast navigation, and comfortable navigation. Since the app is for blind people, usability or user-friendliness would also be an important objective, since a blind person cannot read the screen of a smartphone app, especially concerning the capability of voice recognition.

II.2 Software System Requirements: Functional Requirements

YouSee shall assist blind people by offering multiple features, including:

II.3 Software System Requirements: Non-Functional Requirements

For blind people, non-functional requirements may be more important to achieve than functional requirements. NFRs would include:

III. The Deliverable

1. Issues

The system can be extensively enhanced with the application depending on the user's smartphone. A smartphone is implemented with different types of cameras. The cameras that the application can make use of are ultra-wide to provide feedback for collisions sooner and the depth camera to identify certain objects on how far or near the blind person is and provide real-time distance for the volunteer.

An issue that we face is volunteers not being helpful to blind people by not adhering to their requests. A way this issue was resolved was by adding a review system that blind users can use to rate the volunteers helpfulness. Another way that the issue is resolved is by tracking the number of dropped calls and early disconnections to figure out how helpful the volunteer is. If a volunteer is rated poorly/disconnected often, then they shall be added to a blacklist that prevents them from enlisting as a volunteer.

Another issue faced was defining what constitutes an Emergency, in order to avoid the ambiguity, we resolved it by defining it as a sudden loss of connection, location data and spike in noise leading to the aforementioned events.

2. Improved Understanding

YouSee mobile application is oriented for the visually impaired community. The application pairs the blind user with a volunteer from our app and have him/her help maneuver and navigate through the ground floor, which consist of classrooms, washroom, offices, etc. There's a vast repository of languages for family or friends to help configure the application. The UX should be simplistic as possible for our intended primary stakeholder. The IOS VoiceOver and Android TalkBack are built-in screen readers that will assist on navigating to the application. When YouSee is opened, there will be a green button named "Search" which would queue the user into searching for a volunteer until the request have been accepted. While in queue the smartphone will ring during that duration and timeout after 3minutes when the request hasn’t been accepted. The application will go back into searching until a suitable partner have been connected. Once the connection between the user and volunteer have been accepted, the smartphone will respond with "Connected" along with a vibration. At this point, the partner instructs and aid the user to his/her desired location within the building. The user should be pointing their smartphone outward for the volunteer to give exact real-time instructions. If a sudden incident happens to the user, there is a button labeled emergency that dials 911 call to provide quick access to an emergency dispatcher. If the application closes there will be a distinct noise and vibration in which the user knows that they are not on the application.