Eye Can Code

A platform for students with visual impairments to learn how to code. Test it out here: http://eyecancode.online

Awards

EyeCanCode has won many honours internationally, including:

1. 1st Overall, Hack COVID19
2. 2nd Most Innovative, GeomHacks
3. Top 20, GeomHacks
4. Top Two, Wolfram Sponsor Award, HAccess

How to Run and Contribute

To edit the source code, follow the following steps:

1. Git Clone the Project: `git clone https://github.com/GenericP3rson/EyeCanCode.git`
2. **To run the project, use `flask run`.**
3. Make the necessary edits.
4. Commit changes and create a pull request.
5. We will get back to you shortly!

For any further questions, please email us at eyecancode@gmail.com.

Inspiration

With the recent COVID-19 pandemic, students worldwide have transitioned to online schooling. For some students, however, the transition has been harder than for others. Near where Veer lives is the oldest school for blind students: Perkins School for the Blind. Veer had always wanted to help them, and, during these times, he decided to help them when they needed it more than ever. Together, Veer and Shreya worked on an online platform dedicated for the blind and targeted for Veer and Shreya's favourite lesson: programming.
According to the National Federation of the Blind, COVID-19 has had a disproportionate impact on the blind, with many facing additional challenges during the pandemic. From an education standpoint, blind students and blind parents face uncertainty about the types of electronic materials they will be expected to use for the remainder of the academic year, making it hard for them to keep up with classes. Lastly, it is difficult for the visually impaired to learn how to code on their computer, a challenge which has been exacerbated by the pandemic.

What it does

We built a text editor which can listen to speech, translate it to Python code, and then run the code in a console. The platform is complete with an academy to teach blind students how to code, with lessons in variable types, for loops, if loops, functions, etc.
We used natural language processing to:

1. Allow the visually impaired to code in python by simply speaking
2. Provide a handful of python tutorials with voice and speech recognition features to effectively teach coding to people with visual impairments
3. Create an online platform for the visually impaired to learn

How we built it

We used:

• Flask
• HTML, CSS, and JS
• Python
• Natural Language Processing
• Google Cloud Speech API

Challenges we ran into

We at first parsed the code in Python. However, when connecting it to the JS, it was incredibly laggy and didn't update in real time. Therefore, we had to translate all the Python code into JS which was tedious. In addition, SpeechRecognition only worked on one teammate's computer and not the other, which caused a lot of debugging to occur.

Accomplishments that we're proud of

We're really proud that our product is actually working for others to use. Not only did we complete a text editor, but we also got the academy working, which was great.

What we learned

We learnt how to use speech recognition and execute the code in string form. One of our teammates learned how to deploy code to Heroku and link it to a domain. We also learned more about linking JS with Python, especially for real-time work.

What's next for Eye Can Code

We want to make more aspects of our website audio to further help make it accessible for the blind. Afterwards, we hope to have the platform available for all to use.