First of all, I think my project is useful and interesting. So I first made a list of scenarios and set a priority based on my abilities. First, I used it to show the abilities of AR glasses and to identify the modules needed for the project. Current functions include: Current Time Query, Line Query (By Bus), animal and plant identification, qrcode recognition, and installing new functions based on qrcode.


The project is divided into hardware part and software part. At present, in order to highlight the characteristics of AR glasses, only voice control is supported. 


The hardware part is mainly controlled by raspberry pi. Input and output of voice control by using USB sound card. Use the camera to capture pictures and display them with LCD screen and atomic mirror to ensure that the photos we take are what we need.In the future, from a practical point of view, a rocker or even a Bluetooth keyboard may be added. In fact, I have included a Bluetooth keyboard / mouse in my project, but I can't make good use of them. As the basic spectacle frame, I chose the head mounted magnifying glass as the foundation, which temporarily meets the current needs and is very easy to make. This also simplifies the current hardware selection. In the future, I hope to make it light enough to make it more like a pair of glasses. If you can have a better design, I hope you can share it.


The software part mainly uses cloud services, including offline wake-up, instruction recognition and a simple l process engine based on data bus.


Because I only use real-time recording for speech recognition, frequent calls to online speech recognition will waste a lot of resources. Therefore, an offline speech recognition module must be used to avoid unnecessary network speech recognition services.You can use buttons to trigger voice control. That's more practical, but it doesn't feel cool enough.


Instruction recognition is realized by Baidu AI voice service. It supports not only Chinese, but also English. It is friendly to English support. Of course, you can also use Google or Amazon's cloud services. There is no time to realize multi service support, but it is easy to implement based on software architecture.


At present, my code is based on Chinese. If you are interested enough, I will convert it to support the English version and share it with you.