Close

Chat GPT intergration

A project log for Home Robot Named Sophie

A next generation home robot with a omni directional drive unit and 6 axis collaborative robot arm

apollo-timbersApollo Timbers 12/30/2023 at 22:320 Comments

Ya, you knew it was coming there is no way around it Chat GPT is hear to stay. Instead of just the normal code I opted for a hybrid with my existing off-line version. This way you can ask it real time questions like time,  weather, jokes. A lot of this can happen even with out the internet, and it has the benefit that the voice recognition is done onboard so it is a bit speeder. Now if it does not recognize the phrase it will pass it to another python program handling chat gpt/API. 

So it can hear you talk respond to certain phrases and then pass it off to chat GPT when it gets hard. Then both talk to you via text-speech using festival as it sounds a bit more natural and easier to understand then the python version. So it is a very supercharged voice assistant. It also does not need wake up sounds, so it is a lot more natural to talk too. I will try to get a video loaded tomorrow. 

Code can be found here, do note the robot has a bad habit of hearing itself, so I will need to mute the microphone in the next revision. Enjoy!

https://github.com/thedocdoc/Sophie

Discussions