I want to build avatars - digital characters - for Mycroft. My focus is on the character’s appearance and behavior (or Lower Mind), while Mycroft provides its embodied advanced AI (or Higher Mind)(1).
I know there are a few other projects here of people doing similar things (2). People are also making avatars for other voice assistants, and other types of AI (like chat bots).
Robustly compatible avatars are appealing, but it’s impractical to build and maintain interfaces for the various combinations of Avatar and Higher Mind.
Avatar Link could be a way to solve that. It’s a separate piece of open-source software to sit between Mycroft and the Avatar, which will provide a consistent interface no matter what changes occur with the Higher Mind - or even which Higher Mind is active. As long as the interface layer is maintained, all avatars that implement it won’t break with changes to Higher Minds.
Here’s the repo, which currently just contains documentation.
Is there a already a project doing what I propose with Avatar Link?
How can I receive data from the App Channel?
My search has turned up negative on the first question. It’s got to be open source and decoupled from any particular Higher Mind and any particular implementation of Avatar (so it should work with an Arduino-based robot or whatever).
For the second question, I could really use some guidance. I’ve done a bit of web development, but for this project I’m just now learning about web sockets and Python’s web libraries. Similarly, I’ve only set up and run an Ubuntu Mycroft client and don’t know what inner workings of Mycroft I need to understand or interact with to make progress on Avatar Link. I think the Message Bus looks useful, but am not sure what to do about it.
I welcome any feedback or other assistance you provide on these two questions or the project in general. Either here or in the [Mattermost chat channel](https ://chat.mycroft.ai/community/channels/avatar-link)
(1) Higher / Lower Minds. Apologies for introducing new terms. It’s the best I could think of for the 2 levels of AI behind this type of embodied avatar.
(2) Here are some relevant discussions about Mycroft avatars
[Tree Industries Avatars](https ://community.mycroft.ai/t/mycroft-gets-a-3d-avatar/4623)
[Q.bo Avatar](https ://mycroft.ai/blog/mycroft-on-the-q-bo-one-robot/)
[Some thoughts about what Avatars might need](https ://community.mycroft.ai/t/what-do-i-need-for-a-3d-avatar/3988/5)
(sorry for broken links, “New Users can only Post 2 links”)