Looking forward to seeing your work - it’s always good to have competitors, and gpt4all is also very crashy. If you have a lead in stability, I’d definitely use yours over theirs.

Some other areas you could probably look into if you want to differentiate are:

• Getting Started experience - recommend some high quality models and update the list as time goes on. Maybe include a good default one as part of the package.

• Convenience - include a way to do what the modern chat interfaces do where asking it to do something other than text will call a different AI model built for that purpose and return the result (image generation, etc)

• Voice conversations - Can we actually talk to the dang thing?

• Assistant module - piggybacking off of the last one, can we invoke it with a wake-word or a button press and have it “always available” (similar to HomeAssistant with a Whisper plugin, but on-device).

Anyway, I wish you well in your endeavor and will keep an eye out.

EDIT: looks like the conversational bits are on your roadmap, and you do have some basic suggestions on startup.

As for voice, the OpenWhisper module might fit your project’s theme a bit closer than elevenlabs.