If it runs locally then no data ever leaves your system, so privacy would be respected. There are tons of good local-only LLMs out there right now.
As far as performance goes, current x86 CPUs are awful, but stuff coming out from ARM and likely from Intel/AMD in the future will be much better at running this stuff.
If it runs locally then no data ever leaves your system, so privacy would be respected. There are tons of good local-only LLMs out there right now.
As far as performance goes, current x86 CPUs are awful, but stuff coming out from ARM and likely from Intel/AMD in the future will be much better at running this stuff.