• 36 Posts
  • 234 Comments
Joined 1 year ago
cake
Cake day: March 19th, 2024

help-circle

  • Efficiency still matters very much when self hosting. You need to consider power usage (do you have enough amps in your service to power a single GPU? probably. what about 10? probably not) and heat (it’s going to make you need to run more A/C in the summer, do you have enough in your service to power an A/C and your massive amount of GPUs? not likely).

    Homes are not designed for huge amounts of hardware. I think a lot of self hosters (including my past self) can forget that in their excitement of their hobby. Personally, I’m just fine not running huge models at home. I can get by with models that can run on a single GPU, and even if I had more GPUs in my server, I don’t think the results (which would still contain many hallucinations) would be worth the power cost, strain on my A/C, and possible electrical overload.






  • I can’t speak to beef, but there is more to Android security than what Google provides. That’s what Graphene is for, to make Android even more secure through hardening various attack surfaces and introducing other completely new security features. If that weren’t the case, Graphene wouldn’t be necessary on Pixels because Google does monthly security patching for them.

    It’s also at the firmware level, which Google does not provide except for on their own hardware, and on top of that Google phones are some of the only ones capable of providing some security feature at the hardware level. This seems to be the main thing the Graphene team is trying to point out.