I’ve tried coding and every one I’ve tried fails unless really, really basic small functions like what you learn as a newbie compared to say 4o mini that can spit out more sensible stuff that works.

I’ve tried explanations and they just regurgitate sentences that can be irrelevant, wrong, or get stuck in a loop.

So. what can I actually use a small LLM for? Which ones? I ask because I have an old laptop and the GPU can’t really handle anything above 4B in a timely manner. 8B is about 1 t/s!

  • kattfisk@lemmy.dbzer0.comEnglish
    6·
    1 day ago

    You’re both getting side-tracked by this discussion of recording. The recording is likely legal in most places.

    It’s the processing of that unstructured data to extract and store personal information that is problematic. At that point you go from simply recording a conversation of which you are a part, to processing and storing people’s personal data without their knowledge, consent, or expectation.

    • aksdb@lemmy.worldEnglish
      1·
      1 day ago

      True.

      Although in Germany for example it can also be an issue when recording. If you have a security camera pointed at a public space (that can include the sidewalk infront of your house), passersby can sue you to take it down and potentially get you fined. Even pretending to constantly record such an area can yield that result.

      • tfm@europe.pubEnglish
        1·
        1 day ago

        I’m not a lawyer but I suppose it would depend on the ToS and if the user agrees to the recording and processing. But if it allows the extraction of the real identity of the user it’s probably a GDPR issue.

    • David J. Atkinson@c.im
      01·
      1 day ago

      @kattfisk That seems to imply that you cannot personally listen to or watch recordings that you have made in public. In doing so, you are abstracting personal details that you might have missed before, refreshing your memory, and so on. What is the material difference between you doing this without machine help versus with automation that makes it ethically problematic? What if a friend helped you, not a machine?

      • shnizmuffin@lemmy.inbutts.lolEnglish
        2·
        4 hours ago

        What is the material difference between you doing this without machine help versus with automation that makes it ethically problematic?

        Object permanence, perfect recall, data security and consent. It’s the difference between seeing someone naked vs taking a picture of someone naked.

        Regardless - users, streamers, and developers are all prohibited from scraping and storing the Twitch chat.