Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)S

SuspiciousCarrot78

@ SuspiciousCarrot78 @aussie.zone

Posts
5
Comments
62
Joined
3 wk. ago

  • Best speech to text for arthritic fingers?

    Jump

  • Thank you!

  • Best speech to text for arthritic fingers?

    Jump

  • Thanks - that's worth a gander

  • Best speech to text for arthritic fingers?

    Jump

  • Thank you!

  • Best speech to text for arthritic fingers?

    Jump

  • Thank you!

  • Best speech to text for arthritic fingers?

    Jump

  • Awesome!

  • Best speech to text for arthritic fingers?

    Jump

  • Aussie too - same issue with having to fake accent sometimes :)

  • Selfhosted @lemmy.world
    SuspiciousCarrot78 @aussie.zone

    Best speech to text for arthritic fingers?

  • PewDiePie releases Codex/ClaudeCode/Cursor killer, Odysseous (FOSS)

    Jump

  • Quite a lot, actually.

    Coding, document analysis, STT, home assistant, shopping assistant, gaming, journalling, image and video generation, OCR, language translation, recipe/meal / workout planning, study/flashcard generation, email drafting, adversarial review, search engine on steroids, hardware troubleshooter, companion for elder care, music curator and DJ ....

    All of that without creepy ass cloud shit from Big AI.

    I can go on, but "a lot" probably covers it.

    EDIT: asked, answered and...down voted. Classic Lemmy anti-ai knee jerk. FWIW I work with AI in healthcare settings as well as code review for my own personal projects.

    What I said are actual use cases, not a wishlist generated by Jippity. I can elaborate on any and all of them with actual real life experience.

  • Immich: FUTO — 2 years later

    Jump

  • I'm confused. Are futo the bad guys now? All I know about them is that Louis Rossman used to be involved with them. I like Rossman's stuff / the futo speech to text is great (gladly donated to it).

    Dunno if Rossman's split with them was just so he could focus on FULU or something more.

  • I built a self-hosted affiliate tracking platform — here's why I think self-hosting affiliate software actually matters

    Jump

  • They don't need to. Github has a much stronger SEO. It's literally a global top 100 website.

    Github as billboard / pointer / "trust signal" is just smart discoverability....but not a good "home" these days.

  • Question: What are some alternatives to a Raspberry Pi good for a small home server?

    Jump

  • Go for it! The m73 is cheap enough (and powerful enough) to run all that and ddr3 is still not insane (say, 2x8gb 1600mhz sodimm if want / need). $100 or so, all up, if you shop around / your local market pending.

    Raspberry pi is more elegant / more constrained / more "fuck you, figure it out" but unless you need the challenge, Lenovo is simpler and all around easier first step :). You can't stick a gpu in it (I think the m920 is the oldest one that has pcie - dunno what they go for. The usual combo is something like a 920 and a Quadro P1000 4GB GPU. Maybe ~$300 all up if we're guessing. At which point, there are better, non shoe box options)

  • Question: What are some alternatives to a Raspberry Pi good for a small home server?

    Jump

  • I have a RPI 4b and 3 lenovos (m93p, m710q, p330).

    You can't beat the RPI for power draw (~2w idle and ~7w under max load) but I suspect if you wanted to look at $ to utility measure you'd probably prefer the Lenovo M93P. $50 USD. Mine has i7-4785t, 16GB ddr3 (2x8iirc?) with ethernet, USB etc. Bought 2023/4. I expect base model is still that price now (mines upgraded). The only caveat is that it doesn't have HDMI, it has display port out, but that's just a $5 dongle or SSH issue. M73 would be a touch cheaper.

    Iirc the TDP is 35w max and can be lowered / undervolted a touch (don't update the BIOS - it blocks throtlestop).

    I turned mine into a retro PC slash game server for the kids (luanti etc). But the siren call of doing truly impossible things with the RPI is too beguiling :)

    Eg: running diet pi (headless) with all of my services (media stack, privacy, docs, search, images etc) takes about 300 megabytes (or 650mb if I have to boot into xfce).

    300mb, 2-3w.

    That shouldn't be possible. I love it.

    My next goal is to create an expert system / pseudo llm that sources answers based on user provided markdown or PDF, ZIM files and 4get search or Tavily.

    The advantage here is that 1) speed will be stupid fast as no neural network crap (outside of optional extra Markov chain garnish) 2) not stochastic (but allow for llm as optional "plug in module" - pi might actually run a 135M at non glacial speeds) 3) still serves openAI compat endpoint.

  • Question: What are some alternatives to a Raspberry Pi good for a small home server?

    Jump

  • Is that the right site or am I not seeing it? Your link points to this -

    https://idlewatt.foundagent.net/ Lookup Categories Compare Vendors AI Data Watch Methodology Will this vendor sign a HIPAA BAA? A cited, date-stamped answer for 105 major SaaS tools — can you sign a Business Associate Agreement and store PHI? Built for digital-health teams during vendor procurement.

  • Another reason to self host your own AI

    Jump

  • Respectfully, that's not really how local LLMs work.

    A GGUF model sitting on my hard drive has no ability to "send content back home" any more than a PDF or a JPEG does. If you're running something like llama.cpp or Ollama entirely locally, the model weights are just data files.

    The real privacy concerns are cloud APIs, telemetry in front-ends, browser extensions, analytics, update services, or accidentally exposing a service to the public internet.

    "Self-hosted AI" isn't one thing. There's a huge difference between:

    • Running ChatGPT through an API
    • Running a commercial AI appliance
    • Running a local Qwen/Mistral/Llama model on your own hardware

    Firewalling internet-facing services is good advice. Assuming every local model is secretly uploading prompts is not.

    EDIT: for the record, I didn't down vote you - that was someone else.

  • Another reason to self host your own AI

    Jump

  • Another reason to self host your own AI

    Jump

  • I mean...that entirely depends on your use case - and I hate saying that. For me and what I do, Qwen SLM (esp Qwen3-4B 2507 instruct and Qwen3.5-2B) are exceptional. But I'm not trying to do Claude at home.

    Best bet? Spend $10 on OpenRouter and try different models. In a head to head with ChatGPT 5.4 mini (excellent for coding BTW), I've found Qwen 3.5 27B more than able to hold its own for coding tasks...IF you narrowly gate it/confine it. The last batch of Qwen's really are something. Dunno about the 3.7 series.

    Having said ALL that, I'm really tempted to go back in time and code myself a deterministic expert system, with user updatable knowledge cascade, tool calling and a minimal amount of Markov chain word garnish for flavour. I think we use to just call that "a program" lol.

    Really tempted actually, because if 50% of llm use case is basically Super Google but not shit...well, I can make that myself. I just need to point my autism at it.

    PS: this might help

    https://www.youtube.com/watch?v=0AqpaFm11oI

  • Another reason to self host your own AI

    Jump

  • Numbers about 3-4x. The P100 is near 800 GB/s. The 1080 is what... 192GB/s? Hell, even if it were double that, HBM2 simply has larger bandwidth. The 1080 was a gaming card; the P100 is a server / number cruncher.

  • Self-hosted Image/Video Gallery Options?

    Jump

  • Just for sake of completion

    https://piwigo.org/

    Pros

    Mature project (around since the early 2000s)

    Lightweight compared to Immich

    Designed as a photo library first, not an AI platform

    Albums, tags, metadata, permissions

    Huge plugin ecosystem

    Runs happily on modest hardware

    Can manage very large collections

    Doesn't demand phone-app-centric workflows (though of course it has a phone to computer app / sync)

    Cons

    Feels more like a traditional photo archive than Google Photos

    Mobile experience is functional rather than slick

    No fancy AI search or face recognition by default (though can add easy enough)

    UI is a bit "classic web"

  • Another reason to self host your own AI

    Jump

  • Huh - cheaper than the P40s (though less VRAM) but larger bandwidth due to HBM2. Good looking out

  • Another reason to self host your own AI

    Jump

  • Good tips - thanks!

    PS: sad to report the 24GB Tesla p40s are now around $250 USD on eBay, so not quite as cheap as I remembered. P4s are still cheap tho, though frankly if you're going that end of town, a 1080 is about on par, less fussy and probably cheaper - it just won't fit in a uSFF.

  • Selfhosted @lemmy.world
    SuspiciousCarrot78 @aussie.zone

    Another reason to self host your own AI

  • LocalLLaMA @sh.itjust.works
    SuspiciousCarrot78 @aussie.zone

    Claude? No. Cucumbers? Yes!

  • LocalLLaMA @sh.itjust.works
    SuspiciousCarrot78 @aussie.zone

    "The cost of running LLMs is just too damn high"

  • LocalLLaMA @sh.itjust.works
    SuspiciousCarrot78 @aussie.zone

    Token Speed visualiser

    mikeveerman.github.io /tokenspeed/