Running llama-2-7b-chat at 8 bit quantization, and completions are essentially at GPT-3.5 levels on a single 4090 using 15gb VRAM. I don't think most people realize just how small and efficient these models are going to become.

[cut out many, many paragraphs of LLM-generated output which prove… something?]

my chatbot is so small and efficient it only fully utilizes one $2000 graphics card per user! that’s only 450W for as long as it takes the thing to generate whatever bullshit it’s outputting, drawn by a graphics card that’s priced so high not even gamers are buying them!

you’d think my industry would have learned anything at all from being tricked into running loud, hot, incredibly power-hungry crypto mining rigs under their desks for no profit at all, but nah

not a single thought spared for how this can’t possibly be any more cost-effective for OpenAI either; just the assumption that their APIs will somehow always be cheaper than the hardware and energy required to run the model

I defederated us from two lemmy instances:

• exploding-heads: transphobia
• basedcount: finally I get to ban most of r/PoliticalCompassMemes in one go

we suffered some extremely unexpected downtime while I deployed a trivial change (a reverse proxy from http://awful.systems/archives to http://these.awful.systems/archives) to prod

the downtime was unrelated to the deployment change; instead, it seems like lemmy-ui started crashing because it couldn't render the app icons it uses when saved as a home screen app on mobile. it uses a fairly heavy dependency to do this, and has no error handling in case the source icon data is corrupt, which causes it to crash on every request (resulting in a 503 Service Unavailable error for everyone who tried to access awful.systems during this outage)

since I don't know how that corruption occurred or why it was persistent (the app icon data should be fully static as part of the Nix store as far as I know), so until I can dig in I've disabled generating app icons for our instance. since it seems like we're the first ones to hit this bug, I'll do my best to keep the patch upstreamable so other lemmy instances can benefit from the fix

the r/SneerClub archives are finally online! this is an early v1 which contains 1,940 posts grabbed from the Reddit UI using Bulk Downloader for Reddit. this encompasses both the 1000 most recent posts on r/SneerClub as well as a set of popular historical posts

as a v1, you'll notice a lot of jank. known issues are:

• this won't work at all on mobile because my css is garbage. it might not even work on anyone else's screen; good luck!
• as mentioned above, only 1,940 posts are in this release. there's a full historical archive of r/SneerClub sourced from pushshift at the archive data git repo (or clone git://these.awful.systems/sneer-archive-data.git); the remaining work here is to merge the BDFR and pushshift data into the same JSON format so the archives can pull in everything
• markdown is only rendered for posts and first-level comments; everything else just gets the raw markdown. I couldn't figure out how to make miller recursively parse JSON, so I might have to write some javascript for this
• likewise, comments display a unix epoch instead of a rendered time
• searching happens locally in your browser, but only post titles and authors are indexed to keep download sizes small
• speaking of, there's a much larger r/SneerClub archive that includes the media files BDFR grabbed while archiving. it's a bit unmanageable to actually use directly, but is available for archival purposes (and could be included as part of the hosted archive if there's demand for it)

if you'd like the source code for the r/SneerClub archive static site, it lives here (or clone git://these.awful.systems/sneer-archive-site.git)

RationalWiki is a highly biased cancel community which has attacked people like Scott Aaronson and Scott Alexander before.

Background on the authors according to a far-left website.

Let's at least be honest.

That is profiling work. (Not just "Ad hominem".)

The clash with the name "rational-wiki" is too strong not to be noted.

as the infrastructure admin of a highly biased far-left cancel community that attacks people like Scott Aaronson and Scott Alexander: mmm delicious

for bonus sneers, see the entire rest of the thread for the orange site’s ideas on why they don’t need therapy:

I was about to start psychotherapy last month, I ask my family's friend therapist If he could recommend me where to go. So he interviewed me for about 30 mins and ask me about all my problems.

A week later he send me the number of the therapist. I didnt write her yet, I think I dont need it as badly as before.

Those 30 mins were key. I am highly introspective and logical, I only needed to orderly speak my problems.

to quote Key & Peele: motherfucker, that’s called a job

hey let’s see what the people who killed and buried hacker culture think should go in the jargon file!

If the spirit of the original Jargon file was to be a living document, alas, it failed to keep with the times.

Hackers at large have moved away from Lisp despite Paul Graham and other evangelists […]

Hackers also have moved away from academia at large, and 9-5 jobs at tech behemoths are more natural habitats for them, which also shaped the lingo. I mean, there’s a whole layer of slang usually pertinent to outsourcing agencies and to cubicle farms.

I can’t wait for the corporate-approved jargon file, with any hint of anti-capitalism replaced with fun words and quotes from billionaires to share as the soul leaves my body

So in order for the document to evolve, we need a system to determine consensus. Everyone who cares runs a program on their computer that joins the network and registers their intent. With each proposed change, a query goes out to the network, and it's up to everyone on the network to say yea or nay to the proposal. With enough "yea"s, the document is updated.

...this is starting to sound like a blockchain, isn't it.

for the absolute sake of fuck. coming soon: HackerDAO! collect 10xer tokens and finally prove to the junior devs why corporate gives you so many points to crunch on! vote on fun new jargon, but only if it’s crypto-related! surely you’re hacker enough to be on the pump side of this pump and dump!

reposting here for better visibility (let me know if there’s a better way to do this now that we’re federated): the owners of hachyderm.io just started a generative AI for gaming project, and it looks like donations to them will likely end up going to that

It's because there is a vast concerted effort by the political left to destroy Musk now that he is no longer regarded as being strictly on their side. It's at Trumpian scale these days, in terms of the venom being directed at him.

Reddit is overflowing with non-stop Musk hatred. They spout lie after lie about him in every single thread where he's a topic. The most popular lie being that his business efforts - ie his success - were funded by an emerald mine that his father owned (neither thing is true).

I say this as an emotionally independent, objective observer of the craziness, I have no stake in it, and don't feel one way or another about it. The seeming mental illness the topic of Musk seems to draw out of people is astounding however, the herd promptly acts like deranged lunatics when he comes up as a topic.

Until Trump I had never seen anything like it before, in person or online. There must be a name for such a massive scale of crowd insanity, to describe the frothing-at-the-mouth irrationality.

my deranged lunatic hivemind venomous mentally ill frothing-at-the-mouth leftist brain can’t handle how rational this fucking asshole’s take on musk and trump is

there’s also this at the top of the thread:

I've been mostly ambivalent about the Musk-era at Twitter—mostly because I just don't care enough to have an opinion.

This, though. This one makes me angry and disappointed.

Twitter has had such a solid brand for so long. It's accomplished things most marketers only dream of: getting a verb like "Tweet" into the standard lexicon is like the pinnacle of branding.

turning one of the most popular sites on the internet into a cesspit of transphobia and nazis: ambivalent

musk fails to appreciate the Twitter brand: angry and disappointed

remember, hacker news is a bastion of high-quality discussion. fucking shitheads

Bevy is a fun, cozy game engine to play with if you’re looking for something very flexible that implements some surprisingly advanced features. things I like:

• it’s all rust, which is an advantage for me and the chemical burns I have from handling the dialect of C++ a lot of older game engines used to be written in
• it implements a flexible entity component system, which I found pretty great for specifying game and rendering logic for things like roguelikes and simulations, where multiple game systems might interact in dynamic ways
• the API is very cozy and feels like querying an extremely fast database at times
• it’s a lot lower level than something like Unity or Godot, but you get some pretty advanced rendering features included
• the main developer seems to have a lot of industry experience and a solid roadmap

Nix is one of the few pieces of software I trust. I use it on just about every computer I work on — awful.systems is managed and deployed by just nixos-rebuild and a deployment flake, as are almost all the computers in my house (including a few embedded into the house itself). in general it makes both software development and configuring Linux a lot more fun compared with the traditional way of doing things

I often call Nix fucking incomprehensible, but it doesn’t need to be. Zero to Nix is one of the documentation projects that’s intended to be a more gentle goal-oriented introduction to Nix concepts, and it’s definitely worth following along if you’re curious about Nix and want to be able to do something useful with it right away

if you end up liking Nix and want more of it, NixOS is an entire Linux distro configured and managed by Nix, and it’s incredibly powerful and stable. I run it on a full-fat gaming PC as my primary OS and the experience of running it is surprisingly very good; feel free to ask and I’ll summarize how I run stuff like games on NixOS

see this lemmy-ansible github issue for the fix; basically, our web server now knows how to handle activitypub traffic in a more conforming way

to interact with us from mastodon:

• find the community you want to subscribe to here. note its real name -- that's the name in the sidebar after the !
• search for @communityname@awful.systems in mastodon
• follow that user and enjoy our posts over there! replying and boosting should work ok, no guarantees for anything else

as for interacting with mastodon from here, I think you can paste mastodon URLs into our search and it'll maybe work? someone try that