From my short time with proxmox, I had to dive into the command line to do configuration at the host level that couldnt be done with the UI. I think nixos will help replacd those ad hoc configurations with nix options. In the many articles I read about gpu passthru, and also doing harddrive passthru, I had to work in the host debian environment.

I dumped proxmox because I couldnt get gpu passthrough to work, and havent looked back. Nixos modules and docker have served me better than VMs for my usecase.

This guy develops on windows

not sure if this fits your usecase, but nixos-mailserver

I used nixos-mailserver with success, and very little configuration. Most of it was dns, and thr guide walked me through it. You would have to a nixos box somewhere though. I spun one up on my vps for it.

If you enable iptables you may have to disable firewall.

I am also using nixvim. Didn’t know about this fork. I think I like it? It beats manually writing setup configs. But Im not a vim superuser by any means, so I’m sure nixneovim would be equally useful to me.

Use git? Use CI/CD? What do you mean?

That’s right, “text-generation-webui”. At least its unambiguous lol. Thanks for sharing.

What GPU are you using to run it? And what UI are you using to interface with it? (I know of gpt4all and the generic sounding ui-text-generation program or something)

Yes I’ve got that set but still running into issues at runtime.

It was not configured correctly. Its a nixos bug. Thanks for pointing out the daemon config its what lead me down to solving the docker problem.

Yes thats the nvidia-container-toolkit I described above. It should be installed.

Do you prefer the track ball for your thumb or for your middle finger?

Sorry about your troubles. Keep at it, I promise its greener on the other side.

One tip: nix-env installs things ad hoc. Its against fhe whole philosphy of nix, where your system state is defined in files. So don’t ever use that. If you need any generic package, you can add it to environment.systemPackages. If you accidentally installed something that way, its okay. Just know you might get an error if you try installing it both from nixos-rebuild and nix-env. If that happens, just uninstall from nix-env.

I think it overinflates the click rate, which means despite having more clicks on an ad, that doesnt mean that more people bought some product. This devalues click rate which might make the ad service less valuble to advertisers, so they dont spend as much on Google’s ad service.

And in general I think makes any training data for a model more muddy, since adnauseum isnt behaving like a human. So it could make it more difficult to train models that do targeted advertising.

As a community, I do think we get hungup on distros. Most of them, as you mentioned, are just different defaults of the same packages.

But at the maintainer level, I do think theres a lot of work distributions do at making sure the software they choose as defaults are up to date, secure, and work with one another. I dont enounter it often, but relying on maintainers to prevent mismatched depencies ending up in the day-to-day linux user has to be worth something. And every set of defaults needs that level of assurance, I would think. Im not a maintainer, I could be off here.

What database client do you use? Maybe a plain database is enough with the right client.

Doesn’t need to. That’s a plus though. I think the features I like the most are dropdowns for foreign keys and more specific column types. For instance, a date type gives me a calendar picker, and an image type lets me upload and image and then see it as I browse the data.

Yes everyone would need a client (probably?) but after having recently set it up the first time, its incredibly simple.

You can also use p2p mesh vpn services like zerotier or tailscale to establish a direct connection without opening any port in the router at all.