Thanks, I ended up going with Garage, but it has the same issue. I assumed I could just specify some buckets with their keys in the docker-compose or garage.toml, but no - they had to be done through the api or command line.

This is correct, I already installed the minio cli, but when I came back and read this, I tried it out and yes, once garage is running in the container, you can

alias garage="docker exec -ti <container name> /garage"

so you can do the cli things like garage bucket info test-bucket or whatever. The --help for the garage command is pretty great, which is good since they don’t write it up much in the docs.

Thanks. I ended up going with Garage (in Docker), and installed the minio client cli for these tasks.

One I’m writing. I use the host file system (as I have a strong preference for simple) for it’s storage, but I’m interested in adding Litestream for replicating the database onto AWS.

"Convert this text to make it sound like from a random person: "

Love the effort you’ve put into this question. You’ve clearly done some quality research and thinking.

When I asked myself this same question a couple of years ago, I ended up just buying a second hand Synology NAS to use alongside my mini-pc. That would meet your criteria, and avoids the (I’m not sure what magnitude) reliability risk of using disks connected over USB. It’s more proprietary than I’d like, but it’s battle tested and reliable for me.

starcoder2:latest       	f67ae0f64584	1.7 GB	3 days ago 	
phi3:latest             	d184c916657e	2.2 GB	3 weeks ago	
deepseek-coder-v2:latest	8577f96d693e	8.9 GB	3 weeks ago	
llama3:8b-instruct-q8_0 	1b8e49cece7f	8.5 GB	3 weeks ago	
dolphin-mistral:latest  	5dc8c5a2be65	4.1 GB	3 weeks ago	
codeqwen:latest         	df352abf55b1	4.2 GB	3 weeks ago	
llama3:latest           	365c0bd3c000	4.7 GB	4 weeks ago

I mostly use starcoder2 with Continue for code autocomplete, the big deepseek coder is a bit slow (I can feel it thinking), but it and the regular llama3 are good for chatbot type programming questions.

I don’t really have anything to compare the M1 performance to. I guess the 8GB models output text a little slower than the web versions of the same models, and the 4GB ones about the same. Using ollama in the terminal, there’s sometimes a 0.5-2 second pause before it starts outputting. Not with phi3 though - it’s surprisingly snappy for the quality of answers.

An M1 MacBook with 16GB cheerfully runs llama3:8b outputting about 5 words a second. A second hand MacBook like that probably costs half to a third of a secondhand RTX3090.

It must suck to be a bargain hunting gamer. First bitcoin, and now AI.

edit: a letter

I use the Continue VS Code plugin with Ollama to use a couple of different models (deepseek-coder-v2 & starcoder2) to recreate a local only Github Copilot type experience for coding. This is on an M1 Apple Silicon though. For autocomplete the generation needs to be pretty brisk - I’m not sure how that would go in a VM without a GPU.

Infrastructure:

• Proxmox VE - everything’s virtualised on Debian, mostly in docker inside LXC’s for neat backup/restore and moving between nodes
• NGINX Proxy Manager - in front of most of my homelab services so they have https certificates
• Tailscale - access everything, everywhere, including on phone, securely
• Uptime Kuma - monitoring, with ntfy notifications
• apt cacher NG - unnecessary caching of apt updates

Apps:

• AudioBookShelf - Audio books (download them from here into BookPlayer (iOS) to listen in the car)
• Kavita - eBooks.
• BOINC - curing childhood cancer
• Forgejo - git repository. I do a bit of dev, but everyday self-hosters should probably still learn git to manage their configs
• Jellyfin - TV/Movies
• Syncthing - I replaced dropbox with Syncthing and FileBrowser, and Evernote with Syncthing and SilverBullet

Currently in testing on the dev server:

• neko - virtualised browser. Been experimenting with this in a container with a VPN for really simple secure browsing - ie launch it, do your online banking and then destroy the container.
• Dashy - I go through periods of wanting a pretty home page with all my services, set it all up, then fail to actually use it and eventually delete it, then hear about another cool one…
• Sharry - securish file sharing. I don’t love just emailing my accounts off to the accountant.
• LimeSurvey - survey software (like Survey Monkey) - just something I’m testing for work
• Omada controller - I’ve got a TP-Link switch and WAP that don’t really need centrally controlled, but you know, can be.
• A couple of development environment LXCs I use VS Code in

I still have not landed on a music system. I’ve put some of my library on Jellyfin, and tried a couple of apps with, but haven’t hit on a good combination yet. [edit:formatting}

lol - you are probably right, I’m over-thinking it. The coffee I drink every day now (with an acceptably small amount of fiddling around) is reliably excellent. Perhaps I don’t need to watch the Aeropress movie ;-)