I'll give LM studio a go, thanks.
That sounds like a far better system then, so definitely explains the difference in quality.
You are assuming that the company cares about training, and not just a source of cheap labour. Apprentices are paid barely above minimum wage in Aus, and there are kickbacks to the companies to encourage employing them.
If it worked as you described (which is how it should work), I would absolutely agree with you, but the system in Aus happily churns out some absolute duds. Just like the uni system.
Also, for what its worth, many uni degrees include a year of paid internship, but there are similar issues that allow duds to sail through there as well.
At the time, it wasn't clear that VRAM beyond 8GB was beneficial. Most cards at the time had basically capped at 8 for ages, and I wanted performance for ray tracing. In hindsight it was a bad call, but for gaming it made sense.
Not 24/7, I'd just start my PC when I need it, but its still more power than I'd like.
Keeping data local does make sense, which is why I have been toying with it. I can run relatively stepped on gemma4 models in 8GB, so for now, I'm happy, but im definitely looking at a Nvidia P40 as a second card.
My point is that by the time you have the paper, in either case, there is zero reliable proof that you can do either job. Real world work experience (successfully ran a sparky business, or successfully held a job for a few years) counts far more than the paper does.
Australia. And yes, you have to do on the job training, but that doesn't mean anything. The quality of the work experience is highly variable, so you could spend all of it learning, or all of it buying coffee and sweeping floors.
I very much regret getting a 3070, with only 8GB of ram... Only reason I am hesitant about 3060s is that dual cards will use more power, and the economics are already pretty dicey when the hosted models are being sold below cost.
An electrician certification doesn't mean a whole lot either. Both are just paper. Degrees with work experience and trades with apprentership time hold a little more value, but its still hit and miss.
Full quantisation? I've only got a 8GB 3070, but I'll give it a go
Edit: Tried the unsloth/qwen3.6 with llama.CPP, and it failed to allocate a 26GB Vulcan buffer and died. Dunno what magic your using, no luck for me though :(
Little outside my budget personally, but I've definitely been itching to pull the trigger on a nVidia P40
This is for qwen 3.5, not 3.6, but the vram requirements are a little out there for most:
https://willitrunai.com/blog/qwen-3-5-27b-vram-requirements
16 to 55GB...
I'll bite, why do we need a linux alternative? And what is wrong with BSD?