Yeah I know they’re not the only companies doing distillation, it’s just currently in the news and on peoples minds.
This is the same interference musk has used and is being investigated for past violations. Glad they fixed it so he can continue to interfere with French elections and get his puppet leader installed and make the investigations disappear like in the US. /s
It’s not that complicated. Recreating training data via distillation is basically asking structured questions and recording the responses and reformatting that to use as cleaned “good” training data. Much less energy and compute intensive than creating the training data on your own.
I think I remember reading somewhere how Chinese research’s do this by basically using bots and spreading out the distillation to many source queries.
Distillation is a technique where an older “teacher” AI model is used to train a newer, “student,” model that replicates the capabilities of the earlier system — often at a much lower cost than producing an original model from scratch. Some forms of distillation are widely accepted and even encouraged by AI labs, such as when companies create smaller, more efficient versions of their own models, or allow outside developers to use distillation to build non-competitive technologies.
Basically one AI asks questions and records the answers to recreate training data without massive compute for training data.
Not really. I’m glad that China is copying AI models and providing them for cheaper usage or open sourcing the training.
I don’t believe any US company should monopolize the entirety of human knowledge.
Recycle all the polyester and ban it for clothing. Mandate natural fibers, like hemp!
Drill baby, drill?
They are skipping the cameras and having the car report your speed directly. No need for cameras win everyone has a gps transceiver in their pockets that’s linked to their identity.
Also, the cameras are in the cars.
the Chinese would know they fucking copied it.
Bro. You set the fucking prices you asshole.
view more:
next ›