Yep, if you tell an AI to do something, you are at least partially to blame for whatever it does. They shouldn't be able to avoid responsibility that easily.

That's kind if what Germany told Google. "If you have AI write your search summaries, you are responsible for checking its work and liable for its mistakes.

It didn't work for the RealPage rent price-fixing lawsuit.

Landlords used a common platform to price fix without communication between the companies and that was ruled illegal, it's not quite the same but because of the way public LLMs don't isolate inputs from users, you could argue that if any 2 users input their prices into the same platform they are engaging in collision as the information isn't public.

https://www.justice.gov/opa/pr/justice-department-reaches-proposed-settlement-greystar-largest-us-landlord-end-its

Really we should just ban all algorithmic price setting.