"some workloads saw improvements, overall system performance slightly declined, and binary sizes increased." So -O3 isn't paying off in the Ubuntu packaging world for now and will be reverted soon.
Arm is an awful platform. Linux support across vendors is horrible, all GPU drivers are closed, bootloaders are locked, acpi is barely supported. Please no.