If decibels were used only to measure sound relative to "experienced loudness" there would be no complaint.

The complaint is that it is used in many other ways, often without distinguishing what the base unit is.