Stop running association callbacks when setting `has_many` inverse records. The `before_add` and `after_add` callbacks are meant for newly added records.