I wonder if rate_filter is what you are looking for:
https://suricata.readthedocs.io/en/suricata-5.0.2/configuration/global-thresholds.html#rate-filter
Something like
alert http any any -> any any (http.stat_code; content:"404"; sid:123;)
rate_filter gen_id 1, sig_id 123, track by_dst, count 50, seconds 60, new_action drop, timeout 3600
The rate_filter rule would sit in threshold.config.