You can add the key ignore_errors to config/appsignal.yml and list any error class you don't want reported.
...
ignore_errors:
CustomIgnoredError
...
For example if want Sidekiq jobs to fail using the normal mechanisms but not clog your logs.