Bug #21569
closed
clean backend object takes a long time to run on a foreman instance with thousands of hosts
Description
During the upgrade of a database with a large # of consumers the clean_backend_objects step ran for several hours and then eventually died:
foreman-rake katello:correct_puppet_environments COMMIT=true finished successfully!
Upgrade Step: clean_backend_objects (this may take a while) ...
[DEBUG 2017-10-27 13:28:32 main] foreman-rake katello:correct_puppet_environments COMMIT=true finished successfully!
[ INFO 2017-10-27 13:28:32 main] Upgrade Step: clean_backend_objects (this may take a while) ...
[DEBUG 2017-10-27 18:25:40 main] rake aborted!
[DEBUG 2017-10-27 18:25:40 main] Errno::ECONNRESET: Connection reset by peer - SSL_connect
during the execution there was a lot of load on the Foreman as we made many API calls into Candlepin to check for missing data.
We need to improve the performance of this task so it doesn't cause undue upgrade pain.
Updated by 
Updated by 
Updated by