Project

General

Profile

Actions

Bug #29397

closed

Delays when many clients upload tracer data simultaneously

Added by Jonathon Turel about 4 years ago. Updated about 4 years ago.

Status:
Closed
Priority:
Normal
Category:
API
Target version:
Difficulty:
Triaged:
Yes
Fixed in Releases:
Found in Releases:

Description

Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1691416

Description of problem:
When customer patches around 60 servers simultaneously, many of them get to the "Uploading Tracer Profile" step around the same time, and some clients have delays of over 15 minutes. It is also possible to reproduce this by running a remote execution "katello-tracer-upload" command on multiple hosts.

How reproducible: Consistently

Steps to Reproduce:
1. Have around 160 clients with katello-host-tools-tracer installed.
2. Create a Remote Execution job to run on the 160 clients and run the command "time katello-tracer-upload", with a 15 minute time out.

Actual results: In customers environment, 3 of the servers timed out after 15 minutes, and 2 servers ran for over 5 minutes.

Expected results: Servers not taking over 15 minutes to run katello-host-tools-tracer

Additional info:
Customer ran the same Remote execution job, but set the concurrency level to 1, so that it only ran on one server at a time, and did not have any failures or delays.

See also: https://community.theforeman.org/t/katello-tracer-troubleshoot/8676

Actions #1

Updated by Jonathon Turel about 4 years ago

  • Subject changed from Delays when many clients upload tracer data simultaneously to Delays when many clients upload tracer data simultaneously
  • Category set to API
  • Target version set to Katello 3.16.0
Actions #2

Updated by The Foreman Bot about 4 years ago

  • Status changed from New to Ready For Testing
  • Assignee set to Jonathon Turel
  • Pull request https://github.com/Katello/katello/pull/8625 added
Actions #3

Updated by Samir Jha about 4 years ago

  • Triaged changed from No to Yes
Actions #4

Updated by The Foreman Bot about 4 years ago

  • Fixed in Releases Katello 3.16.0 added
Actions #5

Updated by Jonathon Turel about 4 years ago

  • Status changed from Ready For Testing to Closed
Actions

Also available in: Atom PDF