diff options
author | Steve Baker <sbaker@redhat.com> | 2023-02-27 11:05:10 +1300 |
---|---|---|
committer | Steve Baker <sbaker@redhat.com> | 2023-02-27 11:10:31 +1300 |
commit | 6a9e319fbeb0851c51bb14b9c4c3c5fa4685b14d (patch) | |
tree | 7505771b8835a033e60c08c39827f03011f3d682 /releasenotes/notes/graceful_shutdown_wait-9a62627714b86726.yaml | |
parent | e54ee2ba4cb818e25c75fcdc69f7ff1dc4956c73 (diff) | |
download | ironic-6a9e319fbeb0851c51bb14b9c4c3c5fa4685b14d.tar.gz |
On rpc service stop, wait for node reservation release
Instead of clearing existing reservations at the beginning of
del_host, wait for the tasks holding them to go to completion. This
check continues indefinitely until the conductor process exits due to
one of:
- All reservations for this conductor are released
- CONF.graceful_shutdown_timeout has elapsed
- The process manager (systemd, kubernetes) sends SIGKILL after the
configured graceful period
Because the default values of [DEFAULT]graceful_shutdown_timeout and
[conductor]heartbeat_timeout are the same (60s) no other conductor
will claim a node as an orphan until this conductor exits.
Change-Id: Ib8db915746228cd87272740825aaaea1fdf953c7
Diffstat (limited to 'releasenotes/notes/graceful_shutdown_wait-9a62627714b86726.yaml')
-rw-r--r-- | releasenotes/notes/graceful_shutdown_wait-9a62627714b86726.yaml | 15 |
1 files changed, 15 insertions, 0 deletions
diff --git a/releasenotes/notes/graceful_shutdown_wait-9a62627714b86726.yaml b/releasenotes/notes/graceful_shutdown_wait-9a62627714b86726.yaml new file mode 100644 index 000000000..778b7dc6f --- /dev/null +++ b/releasenotes/notes/graceful_shutdown_wait-9a62627714b86726.yaml @@ -0,0 +1,15 @@ +--- +features: + - | + On shutdown the conductor will wait for at most + ``[DEFAULT]graceful_shutdown_timeout`` seconds for existing lock node + reservations to clear. Previously lock reservations were cleared + immediately, which in some cases would result in nodes going into a failed + state. +upgrade: + - | + ``[DEFAULT]graceful_shutdown_timeout`` defaults to 60s. Systemd + ``TimeoutStopSec`` defaults to 30s. Kubernetes + ``terminationGracePeriodSeconds`` defaults to 90s. It is recommended to + align the value of ``[DEFAULT]graceful_shutdown_timeout`` with the graceful + timeout of the process manager of the conductor process.
\ No newline at end of file |