summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Fix UTF-16 result handling for efibootmgrstable/2023.1Julia Kreger2023-04-274-63/+91
| | | | | | | | | | | | | | | | | | | | | | | | | | | | The tl;dr is that UEFI NVRAM is in encoded in UTF-16, and when we run the efibootmgr command, we can get unicode characters back. Except we previously were forcing everything to be treated as UTF-8 due to the way oslo.concurrency's processutils module works. This could be observed with UTF character 0x00FF which raises up a nice exception when we try to decode it. Anyhow! while fixing handling of this, we discovered we could get basically the cruft out of the NVRAM, by getting what was most likey a truncated string out of our own test VMs. As such, we need to also permit decoding to be tollerant of failures. This could be binary data or as simple as flipped bits which get interpretted invalid characters. As such, we have introduced such data into one of our tests involving UEFI record de-duplication. Closes-Bug: 2015602 Change-Id: I006535bf124379ed65443c7b283bc99ecc95568b (cherry picked from commit 76accfb880474445a5dcb07825889123b3dd0237)
* Update TOX_CONSTRAINTS_FILE for stable/2023.1OpenStack Release Bot2023-03-091-4/+4
| | | | | | | | | | | | Update the URL to the upper-constraints file to point to the redirect rule on releases.openstack.org so that anyone working on this branch will switch to the correct upper-constraints list automatically when the requirements repository branches. Until the requirements repository has as stable/2023.1 branch, tests will continue to use the upper-constraints list on master. Change-Id: I0b3a9e91acc89777425647c1884e7878461ada1a
* Update .gitreview for stable/2023.1OpenStack Release Bot2023-03-091-0/+1
| | | | Change-Id: I5f7278a02971e707dc1e1f074685ba3639e017be
* Merge "update NVIDIA NIC firmware images and settings by ironic-python-agent"9.4.0Zuul2023-01-316-0/+2159
|\
| * update NVIDIA NIC firmware images and settings by ironic-python-agentwaleed mousa2023-01-116-0/+2159
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add "update_nvidia_nic_firmware_image" and "update_nvidia_nic_firmware_settings" clean steps to MellanoxDeviceHardwareManager. By adding those two steps, we can update the firmware image and firmware settings of NVIDIA NICs by ironic-python-agent using manual cleaning command The clean steps require mstflint package installed on the image. The "update_nvidia_nic_firmware_image" clean step requires to pass "images" parameter to the clean command The "images" parameter is a json blob contains a list of images, where each image contains a map of: * url: to firmware image (file://, http://) * checksum: checksum of the provided image * checksumType: md5/sha512/sha256 * componentFlavor: PSID of the nic * version: version of the FW The "update_nvidia_nic_firmware_settings" clean step requires to pass "settings" parameter to the clean command The "settings" parameter is a json blob contains a list of settings, where each settings contains a map of: * deviceID: device ID * globalConfig: global config * function0Config: function 0 config * function1Config: function 1 config Change-Id: Icfaffd7c58c3c73c3fa28cfc2a6c954d2c93c16e Story: 2010228 Task: 46016
* | Merge "Make logs collection a hardware manager call"9.3.0Zuul2023-01-265-156/+161
|\ \
| * | Make logs collection a hardware manager callDmitry Tantsur2023-01-255-156/+161
| |/ | | | | | | | | | | This allows hardware managers to collect additional logs. Change-Id: If082b921d4bf71c4cc41a5a72db6995b08637374
* | Merge "Readd usedevelop true to tox.ini"Zuul2023-01-261-0/+1
|\ \
| * | Readd usedevelop true to tox.iniRiccardo Pittau2023-01-251-0/+1
| |/ | | | | | | | | | | This avoid using sdist, which is the wanted behavior Change-Id: Ibfb867ee0ff8274130a19538aa7ff9b9296dc4e1
* | Make reno ignore bugfix eol tagsJay Faulkner2023-01-251-0/+2
|/ | | | | | | | | Reno was assuming all tags ending in -eol represented an old, EOL'd stable branch. That's not true for Ironic projects which have bugfix branches. Update the regexp to exclude those branches. Co-Authored-By: Adam McArthur <adam@mcaq.me> Change-Id: I265969ab40a98a02962c2fc8460b6519ab576f99
* Merge "modify error word node"Zuul2023-01-041-1/+1
|\
| * modify error word nodeliuyuanfeng2022-12-301-1/+1
| | | | | | | | Change-Id: Ie5c9fa7489eb891ef1bbe57c7d51ecb64e1c0db8
* | Remove old, unused proxy.sh fileJay Faulkner2023-01-031-6/+0
| | | | | | | | | | | | This should've been removed with the rest of the contents of imagebuild/ Change-Id: I2ce3ad155d2963352daa5ea8d983d35e8f41eb19
* | Fix for tox4 and setuptoolsRiccardo Pittau2023-01-023-1/+2
|/ | | | | | | | | | | | - Disable auto discovery in setuptools This is to avoid issues with latest setuptools after version 61.0 For more info see [1] - add bash script to allowlist in tox.ini - use default size for vm memory [1] https://github.com/pypa/setuptools/issues/3197 Change-Id: Iae24917add1aae6b1ed46dba0d2c270b39c5698c
* Merge "Fix create configuration unit tests"Zuul2022-12-161-0/+2
|\
| * Fix create configuration unit testsRiccardo Pittau2022-12-151-0/+2
| | | | | | | | | | | | | | | | | | | | | | The unit tests for create_configuration give different result if ran on a bios or uefi booted machine because they get the partition table type value based on the utils function get_node_boot_mode. Let's mock the boot_mode as we do in other tests to get an independent result. Change-Id: Ic0e7daea7ec4ce0806cd126c27166f84690c5d9e
* | Fixes for tox 4.0Jay Faulkner2022-12-151-7/+8
|/ | | | | | | - passenv needed better structure - usedevelop no longer allowed alongside skipsdist Change-Id: I22dae3b1e4cca2dc328c21e889acf7fe98a80e0b
* Merge "Fix failure of bind mount in _install_grub2"9.2.0bugfix/9.2Zuul2022-10-172-3/+46
|\
| * Fix failure of bind mount in _install_grub2Vanou Ishii2022-09-222-3/+46
| | | | | | | | | | | | | | | | | | | | | | | | When IPA runs _install_grub2, IPA tries to bind mount /dev, /proc and /run to <temporal directory path root partition mounted>/{dev,proc,run}. However that bind mount fails because there aren't such mount point path under temporal directory. To fix this failure, this patch add mkdir command before bind mount. Story: 2010292 Task: 46273 Change-Id: I434ce1bf1863ee0f11c4d09918d6d2d8dc065c02
* | Merge "prioritize lsblk as a source of device serials"Zuul2022-10-146-77/+190
|\ \
| * | prioritize lsblk as a source of device serialsRozzii2022-10-106-77/+190
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The current way of prioritizing ID/DM_SERIAL_SHORT or ID/DM_SERIAL works in most cases but the udev values seem to be unreliable. Based on experience it looks like lsblk might be a better source of truth than udev in regerards to serial number information. This commit makes lsblk the default provider of block device serial number information. Story: 2010263 Task: 46161 Change-Id: I16039b46676f1a61b32ee7ca7e6d526e65829113
* | | Merge "Update release versions for yoga"Zuul2022-10-141-3/+3
|\ \ \ | |/ / |/| |
| * | Update release versions for yogaRiccardo Pittau2022-09-231-3/+3
| | | | | | | | | | | | Change-Id: I06d14bc499a7c081fe73b68de6c49e2f1bc51dc5
* | | Switch to 2023.1 Python3 unit tests and generic template nameOpenStack Release Bot2022-09-231-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is an automatically generated patch to ensure unit testing is in place for all the of the tested runtimes for antelope. Also, updating the template name to generic one. See also the PTI in governance [1]. [1]: https://governance.openstack.org/tc/reference/project-testing-interface.html Change-Id: I91232b32f26842802fc42c1d9e28a6ea791ecb7b
* | | Update master for stable/zedOpenStack Release Bot2022-09-232-0/+7
|/ / | | | | | | | | | | | | | | | | | | | | | | Add file to the reno documentation build to show release notes for stable/zed. Use pbr instruction to increment the minor version number automatically so that master versions are higher than the versions on stable/zed. Sem-Ver: feature Change-Id: Iff9b5efee0b436357d5cae3909a89cd09d5e6070
* | Merge "add openstack-python3-zed-jobs-arm64 job"9.1.0Zuul2022-09-201-0/+1
|\ \
| * | add openstack-python3-zed-jobs-arm64 joblikui2022-08-291-0/+1
| | | | | | | | | | | | | | | | | | This is a non-voting job to validate py3 unittests on ARM64 Change-Id: I608d2e4e9e378b1f6e33a7e1a2cdc1c0bab7ec5c
* | | SoftwareRAID: Enable skipping RAIDSJakub Jelinek2022-09-058-59/+750
| |/ |/| | | | | | | | | | | | | | | | | | | | | | | | | Extend the ability to skip disks to RAID devices This allows users to specify the volume name of a logical device in the skip list which is then not cleaned or created again during the create/apply configuration phase The volume name can be specified in target raid config provided the change https://review.opendev.org/c/openstack/ironic-python-agent/+/853182/ passes Story: 2010233 Change-Id: Ib9290a97519bc48e585e1bafb0b60cc14e621e0f
* | Merge "Create RAIDs with volume name"Zuul2022-09-025-44/+117
|\ \ | |/ |/|
| * Create RAIDs with volume nameJakub Jelinek2022-09-025-44/+117
| | | | | | | | | | | | | | | | Use 'volume_name' field from 'target_raid_config' to create logical disks if it is present Do not allow two logical disks to have the same volume name Change-Id: If3e4e9f8698ec3e0cb49717f8ed2087d2ba03f2c
* | Trivial: Fix reno for software raid fixJulia Kreger2022-08-251-1/+1
| | | | | | | | | | | | | | Fixes the release note for If721dfe1caa5915326482969e55fbf4697538231. Change-Id: I9971d12665f2c8a4fdfe82911c6173021d03ddc0
* | Merge "Fix software raid output poisoning"Zuul2022-08-254-1/+43
|\ \
| * | Fix software raid output poisoningJulia Kreger2022-08-244-1/+43
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | In the event a device name is set to contain a raid device path, it is possible for the Name and Events field values of mdadm's detailed output to contain text which inadvertently gets captured and mapped as component data for the "holder" devices of the RAID set. This would cause invalid values to get passed to UEFI methods which would cause a deployment to fail under these circumstances. We now ignore the Name and Events fields in mdadm output. Change-Id: If721dfe1caa5915326482969e55fbf4697538231
* | | remove unicode prefix from codeniuke2022-08-232-11/+11
|/ / | | | | | | Change-Id: I70f0112f1ee3066ffd9316d10b84b9ea5b7fc306
* | Merge "Improve function list_block_devices_check_skip_list"Zuul2022-08-172-25/+20
|\ \
| * | Improve function list_block_devices_check_skip_listJakub Jelinek2022-08-162-25/+20
| | | | | | | | | | | | | | | | | | | | | | | | | | | Fix minor issues suggested by dtantsur Add an example of skip list specification to the documentation A follow-up patch to I3bdad3cca8acb3e0a69ebb218216e8c8419e9d65 Change-Id: Ic94a33b7bc0572a1cc8f92b330474ec63a173e81
* | | Merge "Enable skipping disks for cleaning"9.0.0Zuul2022-08-164-9/+265
|\ \ \ | |/ / | | / | |/ |/|
| * Enable skipping disks for cleaningJakub Jelinek2022-08-114-9/+265
| | | | | | | | | | | | | | | | | | | | | | | | Introduce a field skip_block_devices in properties - this is a list of dictionaries Create a helper function list_block_devices_check_skip_list Update tests of erase_devices_express to use node when calling _list_erasable_devices Add tests covering various options of the skip list definition Use the helper function in get_os_install_device when node is cached Story: 2009914 Change-Id: I3bdad3cca8acb3e0a69ebb218216e8c8419e9d65
* | Merge "Use lsblk json output for safety_check_block_device"Zuul2022-08-032-32/+31
|\ \ | |/ |/|
| * Use lsblk json output for safety_check_block_deviceRiccardo Pittau2022-07-202-32/+31
| | | | | | | | Change-Id: Ibfc2e203287d92e66567c33dc48f59392852b88e
* | Remove unused lines of codeJakub Jelinek2022-07-201-5/+0
| | | | | | | | | | | | | | The 5 lines of code were extracted from erase_devices_metadata to _list_erasable_devices, but now are duplicated in both functions. The variable block_devices is not used in erase_devices_metadata. Change-Id: I89f56c69d90fb0eb61907d6667266fbd57d333af
* | Merge "Guard shared device/cluster filesystems"Zuul2022-07-208-9/+499
|\ \ | |/
| * Guard shared device/cluster filesystemsJulia Kreger2022-07-198-9/+499
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Certain filesystems are sometimes used in specialty computing environments where a shared storage infrastructure or fabric exists. These filesystems allow for multi-host shared concurrent read/write access to the underlying block device by *not* locking the entire device for exclusive use. Generally ranges of the disk are reserved for each interacting node to write to, and locking schemes are used to prevent collissions. These filesystems are common for use cases where high availability is required or ability for individual computers to collaborate on a given workload is critical, such as a group of hypervisors supporting virtual machines because it can allow for nearly seamless transfer of workload from one machine to another. Similar technologies are also used for cluster quorum and cluster durable state sharing, however that is not specifically considered in scope. Where things get difficult is becuase the entire device is not exclusively locked with the storage fabrics, and in some cases locking is handled by a Distributed Lock Manager on the network, or via special sector interactions amongst the cluster members which understand and support the filesystem. As a reult of this IO/Interaction model, an Ironic-Python-Agent performing cleaning can effectively destroy the cluster just by attempting to clean storage which it percieves as attached locally. This is not IPA's fault, often this case occurs when a Storage Administrator forgot to update LUN masking or volume settings on a SAN as it relates to an individual host in the overall computing environment. The net result of one node cleaning the shared volume may include restoration from snapshot, backup storage, or may ultimately cause permenant data loss, depending on the environment and the usage of that environment. Included in this patch: - IBM GPFS - Can be used on a shared block device... apparently according to IBM's documentation. The standard use of GPFS is more Ceph like in design... however GPFS is also a specially licensed commercial offering, so it is a red flag if this is encountered, and should be investigated by the environment's systems operator. - Red Hat GFS2 - Is used with shared common block devices in clusters. - VMware VMFS - Is used with shared SAN block devices, as well as local block devices. With shared block devices, ranges of the disk are locked instead of the whole disk, and the ranges are mapped to virtual machine disk interfaces. It is unknown, due to lack of information, if this will detect and prevent erasure of VMFS logical extent volumes. Co-Authored-by: Jay Faulkner <jay@jvf.cc> Change-Id: Ic8cade008577516e696893fdbdabf70999c06a5b Story: 2009978 Task: 44985
* | Drop support for instance netbootDmitry Tantsur2022-07-076-47/+21
|/ | | | Change-Id: I2b4c543537dac8904028fdcdb590c1c214238e10
* Merge "CI: Removing ironic job queue"Zuul2022-07-051-1/+0
|\
| * CI: Removing ironic job queueJulia Kreger2022-05-191-1/+0
| | | | | | | | | | | | | | Please see: https://zuul-ci.org/docs/zuul/latest/releasenotes.html#relnotes-4-1-0-deprecation-notes Change-Id: I341b8a2220a49c5a7c3f78fed3a1baa0f0638cde
* | Merge "Fix passing kwargs in clean steps"Zuul2022-07-044-1/+73
|\ \
| * | Fix passing kwargs in clean stepswaleedm2022-07-014-1/+73
| | | | | | | | | | | | | | | | | | | | | | | | Pass kwargs to dispatch_to_managers method in execute_clean_step Change-Id: Ida4ed4646659b2ee3f8f92b0a4d73c0266dd5a99 Story: 2010123 Task: 45705
* | | Merge "Drop python2 from bindep.txt"Zuul2022-07-021-3/+1
|\ \ \
| * | | Drop python2 from bindep.txtPavlo Shchelokovskyy2022-06-301-3/+1
| |/ / | | | | | | | | | | | | | | | | | | | | | | | | IPA dropped support for Python2 long ago, and now Python2 is not even available in newer distros, breaking installation if IPA binary dependencies. Depends-On: https://review.opendev.org/c/openstack/ironic/+/848345 Change-Id: I75a618f94de58f6de2bd96b37de1894bb0e61998
View Lorry Controller Status