summaryrefslogtreecommitdiff
path: root/swiftclient
Commit message (Collapse)AuthorAgeFilesLines
* Merge "Allow tempurl times to have units"4.1.0Zuul2022-08-252-42/+65
|\
| * Allow tempurl times to have unitsTim Burke2022-08-192-42/+65
| | | | | | | | | | | | | | Specifically, let users add a suffix for seconds, minutes, hours, or days. Change-Id: Ibbe7e5aa8aa8e54935da76109c2ea13fb83bc7ab
* | Merge "Add option to skip container PUT during upload"Zuul2022-08-232-48/+60
|\ \
| * | Add option to skip container PUT during uploadTim Burke2022-01-112-48/+60
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Currently, a user with read/write access to a container (but without access to creat new containers) recieves a warning every time they upload. Now, allow them to avoid the extra request and warning by specifying --skip-container-put on the command line. This is also useful when testing: developers can HEAD a container to ensure it's in memcache, shut down all container servers, then upload and creaate a bunch of async pendings. Previously, the 503 on container PUT would prevent the object upload from even being attempted. Closes-Bug: 1317956 Related-Bug: 1204558 Change-Id: I3d9129a0b6b65c6c6187ae6af003b221afceef47 Related-Change: If1f8a02ee7459ea2158ffa6e958f67d299ec529e
* | | Merge "Expand retry handling on ratelimit response"Zuul2022-08-191-1/+1
|\ \ \
| * | | Expand retry handling on ratelimit responseClay Gerrard2022-08-181-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We have seen middlewares that return ratelimit responses as 498 or 429, so tolerate either. Closes-Bug: #1879572 Change-Id: I027222157f6c2ad7882a0508302c9de097baae4c
* | | | Merge "Enable retry_on_ratelimit by default"Zuul2022-08-192-4/+7
|\ \ \ \ | |/ / / | | | / | |_|/ |/| |
| * | Enable retry_on_ratelimit by defaultTim Burke2022-08-182-4/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | UpgradeImpact ============= The Connection class now enables retry_on_ratelimit by default. If you need to return to the old behavior, explicitly pass retry_on_ratelimit=False as a keyword arg. The SwiftService class will now enables the retry_on_ratelimit option by default. If you need to return to the old behavior, explicitly set it to false in your options dict. Change-Id: I3221fda84f0b8031c50128aa600e2c19deb5b102
* | | Merge "More cleanup following py2 removal"Zuul2022-08-183-16/+1
|\ \ \ | |/ / |/| |
| * | More cleanup following py2 removalTim Burke2022-05-243-16/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Drop py2-only hacking pin from test-requirements. * Remove quote() helper; urllib.parse.quote() works fine. * Remove some useless code. Change-Id: I9ffc923f58f1d11538f83ff26f7beb53cdf134c3
* | | tempurl: Support sha256 and sha512 signatures4.0.1Tim Burke2022-06-082-4/+29
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | Up the default to sha256 since * the proxy has supported (and defaulted to allowing) it for four years now, and * Rackspace has supported it for even longer. Include a note in the --help about older clusters likely requiring sha1. Change-Id: Ibac2bb7e2e4c9946c7384f0aab8e43d0d79ba645 Related-Change: Ia9dd1a91cc3c9c946f5f029cdefc9e66bcf01046 Related-Bug: #1733634 Closes-Bug: #1977867
* | Add timeout for Swift service4.0.0Pavel Abalikhin2022-04-212-0/+4
| | | | | | | | | | | | | | Connection class has timeout parameter but SwiftService and shell don't use it. That can lead to an endless wait when network is unreachable. Change-Id: Iafa42fc2f8b56feefa2bc8ea6a1b8845717d3bab
* | Remove unnecessary unicode prefixesStephen Finucane2022-03-211-4/+4
| | | | | | | | | | | | | | | | All strings are unicode by default in Python 3. No need to mark them as such. Signed-off-by: Stephen Finucane <stephenfin@redhat.com> Change-Id: I68fb60ef271abfddebcc9d2137424f5db2a17e92
* | Remove unnecessary object subclassingStephen Finucane2022-03-215-16/+16
| | | | | | | | | | | | | | All classes subclass from object by default in Python 3. Signed-off-by: Stephen Finucane <stephenfin@redhat.com> Change-Id: I5a1ad57bcc092861ce969759b06a07c880ad3d35
* | Remove sixStephen Finucane2022-03-217-86/+53
| | | | | | | | | | | | | | This mostly affects tests. Nothing too complicated Signed-off-by: Stephen Finucane <stephenfin@redhat.com> Change-Id: Iabc78f651e1d48db35638280722f8019798eccd6
* | Remove coding commentsStephen Finucane2022-03-211-1/+0
| | | | | | | | | | | | | | Everything is unicode in Python 3. Signed-off-by: Stephen Finucane <stephenfin@redhat.com> Change-Id: I6a076dc67c461f265ed99878e3959e1992a88189
* | Remove __future__ importsStephen Finucane2022-03-213-6/+1
| | | | | | | | | | | | | | These aren't needed in modern Python 3 versions. Signed-off-by: Stephen Finucane <stephenfin@redhat.com> Change-Id: I5e81d6fb2e2cb8e4bfae4ed746da002f44e871c4
* | Don't patch Requests globally on importAarni Koskela2022-03-212-22/+59
| | | | | | | | | | | | | | | | | | | | This also upgrades the Requests dependency to 2.4+ (released in 2014) to avoid having to do version comparisons altogether. Refs https://bugs.launchpad.net/python-swiftclient/+bug/1904551 Signed-off-by: Aarni Koskela <akx@iki.fi> Change-Id: I58399f6c526b0b78462f31739c43076314ba9e76
* | Drop support for Python 2Stephen Finucane2022-03-161-16/+2
|/ | | | | | | There's a lot of cleanup possible, but this is a start. Signed-off-by: Stephen Finucane <stephenfin@redhat.com> Change-Id: Ia1176b7fd5434d52070d482a37abfbb98800cdb3
* Merge "Include storage policy when listing account with --long"3.13.0Zuul2021-10-131-2/+3
|\
| * Include storage policy when listing account with --longTim Burke2021-09-211-2/+3
| | | | | | | | Change-Id: Ibc2f9445b5a8e80cfb73d0706e20a7e4c62eec4a
* | Correctly aggregate totals for >10k itemsTim Burke2021-09-211-15/+17
|/ | | | | | | | | | | | | | | | | Previously, we would write out totals for every page of listings, like $ swift list sync --prefix=09-21 --total -l 80000000000 80000000000 80000000000 58096000000 Now, roll those all into a single total: $ swift list sync --prefix=09-21 --total -l 298096000000 Change-Id: Icc265636815220e33e8c9eec0a3ab80e9f899038
* Only log the traceback for non-404sTim Burke2021-09-201-1/+1
| | | | Change-Id: I08ba4a3120e99b444b13f1ca6f5493529868df26
* Improve formatting for billions of objectsTim Burke2021-09-201-2/+2
| | | | Change-Id: If8aa08c4c8c8ad6ca2c861602baf1eefa8642a8a
* Fix Typo in shell.pyjonasdlindner2021-04-291-1/+1
| | | | Change-Id: I2615e0d6b54d8cc020c24d1b5b4064e038f0934b
* Have `delete --all` imply `--versions` for the CLITim Burke2020-10-161-2/+4
| | | | Change-Id: Id5a6d4cef3d4ed76c897a099a62a4ba3ed8f8dab
* Merge "Close connections created when calling module-level functions"Zuul2020-10-151-17/+70
|\
| * Close connections created when calling module-level functionsTim Burke2020-10-131-17/+70
| | | | | | | | | | | | | | | | Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com> Change-Id: Id62e63afc6f2ffa32eb8640787c78559481050f9 Related-Change: I200ad0cdc8b7999c3f5521b9a822122bd18714bf Related-Bug: #1873435 Closes-Bug: #1838775
* | Merge "Include transaction ID in ClientException.__str__"Zuul2020-09-222-2/+13
|\ \ | |/ |/|
| * Include transaction ID in ClientException.__str__Tim Burke2020-09-092-2/+13
| | | | | | | | | | | | | | | | | | | | It's fairly annoying getting a traceback in swift's probe tests then only having a URL and status code to go searching for in logs. Leave the shell.py output untouched, though, since we output the transaction ID on a new line anyway. Change-Id: Idb849848ec08b6c04812b088467c9a687c2a7e27
* | (Mostly) revert "Cleanup session on delete"Tim Burke2020-09-081-8/+10
|/ | | | | | | | | | This reverts commit 1f26c5736949e1c3b57c024a315e33fc419f126e for py2. Apparently the existence of the __del__ method on Python 2 prevents us from cleaning up all file descriptors. Change-Id: Id6cff5dd7b9faf9c4240c0cb26b74d05ed37da5b Closes-Bug: #1873435 Related-Bug: #1838775
* Add max_backoff and starting_backoff for get_conn in swift serviceMeuh2020-07-281-2/+4
| | | | Change-Id: I45f5d3009e0e2015c7366384ee826113fc27c70b
* Clean up some warningsTim Burke2020-06-171-2/+5
| | | | Change-Id: Iae149533d04c7b173c4ef88fb775f5fe13c16466
* Application credential support follow-upTim Burke2020-05-272-16/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Following the recent v3applicationcredentials patch, if you have your environment variables set up to work with python-openstackclient using swiftclient's v1password plugin, swiftclient won't work: $ env | egrep '^(OS|ST)_' ST_KEY=testing ST_USER=test:tester OS_AUTH_URL=http://saio/auth/v1.0 ST_AUTH=http://saio/auth/v1.0 OS_USERNAME=test:tester OS_AUTH_TYPE=v1password OS_PASSWORD=testing $ openstack object store account show +------------+----------------------------+ | Field | Value | +------------+----------------------------+ | Account | AUTH_test | | Bytes | 0 | | Containers | 11 | | Objects | 0 | +------------+----------------------------+ $ swift stat Only "v3applicationcredential" is supported for --os-auth-type We don't really want to allow (and mostly ignore) arbitrary OS_AUTH_TYPE values, though -- there are a whole bunch of plugins we don't remotely support. But it seems OK to allow any of the password plugins; while we won't actually use them (currently), we provide roughly equivalent functionality. Handful of other drive-bys: * Use a None sentinel to determine whether keystoneauth1 is installed instead of trying to catch a NameError. * Clarify error state when keystoneauth1 is not installed. * Fix a typo: "sses" -> "sess". Change-Id: Id7ea9c3ea8278ae86a04d057a472a8f8a87b8eae Related-Change: I9190e5e7e24b6a741970fa0d0ac792deccf73d25
* Merge "Support v3 application credentials auth."Zuul2020-05-133-14/+112
|\
| * Support v3 application credentials auth.Charles Hsu2020-04-163-14/+112
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Use keystoneauth1 application credential plugin and session to fetch a token and endpoint catalog url. $ swift --os-auth-url http://172.16.1.2:5000/v3 --auth-version 3\ --os-application-credential-id THE_ID \ --os-application-credential-secret THE_SECRET \ --os-auth-type v3applicationcredential auth Change-Id: I9190e5e7e24b6a741970fa0d0ac792deccf73d25 Closes-Bug: 1843901 Closes-Bug: 1856635
* | Fixed capability discovery endpoint hardcodeIvan Kolodyazhny2020-04-241-2/+15
|/ | | | | | | | | | It fixes get_capabilities() method to process correctly endpoints like: 'https://<ip>:<port>/v1', 'https://<ip>:<port>/swift/v1'. Co-Authored-By: Daniel Cech <dcech@mirantis.com> Change-Id: Ib4037d0b49da1bce959947100629370805f510d5 Closes-bug: #1712358
* Improve `list --versions` outputTim Burke2020-04-101-4/+11
| | | | | | | | | | Have `--versions` imply `--long` and add a new column for version_id. Also, have version-aware listings show all versions as "null" on old Swifts that don't support object versioning (or when object versioning is not enabled). Change-Id: I0e009bce2471d1c140ac9b83700591cb355fee3f
* object versioning featuresClay Gerrard2020-04-084-28/+163
| | | | | | | | | | * add --versions to list * add --versions to delete * add --version-id to stat * add --version-id to delete * add --version-id to download Change-Id: I89802064921778fee7efe57c7d60c976cdde3a27
* Merge "Add test for bulk-delete-attempt-counter fix"Zuul2020-01-161-1/+1
|\
| * Add test for bulk-delete-attempt-counter fixTim Burke2019-11-151-1/+1
| | | | | | | | | | | | Change-Id: Ifdeefeb4a5a3fc6895bd6cda695684de02f8c602 Related-Change: If4af9141fe4f3436a4e9e0e2dfc24c6ec7292996 Related-Bug: #1852808
* | Merge "Cleanup session on delete"Zuul2019-12-091-0/+9
|\ \ | |/ |/|
| * Cleanup session on deleteAlex Schultz2019-12-081-0/+9
| | | | | | | | | | | | | | | | | | | | | | | | If an external http connection was not passed into the client, we create one with a requests.Session() on our own. Once this is used, it may still have an open socket when the connection is closed. We need to handle the closing of the requests.Session() ourselves if we created one. If you do not close it, a ResourceWarning may be reported about the socket that is left open. Change-Id: I200ad0cdc8b7999c3f5521b9a822122bd18714bf Closes-Bug: #1838775
* | Fix printed object names on successful bulk-deleteSébastien Blaisot2019-11-151-4/+2
| | | | | | | | | | | | | | | | | | Replace the 1 always concatenated to printed object names for each successfully deleted object in bulk-delete with an optional [after x attempts] if x > 1 Change-Id: If4af9141fe4f3436a4e9e0e2dfc24c6ec7292996 Closes-Bug: 1852808
* | v1auth: support endpoint_data_for() apiTim Burke2019-11-061-1/+11
| | | | | | | | | | | | | | | | ...so we can be used with openstacksdk. Also, add a few functests that use openstacksdk. Change-Id: Ie6987f5de48914ec8932254cde79a973a0264877
* | docs: Fix warning treated as errorTim Burke2019-09-041-0/+6
|/ | | | Change-Id: I669533334419e94ca925e859f2b0d5d2afe9f7f1
* Merge "Fix up requests so we can send non-RFC-compliant headers on py3"Zuul2019-08-021-2/+4
|\
| * Fix up requests so we can send non-RFC-compliant headers on py3Tim Burke2019-07-251-2/+4
| | | | | | | | Change-Id: I3dac826c1f208569c5f40431f59a2045e5744415
* | Delete/overwrite symlinks betterTim Burke2019-08-011-2/+4
|/ | | | | | | | | | | | | Previously, when deleting a symlink that points to an xLO, we'd clean up the xLO's segments then delete the symlink, leaving the xLO itself busted. Similar trouble would come from overwriting a symlink pointing to an xLO. Check for a Content-Location in the HEAD response and leave such segments. Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com> Change-Id: I45b210cf380a68bd88187c91fa2d63a8b2bb709b
* Merge "Optionally display listings in raw json"Zuul2019-07-102-1/+40
|\