summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Updated from global requirementsmitaka-eolstable/mitakaOpenStack Proposal Bot2017-02-171-2/+2
| | | | Change-Id: Ie24c528938e892136cf46151d27cbbfa6711fcd4
* Prepare for using standard python testsAndreas Jaeger2017-02-161-0/+54
| | | | | | | | | | | | | | | | | Add simple script to setup mysql and postgresql databases, this script can be run by users during testing and will be run by CI systems for specific setup before running unit tests. This is exactly what is currently done by OpenStack CI in project-config. This allows to change in project-config the python-db jobs to python-jobs since python-jobs will call this script initially. See also http://lists.openstack.org/pipermail/openstack-dev/2016-November/107784.html Needed-By: I1c6c23b39a93991d2dcb5e753fd851d244326581 Change-Id: Ibbe9910b0bae398542bf5fb84f2c7151bc898770 (cherry picked from commit fd3503e110fafd0fbe08effe1cceb4a964e41ff0)
* Add Constraints supportTony Breeds2017-02-162-2/+35
| | | | | | | | | | | | | | Adding constraints support to libraries is slightly more complex than services as the libraries themselves are listed in upper-constraints.txt which leads to errors that you can't install a specific version and a constrained version. This change adds constraints support by also adding a helper script to edit the constraints to remove taskflow. (cherry picked from commit 09ded16b22a03c44d907db965d4a376a132b8030) Change-Id: I7dd194beaac22110821270bbca141220f8580182
* Update .gitreview for stable/mitakaDoug Hellmann2016-03-091-0/+1
| | | | Change-Id: Icdd4e93edef1d53d12e6ab1e7066fac6275ac68b
* Updated from global requirements1.30.0OpenStack Proposal Bot2016-02-231-1/+1
| | | | Change-Id: Ib52b5d70f6985f7a0f9e4701063a827fa51e94b7
* Sqlalchemy-utils double entry (already in test-requirements.txt)Joshua Harlow2016-02-211-2/+0
| | | | | | | | | | | Since sqlalchemy as a backend is optional (only needed if someone is using persistence and a database) then it's only needed during testing (to ensure it still works). Also pip complains about double requirement entries and fails to install into a virtualenv, so this fixes that as well. Change-Id: Ica34b719e7a750a9cf3ae381f43edf117e0478a8
* Updated from global requirements1.29.0OpenStack Proposal Bot2016-02-192-2/+2
| | | | Change-Id: I0c387fab2337a11b9784a23a06e78012a8827520
* Add missing direct dependency for sqlalchemy-utilsDavanum Srinivas2016-02-181-0/+3
| | | | | | | oops looks like we missed one Closes-Bug: #1545895 Change-Id: I6dd68a7f99281701506fb6fa9834985e97573c0d
* Merge "Add WBE worker expiry"1.28.0Jenkins2016-02-156-12/+78
|\
| * Add WBE worker expiryJoshua Harlow2016-02-146-12/+78
| | | | | | | | | | | | | | | | | | When a worker hasn't responded to a notification request for a given amount of time remove it from being a useable worker that we can match task submissions to. Change-Id: I596bccc1c42f83ee79136dd27bc87039154ff7b1
* | Merge "Some WBE protocol/executor cleanups"Jenkins2016-02-158-139/+118
|\ \ | |/
| * Some WBE protocol/executor cleanupsJoshua Harlow2016-02-148-139/+118
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Remove some of the usage of @property as none of these objects are publicly exposed (or have docstrings on them) to save some space/lines of code that aren't really adding any benefit. Use less **kwargs when we know exactly what the keyword arguments will or will not be. Being explicit makes it easier to understand these functions (vs not knowing what the arguments can or can't be). Removes base worker finder because right now we only have one implementation (at some point we will have two) but we can just wait to add a base class until then. Change-Id: I7107ff6b77a355b4c5d301948355fb6386605388
* | Merge "Remove need for separate notify thread"Jenkins2016-02-153-49/+69
|\ \ | |/
| * Remove need for separate notify threadJoshua Harlow2016-02-143-49/+69
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Instead of having a periodic notification thread that will drop messages to try to find workers we can just have this same work be done in the periodically called on_wait callback that is already used for expiring and matching workers to new/updated workers. This avoids having one more thread that doesn't do all that much (and activating it during waiting calls will be often enough to achieve its goal in life). Change-Id: If80233d13d914f2ed3665001a27627b78e6ee780
* | Updated from global requirementsOpenStack Proposal Bot2016-02-141-1/+1
|/ | | | Change-Id: I056f334614e0f0a518b9110f861dd65acf9e7ea7
* Merge "Don't bother scanning for workers if no new messages arrived"Jenkins2016-02-132-7/+26
|\
| * Don't bother scanning for workers if no new messages arrivedJoshua Harlow2016-02-112-7/+26
| | | | | | | | | | | | | | | | | | | | If the worker finder has not gotten any new notification messages letting it know about new (or updated) workers we can just skip trying to match existing waiting work to workers as without messages being processed the match will still not work (as the worker data doesn't change without those messages being processed). Change-Id: I41d50c676f04f85c49a03d9d503da1955af45f7d
* | Merge "Fix for WBE sporadic timeout of tasks"Jenkins2016-02-137-247/+83
|\ \ | |/
| * Fix for WBE sporadic timeout of tasksJoshua Harlow2016-02-057-247/+83
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This fixes the sporadic of tasks that would happen under certain circumstances. What happened was that a new worker notification would be sent to a callback while at the same time a task submission would come in and there would be a small race period where the task would insert itself into the requests cache while the callback was processing. So to work around this the whole concept of a requests cache was revamped and now the WBE executor just maintains its own local dictionary of ongoing requests and accesses it safely. During the on_wait function that is periodically called by kombu the previous expiry of work happens but now any requests that are pending are matched to any new workers that may have appeared. This avoids the race (and ensures that even if a new worker is found but a submission is in progress that the duration until that submission happens will only be until the next on_wait call happens). Related-Bug: #1431097 Change-Id: I98b0caeedc77ab2f7214847763ae1eb0433d4a78
* | Updated from global requirementsOpenStack Proposal Bot2016-02-111-1/+1
| | | | | | | | Change-Id: I70b832d236b1d36de7b9412ce20f2ae04beee8e9
* | Updated from global requirementsOpenStack Proposal Bot2016-02-111-1/+1
| | | | | | | | Change-Id: I4c2e2630e457fccc9f2984c2e47fe865b901f2d4
* | Updated from global requirementsOpenStack Proposal Bot2016-02-101-2/+2
| | | | | | | | Change-Id: Ic12b1448aa05f17e35ac21c0a3f347f9c9d0f5bf
* | Updated from global requirements1.27.0OpenStack Proposal Bot2016-02-071-1/+1
|/ | | | Change-Id: I521b1775d74138a1ae818330f9a0d5af63f921b0
* Merge "Handle cases where exc_args can't be serialized as JSON in the WBE"Jenkins2016-02-035-10/+45
|\
| * Handle cases where exc_args can't be serialized as JSON in the WBEGreg Hill2016-01-285-10/+45
| | | | | | | | | | | | | | | | | | First try to get them, but if they aren't able to be serialized, just return the failure without them. This only affects the WBE that serializes failures as part of the JSON response that is sent over the wire from the worker process to the WBE engine. Change-Id: I86e3255b612bc15097aabe63a684cf8b8808e61b
* | Merge "Use 'addCleanup' instead of 'tearDown' in engine(s) test"Jenkins2016-02-031-5/+6
|\ \
| * | Use 'addCleanup' instead of 'tearDown' in engine(s) testJoshua Harlow2015-07-171-5/+6
| | | | | | | | | | | | Change-Id: I1d9b13b6f5cd48b7ac98f5c34ef9cb837f9ca7d1
* | | Merge "Use helper function for post-atom-completion work"Jenkins2016-02-012-38/+51
|\ \ \
| * | | Use helper function for post-atom-completion workJoshua Harlow2016-01-202-38/+51
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | For allowing for future changes (where the future 'add_done_callback' can be used if we deem it to be ok to do this) make the completion of an atom a small helper function that is called (and can be called elsewhere in the future). Change-Id: Ief2746debf496b017331a88c7913d9321aac0774
* | | | Merge "Add comment as to why we continue when tallying edge decider nay voters"Jenkins2016-02-011-1/+5
|\ \ \ \
| * | | | Add comment as to why we continue when tallying edge decider nay votersJoshua Harlow2016-01-111-1/+5
| | | | | | | | | | | | | | | | | | | | Change-Id: Iaee621e15330979d80285430be97af91934b0357
* | | | | Merge "Remove stray LOG.blather"Jenkins2016-02-011-4/+4
|\ \ \ \ \
| * | | | | Remove stray LOG.blatherJoshua Harlow2016-01-131-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We are now longer using blather so remove an instance of it that must of snuck in. Change-Id: I313924da4eb5bcb815d621a3eb3d66c80ec946df
* | | | | | Enable OS_LOG_CAPTURE so that logs can be seen (on error)Joshua Harlow2016-01-281-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | Change-Id: Ic81bb43fa70ca51d5b9280a5546ac3e2045312a0
* | | | | | Merge "Disable oslotest LOG capturing"Jenkins2016-01-281-0/+1
|\ \ \ \ \ \ | |_|_|_|_|/ |/| | | | |
| * | | | | Disable oslotest LOG capturingJoshua Harlow2016-01-251-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | It would be really nice to actually be able to see the logs that happen when a failure is triggered, so this is an attempt to see if disabling LOG capturing will make that possible. Change-Id: Ia55d125de38b1843039fc7184bb24d00031e6682
* | | | | | Merge "Retrieve the store from flowdetails as well, if it exists"Jenkins2016-01-264-5/+213
|\ \ \ \ \ \
| * | | | | | Retrieve the store from flowdetails as well, if it existsGreg Hill2016-01-254-5/+213
| |/ / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Gives users a more permanent way to provide an initial set of arguments to a flow. Change-Id: Ib9c3d60882548120d467a645bbac9be78408bac3 Implements: blueprint flow-details-keep-store
* | | | | | Merge "Pass through run timeout in engine run()"Jenkins2016-01-261-2/+8
|\ \ \ \ \ \
| * | | | | | Pass through run timeout in engine run()Joshua Harlow2015-12-031-2/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | It can be quite useful to control the delay/timeout used during waiting periods via the run() method and not requiring the usage of run_iter() to achieve the same thing. This change makes it possible to pass the same timeout used in run_iter() to run() and have it be used in the engine internals. Change-Id: I3798ee14600a2d30e009abf1f273b5edbbe3f5ed
* | | | | | | Merge "Use automaton's converters/pydot"Jenkins2016-01-254-79/+60
|\ \ \ \ \ \ \ | |_|/ / / / / |/| | | | | |
| * | | | | | Use automaton's converters/pydotJoshua Harlow2015-10-114-79/+60
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This uses the automaton library's converters/pydot to generate the state machine diagram. It also regenerates the diagrams using this new code base. Depends-On: I968a15ebce839761d0a935ba6b22de64b3b7783c Change-Id: Ie59e093196d06c634378e4f4099f681b3c425aac
* | | | | | | Updated from global requirementsOpenStack Proposal Bot2016-01-241-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Change-Id: I0f34ed3ffc9c782fea38c4522f2ca34d985024ea
* | | | | | | Updated from global requirementsOpenStack Proposal Bot2016-01-231-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Change-Id: I22574ede3684bc0d8ec308ebe07f821a42daa84b
* | | | | | | Merge "Add flow durations to DurationListener"Jenkins2016-01-202-26/+56
|\ \ \ \ \ \ \
| * | | | | | | Add flow durations to DurationListenerGreg Hill2015-11-022-26/+56
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This modifies the private interface a little so if people have custom subclasses, it will require them to modify their _record_ending function to take additional arguments. Afaik, we're the only ones insane enough to do such a thing and we're ok with the change. Change-Id: I24444d65a566023afcd1546e4f784ecae36d6126 Fixes: #1510248
* | | | | | | | Merge "Add public property from storage to flowdetail.meta"Jenkins2016-01-202-1/+8
|\ \ \ \ \ \ \ \ | |_|_|_|_|_|/ / |/| | | | | | |
| * | | | | | | Add public property from storage to flowdetail.metaGreg Hill2015-11-172-1/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Sometimes you need to access the metadata from listeners and currently that requires a private property access. Change-Id: Ib4f15650b15dfe8a04dbb690607d515663371d90 Fixes: #1511086
* | | | | | | | Merge "Add useful/helpful comment to retry scheduler"Jenkins2016-01-201-0/+3
|\ \ \ \ \ \ \ \
| * | | | | | | | Add useful/helpful comment to retry schedulerJoshua Harlow2016-01-191-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is hopefully useful to understand why this happens in this order. Change-Id: I8ff63417489a8d4bada12acc91dbc6bca69df2ba