summaryrefslogtreecommitdiff
path: root/src/third_party/wiredtiger/bench/workgen
Commit message (Collapse)AuthorAgeFilesLines
* Import wiredtiger: 8f90c3c2923040725fb424b3a5c510bacc4ce380 from branch ↵Luke Chen2021-03-262-1/+98
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 8d6061cfc8..8f90c3c292 for: 4.4.5 WT-6856 Extend the configurations supported by the framework WT-7060 Set the history store file size stat on startup WT-7095 Checkpoint generation update during history store checkpoint WT-7160 Migrate wiredtiger-doc-build job to Evergreen WT-7235 Enhance tiered API for object naming WT-7239 Embed compile step into macOS unit-test WT-7268 Coverity reports failures for test_harness code WT-7269 Enable column store scenarios to all RTS existing tests WT-7275 Add timestamp and transaction management to the test framework WT-7288 Construct a many-dhandle-stress.wtperf workload WT-7289 Add warning and fatal wtperf options for idle_table_cycle WT-7290 Import many-dhandle-stress.wtperf to workgen WT-7295 Compatibility with older versions of WT WT-7298 Remove LSM references from tiered cursor code WT-7299 Remove extraneous output from results.txt for Python tests WT-7300 Moving workload_generator load phase into run WT-7302 Use last connection base write generation as a minimum base write generation for a btree WT-7307 Rework the tombstone visibility checks for history store cursor previous and next calls WT-7308 Update the configuration definition of the test framework to be more structured WT-7311 New option to specify test to run in the test framework WT-7328 Coverity: Multiple warnings in local_storage extension WT-7331 Fix exact return when we place the history store cursor on e exact key initially WT-7338 Copy the configuration directory when building the test framework WT-7339 Coverity: Incorrect deallocator WT-7349 Free memory access when walking through HS during eviction WT-7354 Refactor tiered schema code to follow conventions WT-7360 Fix batchtime setting for some Evergreen builders WT-7361 Remove doc-update task from patch build
* Import wiredtiger: 3f4a0f60178bc7336f3af1f8de9c5e3161205ac5 from branch ↵Luke Chen2021-03-0331-31/+31
| | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: e320231c1b..3f4a0f6017 for: 4.4.5 WT-6673 RTS fix inconsistent checkpoint by removing updates outside of the checkpoint snapshot WT-6851 Add a thread management library to the cpp test framework WT-6853 Add workload operation tracking WT-6912 Write "logging" subpage for Architecture Guide WT-6926 Update WiredTiger source code to include 2021 copyright notices WT-7047 Use stable timestamp as required in test_prepare_hs04 WT-7208 Leave table cursor in a valid state when subordinate index fails to open WT-7224 Moved test_config.c to src/config WT-7238 Use of constructor initialization list to avoid seg fault WT-7242 Fix example to correctly use API for system and no encryption WT-7243 Fix unexpected output failure in test_bug025 WT-7252 Remove redundant code which was pushed by WT-6673
* Import wiredtiger: bb1cc65a63a4fb081cb5969f0728ff2b74fc7c8b from branch ↵Luke Chen2020-09-291-43/+0
| | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 8a1dce8653..bb1cc65a63 for: 4.4.2 WT-5645 Add Evergreen test that cycles through known failure test/format configs WT-6181 Have Python Evergreen tests print standard output on failure WT-6490 Acquire snapshot for eviction threads WT-6654 Clean up test_backup15.py WT-6657 Fix history store panic when inserting an update without timestamp WT-6670 Fix uninitialized buffer WT-6674 Remove Async API code and documentation WT-6683 Fix logically dead code WT-6685 Add import configuration option to WT_SESSION::create WT-6689 Add support for file import when the exported configuration is provided WT-6721 Add a new Evergreen task to run cyclomatic complexity WT-6734 Add missing brace to Swig Java interface
* Import wiredtiger: 6a7db4f96fe828fdb1b9a31d83460c0573a2c3b1 from branch ↵Luke Chen2020-09-094-21/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 579966149b..6a7db4f96f for: 4.4.2 WT-5144 Use wt_clock instead of wt_epoch in perf programs WT-5585 Remove cache_overflow config option WT-5693 Enable test_wt4105_large_doc_small_upd WT-5940 Migrate to Clang Format 10 WT-6000 Enhance incremental backup testing in format to support restart WT-6006 Revert test binaries to 10 in checkpoint-stress-test WT-6027 Fix docs spelling errors and warnings WT-6322 Split full compatibility tests into smaller groups WT-6390 Extend compact02 timeout from 8 => 10 minutes WT-6404 Add timing stress that delays checkpoint after it calls __wt_txn_begin WT-6451 Do not evict clean metadata pages if needed for historic reads WT-6458 read row-store leaf pages with prepared updates in a single pass WT-6463 History store operations should honor cache size WT-6471 Avoid the error message for non-existent clang-format binary WT-6472 Update timestamp_abort test cache configuration WT-6478 Cursor cache statistics not getting incremented WT-6505 Add debugging for missing file failure WT-6507 Exit cache eviction worker after our operation has timed out WT-6526 Fix assertion failure when opening DB in readonly mode after unclean shutdown WT-6532 Consider update structure overhead in split length calculation WT-6542 Add an assert to ensure we are not unintentionally returning empty values WT-6544 Onpage value not appended to the tombstone restored from the data or history store WT-6556 Fix internal sessions to use internal session close function than public API to avoid memory leak WT-6559 Use the session id from the new session to determine statistics bucket WT-6560 Fix usage of global salvage in WT utility WT-6561 Provide MongoDB configuration in the wt utility usage output WT-6569 Squash the prepared updates into a single update before writing it to data store WT-6570 RTS to remove the left over updates in the history store without stop timestamp WT-6571 Lseek cannot use error_sys_check because it does not return an int WT-6577 History store dump outputs confusing time window WT-6578 Prevent reconciliation from looking past the on-disk value WT-6581 Fix class name in test_hs15 WT-6585 Panic if updates that are older than the updates in history store are inserted to history store WT-6586 Tombstone inserted to history store should also be flagged as WT_UPDATE_HS WT-6589 Fix disabled cursor cache python tests WT-6591 Stop checkpoint thread before closing connection in Python tests WT-6593 Retry conflicting operations in test_rollback_to_stable10 WT-6596 Increase cache for timestamp abort test and separate key spaces for all abort tests WT-6598 Add new API allowing changing dhandle hash bucket size WT-6602 Allow operation timeout ms to be passed to commit and rollback WT-6604 Fix typo in the comment descibing WT_CELL structure WT-6610 Fix incremental backup checkpoint parsing to handle upgrades WT-6611 Revert enhancement allowing rename and incremental backup WT-6613 Add python test for early_load flag WT-6615 Initialize last_upd where it is actually used WT-6619 Eliminate possibility of infinite loop in test_cursor13.py WT-6623 Set the connection level file id in recovery file scan WT-6625 Remove outdated TODO WT-6635 Disable mix and column filetype test WT-6640 Coverity: Failure to restore saved dhandle WT-6641 Coverity: Unused value
* Import wiredtiger: bdff12c2331ab0478a22309a6d35519d2e2ca441 from branch ↵Luke Chen2020-05-121-1/+1
| | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 404b4a70af..bdff12c233 for: 4.4.0-rc6 WT-5864 Append globally visible tombstone with WT_TS_NONE to the update chain WT-6063 Re-enable checkpoint-filetypes-test in Evergreen WT-6065 Re-enable spinlock-gcc-test in Evergreen WT-6092 Use durable timestamp for global visibility check instead of commit timestamp WT-6111 Rework cell structures and unpacking WT-6157 Disable table logging in workgen stress test while running prepare transactions WT-6159 Tag verbose messages to make them easier to distinguish WT-6160 Fix format failure caused by stack overwrite WT-6161 Fix format hang when WiredTiger internal checkpoints are configured WT-6162 Fix incorrectly counts failures in format.sh WT-6166 KEY/VALUE short cells have to handle copy cells
* Import wiredtiger: a707df12a2503ad39ccdd82a84062faa6a07e082 from branch ↵Luke Chen2020-04-305-29/+293
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 7b994a862e..a707df12a2 for: 4.4.0-rc4 WT-3726 Add documentation specifying build pre-requisites WT-5260 Restore assert that trees being discarded are not marked dirty WT-5544 Fix cache stuck during salvage WT-5573 Re-enable unit test test_util01.test_dump_process_timestamp_old WT-5614 Coverity: Redundant NULL check WT-5623 Support reading modify type updates in the history store for non-timestamp tables WT-5661 Make WiredTiger utilities self documenting WT-5676 Prepare support with durable history: add workgen stress tests WT-5697 Dropping or renaming tables returns EBUSY in incremental backup test WT-5728 Coverity analysis defect 114081: PW.SET_BUT_NOT_USED WT-5749 Only pass a non-NULL WT_ITEM value when allocating a WT_UPDATE with associated data WT-5764 Fix and reenable test_compact02 WT-5790 Disable test_wt2246_col_append WT-5883 Add upgrade/downgrade testing to WiredTiger standalone tests WT-5911 History store verification re-architecture WT-5912 Change page deletion assert condition in __split_insert() WT-5954 Turn off column store test and lower isolation levels in test_random_abort WT-6010 Workgen changes - Add session config at Thread level WT-6031 Remove legacy WT_PAGE_MODIFY.last_stable_timestamp WT-6033 Clean up unused unittest imports WT-6044 Coverity: Variable set but never used WT-6045 Minor cleanup for test_random_abort WT-6047 Coverity: Redundant NULL check WT-6049 Fix eviction evicting uncommitted changes WT-6050 Close the metadata cursor after bulk loading WT-6053 fixed-width column-store macro can step past the end of allocated memory WT-6073 Don't append the tombstone to the update chain if it is already there WT-6078 Temporarily disable hs verify to unblock wiredtiger drop WT-6081 Switch wtperf defaults to mirror MongoDB defaults
* Import wiredtiger: 7b994a862e899a12eb7c3ac814c9fada7d8d1ab9 from branch ↵r4.4.0-rc2Luke Chen2020-04-221-0/+71
| | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 9bd1ece797..7b994a862e for: 4.4.0-rc2 WT-4701 Switch test/format to use WiredTiger locking primitives WT-5766 Separate out internal and shared transaction data WT-5791 Prepare checkpoint can finish in 0msec and reset prepare min stat WT-5794 Remove skew_newest option from reconciliation WT-5833 Fix caching issue for overflow key/value items WT-5919 Disallow logging archival testing with log-based incremental backup WT-5946 Eviction server handles can deadlock when opening HS cursors WT-5968 Make the WT_SESSION_IMPL.txn field an allocated structure WT-5986 Create script for emulating multiversion tests WT-6016 Fill source code comments where lines start with parentheticals WT-6020 __rec_append_orig_value() cleanup WT-6026 Fix s_all breakage on format.h
* Import wiredtiger: 9bd1ece7971714f947b47e589b0af5d7ee97a29d from branch ↵Luke Chen2020-04-1618-40/+110
| | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: da6c25fee0..9bd1ece797 for: 4.4.0-rc2 WT-5671 Prepare support with durable history: implement changes to prepare and commit/abort WT-5675 Prepare support with durable history: workgen changes WT-5765 Add an error return macro that skips codes but doesn't clear them WT-5825 Reduce the number of runs for checkpoint-stress-test WT-5982 Remove redundant fields used earlier for HS inserts WT-5989 Support arguments in workgen WT-5997 Disable mongodb-4.4 branch for release compatibility testing WT-5999 Update format so it's possible for it to restart on an existing database WT-6003 Remove duplicate open_cursor call WT-6007 Fix an assert for fixed length column store WT-6008 Turn off format stress testing for column-store
* Import wiredtiger: da6c25fee0c5c9b0376df0dc19caa40a553cc5a2 from branch ↵r4.4.0-rc0Luke Chen2020-04-095-37/+267
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 5b5d798856..da6c25fee0 for: 4.4.0-rc0 WT-5357 Document WT_SESSION.truncate of a log cursor WT-5527 Free the onpage updates when restoring update chains WT-5675 Prepare support with durable history: workgen changes WT-5778 Simplify __rec_append_orig_value WT-5796 Speed up verification of file's associated history store information WT-5811 Mark ASAN tests as running on a slow machine WT-5909 Coverity unused value issue WT-5930 (4.4-only) Journaled data from 4.2 binaries not recovered at startup WT-5932 Rollback to stable aborting on-disk updates for in-memory database WT-5938 Fix a memory corruption in rollback to stable WT-5941 Document how eviction works in durable history WT-5943 Consider WT_TS_NONE timestamped update also a valid update for rollback to stable WT-5944 Relax test_wt2853_perf performance parameters temporarily WT-5948 Search shouldn't ignore globally visible tombstone of history store WT-5952 Fix freeing updates racing with application threads WT-5953 Fix format CONFIG file "mmap_all" syntax incompatibility WT-5961 Respect write generations when constructing the root addr WT-5965 Ignore leading whitespace in format CONFIG files WT-5967 Remove named snapshot support WT-5978 Unstable prepared updates causing the update chain to be unnecessarily restored WT-5979 Add Evergreen release compatibility test for forward compatibility WT-5983 Remove diagnostic tests left over from WT-5043 WT-5985 Turn off format testing for relaxed isolation levels WT-5987 Turn off history store verification in the WT_SESSION.verify method WT-5988 Do not write log records as part recovery rollback to stable operation WT-5993 Restore disk page header version WT-5994 Turn off format testing for relaxed isolation levels (part 2)
* Import wiredtiger: 187983a50c696eb217a780bb6b29e4bd3433c13b from branch ↵Luke Chen2020-03-151-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 7e595e4a3a..187983a50c for: 4.4.0-rc0 WT-3821 Python test case fails due to pinned timestamp warning WT-4458 Only sweep btree handles that have been evicted from cache WT-4671 Remove Limbo pages WT-4674 Instantiate birthmark records using in-memory metadata WT-4676 Search LAS for the history and compare to in-memory update WT-4677 Re-initialize prepared updates WT-4678 Write the test workload for relevant history in cache WT-4681 Check if expired content is being swept from lookaside WT-4683 Reverse the modifies when writing to LAS WT-4685 Add new statistics for relevant history in cache WT-4868 Aggregate btree write gen from leaf pages in salvage WT-4954 Document duplicate backup cursors WT-5001 Migrate Jenkins “wiredtiger-test-format-stress-sanitizer-ppc” job to Evergreen WT-5045 Add more statistics tracking where checkpoint spends time WT-5052 Enhance lookaside search functionality to handle WT_MODIFY records WT-5058 Stop initializing a page with updates from lookaside WT-5066 Extend test_las06 to support column store. WT-5072 Modify __wt_rec_upd_select() to pull an update from lookaside WT-5073 Review update chain traversals WT-5089 test_las02.py fails: Unable to locate the correct record WT-5092 Modify lookaside schema to add timestamp and transaction id to the key WT-5098 Modify __wt_update_alloc() to accept NULL WT_ITEM values WT-5141 Handle multiple modifies for the same key on lookaside eviction WT-5146 Returning wrong record value for variable length columnar table WT-5158 Remove assertion in __wt_find_lookaside_upd for cursor comparison WT-5167 Fixing the missing pieces of page instantiation from las WT-5186 Handle reading of LAS modifies on top of a birthmark record WT-5191 Avoid LAS sweep server remove records that don't have disk image with proper version WT-5203 lookaside history should no longer be preferentially evicted WT-5212 Backup data validation tests WT-5214 Verify potential incremental failures WT-5215 Stress testing of incremental backup WT-5222 Make checkpoint always choose skew newest WT-5225 Create persistent file for History store WT-5227 Enable python test cursor04 on relevant history feature branch WT-5228 Several tests fail with incorrect or missing record after reconciliation changes WT-5233 Prepared update not visible in las06 WT-5236 Enhance workgen to support draft lookaside stress workload WT-5246 Update WiredTiger backup documentation WT-5253 Add History store file to checkpoint target list. WT-5254 Add aggregate timestamp info to the WT_REF. WT-5256 Fix relevant history build after develop merged brought LIMBO reference WT-5264 Add a delete record for every insert record into the WT history store to represent stop time pair WT-5267 Enable storing start/stop time pair for each record in the history store WT-5271 Remove WT_PAGE_LOOKASIDE structure. WT-5279 Disable failing tests in the preferred way WT-5280 Write all other versions to history store during checkpoint. WT-5281 Assert that we're no longer writing tombstones to the history store WT-5283 Eviction to create disk image with newest committed version. WT-5284 Test to check eviction is writing the newest version to data store WT-5286 Enable the data format to store time pair WT-5289 Remove the code that does garbage collection from sweep server WT-5290 Add new verbose flag and verbose logs for checkpoint garbage collection WT-5291 Additional statistics for checkpoint garbage collection WT-5292 Test the garbage collection by checkpoint WT-5295 Disable remaining failing tests in durable history branch WT-5298 Add a condition to verify the timestamp of a page during checkpoint of history store WT-5300 Traverse the history store internal page for obsolete child pages by checkpoint WT-5302 Begin writing validity window for new data format WT-5303 Update checkpoint statistics for the new history store file. WT-5308 Remove WT --enable-page-version-ts build configuration option WT-5317 Eviction writes uncommitted metadata changes to disk WT-5320 Save update restore to reuse lookaside eviction. WT-5321 Update the stats and counters that represent lookaside inserts according to durable history WT-5328 Evict obsolete history store page WT-5333 Fix search not found issue due to skipped birthmark and rework txn_read WT-5335 Read the start and stop time pairs back from cell when we reconstruct it on update chain WT-5341 Clang sanitiser was triggered by checkpoint writing to the history store change WT-5343 Show history store in the wt list WT-5345 Show aggregated timestamp information for internal pages and leaf pages WT-5347 Add ability for wt util to print historical versions of a key WT-5353 Verify data continuity between history and data store WT-5354 Verify history store key is not missing from the data store WT-5355 Add the ability to dump a given btree as of a timestamp WT-5361 Fix selecting aborted txn to write to disk WT-5369 Don't use transaction ids from a page with a previous startup generation WT-5385 Use WT_UPDATE_HISTORY_STORE to avoid repeatedly inserting updates to lookaside WT-5386 Re-enable test_inmem01 WT-5388 Fix write squash statistic caused by change in reverse delta WT-5392 Fall out of in-memory obsolete history page eviction WT-5414 Change the usage from durable timestamp to commit timestamp during eviction. WT-5416 Make sure that rollback to stable works on all objects in WT WT-5417 Skip the clean pages of each tree with aggregated stop timestamp is less than stable timestamp WT-5419 Create a TOMBSTONE update to represent the on-disk value state WT-5420 Reconcile should consider TOMBSTONE update to replace or remove the on-disk value WT-5421 Search the history store to find the value that can be replaced the on-disk value WT-5422 Remove the history updates for reconciled data pages WT-5423 Convert a history store modified value into a full update WT-5424 Add statistics for rollback to stable operations WT-5425 Add a new verbose flag to print the rollback to stable operation WT-5426 Ensure rollback to stable is executed from recovery WT-5427 Implement tests for rollback to stable WT-5431 Merge develop branch to durable history branch WT-5434 Remove develop-timestamp and add test for 4.0 and 4.2 pair to compatibility_test_for_mongodb_releases.sh after merge durable history to develop WT-5441 Fix known visibility issues WT-5446 Fix not writing to lookaside WT-5448 Reconciliation wrongly overwrites the cell with default time pairs WT-5451 Update reverse modify logic to always insert a modify into the history store WT-5453 Fix cell packing for globally visible values. WT-5454 Rename cache_overflow configuration option. WT-5455 Fix test_hs03.py WT-5457 single block reconciliation with saved updates can leak blocks WT-5461 Search should not return onpage value if nothing is found by transaction read WT-5462 Rebalance the Evergreen Python test buckets WT-5464 Open reading history cursors on the user session WT-5467 Make history store cursor part of each session, get rid of the cursor pool WT-5469 Support mixing timestamped and non-timestamped updates WT-5476 Continue writing tombstones when the tombstone is globally visable. WT-5478 Insert records directly into history store without a txn WT-5482 Increment cache usage when appending on-disk value to update list WT-5484 Check visibility before saving updates for in memory reconciliation WT-5489 page-read can race with threads locking in-memory page structures WT-5491 Add an option to wt verify to confirm that no data exists after the stable timestamp WT-5493 Re-enabling test_bug008 WT-5495 WT-5495 For column store, check the on-page value and history store even if the key is in the insert list WT-5496 upd should be reset to NULL if all upd on the chain are not visible in txn read WT-5500 Implement new history store format WT-5501 Do not use default session to create a history store cursor when configuring WT-5502 Re-add changes reverted by merge commit WT-5503 We can only free updates inserted into history store after a full update. WT-5508 Some of the txnids not cleared after restart WT-5509 Infinite loop when reading from history store at early specific timestamp in test_util01 WT-5510 Fix test_hs01.py, test_hs06.py (test_hs_prepare_reads) WT-5513 Don't consider TOMBSTONE/Stop time pair for history store reads WT-5515 Enable test_hs06 WT-5516 Backup starts with base_write_gen 1 WT-5518 Split-parent code can race with other threads when checking the WT_REF.state WT-5519 Apply version from datastore after finding a modify when possible. WT-5522 Remove update free logic in hs_insert_updates. WT-5523 Inserting history store needs to handle modify based on a tombstone WT-5525 Free up 3B in the WT_REF structure WT-5529 Improve usage of upd in txn.i WT-5540 Call cursor disable bulk insert on first insert to history store. WT-5541 Use snapshot isolation whenever we use history store cursors in verification WT-5542 History store not using the on disk value as the base value for modify when key boundary crossed WT-5547 Disable all the skipped rollback to stable tests for column store types WT-5549 Fix the recovery rollback to stable and enable the passing tests for both row and variable columnar types WT-5551 Fix the history store insert statistics WT-5552 Checkpoint reconciliation and page splits free the WT_REF.addr field without locking WT-5555 Update base write gen to the maximum write gen we have seen in recover WT-5556 Verify of a file should verify its history store content too WT-5558 Use durable timestamp from the update instead of start WT-5563 Transactions ID are getting wiped which causes errors in WT Verify WT-5565 Core dump is generated when running test_random_abort or test_random_direcio run on durable history branch WT-5566 Update rollback to stable tests to use new statistics WT-5567 Fix an assert in txn_read always be true WT-5569 Update WiredTiger source code to include 2020 copyright notices for durable history WT-5570 Refactor the __upd_alloc_tombstone() according to the new use in durable history WT-5574 Rolling back a prepared transaction with `cursor_copy` results in a use-after-free WT-5575 Fix the test_durable_ts01 test to expect older data after recovery WT-5576 Temporarily add lookaside score stat and cache_overflow config option WT-5579 Fix Evergreen memory sanitizer test failure WT-5581 Address sanitizer test failure running bloom filter testing WT-5582 Long unit testing sweeping cursors failing WT-5583 Applying operations in recovery encounters unexpected operation type WT-5587 Limit how many checkpoints are dropped by a subsequent checkpoint WT-5589 force_stop on duplicate cursor open not returning error WT-5590 Fix spellings so s_string passes WT-5593 test/format assertion failure addr->size != 0 WT-5595 test/format data mismatch errors WT-5596 Increase format stress testing scope. WT-5597 Fix the history store file access during recovery WT-5598 __verify_timestamp_to_pretty_string uses local buffer which is freed before access WT-5602 Rollback transaction core dumped with upd->start_ts >= unpack->stop_ts WT-5603 test/format assertion failure while discarding in-memory page WT-5605 Update test checkpoint to no longer use checkpoint cursors WT-5607 Successful 'verify -h' calls are returning not found WT-5610 Fix assertion for reconciling fixed length column store WT-5611 Don't write updates with different commit and durable timestamps to data store WT-5612 Remove history store values for non-timestamp tables WT-5613 Remove birthmark update type WT-5615 Coverity: Read of uninitialised value WT-5618 Skip timestamp range overlap check if start timestamp is zero WT-5620 Skip the history store TOMBSTONE only for rollback to stable operation WT-5624 Incremental unit test should use offset/length ranges WT-5625 corruption detected during validation - root page's aggregated timestamp incorrect WT-5626 Remove assert which checks for newer updates in the history store WT-5628 rollback_to_stable failed with no such file WT-5631 Recovery rollback to stable for timestamped logged tables WT-5632 Don't write stop_ts of 1 for non-timestamped delete WT-5633 Fix another assertion for reconciling fixed length column store WT-5636 prefix compression is slow in the history-store access pattern WT-5638 Ignore checking visibility of history store updates as they are implicitly committed WT-5640 test_wt2323_join_visibility fail when processing consecutive tombstones in __wt_hs_insert_updates WT-5641 Clear history store content when deleting a key due to a globally visible tombstone WT-5644 Appending onpage value to an aborted update triggers an assert WT-5647 replace the WT_REF structure's WT_REF_READING state with a flag WT-5648 Add a leaf or internal page type flag to the WT_REF structure WT-5649 Refactor WT_REF locking, review all WT_REF.addr reads for locking issues WT-5650 Fix a race condition between reading the WT_PAGE.modify field and the page being dirtied. WT-5651 Fix the RTS assert to consider error scenarios of search WT-5654 Add version information to the history store key format WT-5658 Fix heap-use-after-free in parent split code WT-5665 Data mismatch bug when running new version of test_checkpoint with timestamps WT-5666 Deleting a chunk of the namespace changes the WT_REF type WT-5667 Remove usage of checkpoint cursor in test/format WT-5668 Prepare support with durable history: implement data format changes WT-5678 Fix infinite looping behaviour in history store cursor positioning WT-5680 segfault when dereferencing NULL addr while reconciling WT-5682 Ensure that we can't apply modifies on top of tombstones WT-5684 overflow values must be discarded when there is no update for a key WT-5685 Set aspell dictionary to en_US WT-5688 Memory leak detected during page overflow read WT-5689 reduce work required for the cursor-pinned test. WT-5690 Rollback to stable assertion failure regarding update visibility WT-5692 Revert a test change to fix a Python hang WT-5695 Fixed incremental backup example to use O_CREAT in the backup range case WT-5696 test_timestamp_abort fails with data mismatch WT-5698 Disabling bulk cursor changes broke a Jenkins compile WT-5699 Refactor incremental backup RANGE code WT-5700 Add smoke test script for incremental backup stress test WT-5701 If an out-of-order update masks an on-disk value, don't append it WT-5704 Incremental backup smoke test core dumped WT-5706 Fix csuite-incr-backup-test calculation of value sizes WT-5707 Reduce the test load for checkpoint stress test WT-5712 Ensure WT command line utility treats history store consistently WT-5713 Fix failures so test_durable_rollback_stable.py can be enabled WT-5719 Incremental backup metadata should quote the ID string WT-5722 Incremental backup should do a name check on identifiers WT-5745 Don't copy a value into tombstones WT-5747 Cope with updates out of timestamp order WT-5753 Fix divide by zero error in test/csuite/test_incr_backup WT-5756 heap-use-after-free in __wt_row_modify WT-5762 Make test_hs10 more robust WT-5767 Fix search_near invocations for history store WT-5771 make-check-msan-test failed with use-of-uninitialized-value error on RHEL 8.0 WT-5774 Move stress test tasks into a separate build variant WT-5775 Fix leak of updates from history store WT-5777 Add statistic for tracking history store deletions due to key removal WT-5780 Fix timestamp_index_build.js in noPassthrough suite. WT-5781 Fix basic.js in parallel suite WT-5786 Detect if a file is too small to read a descriptor block WT-5792 Dump and verify can't see the history store WT-5795 Disable assertion that inserts to the history store are unique WT-5798 Check that the history store file exists before performing rollback to stable WT-5799 Dont assume we have ordered timestamps when doing rec append original value WT-5800 Temporarily disable history store verify WT-5806 Perform rollback to stable on a clean shutdown WT-5809 Invariant failure: stable timestamp does not equal appliedThrough timestamp WT-5820 Change format.sh to forcibly quit if a test runs out of disk space. WT-5822 Don't evict metadata updates from a running checkpoint WT-5827 Enable test_schema_abort WT-5830 Enable two c tests in evergreen
* Import wiredtiger: d74cb1a91399e1197a95667502002ffed2b7b82b from branch ↵Luke Chen2020-02-1228-28/+28
| | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 94c6c16014..d74cb1a913 for: 4.3.4 WT-5372 Skip known errors for long-running format stress sanitizer tasks WT-5383 Update WiredTiger source code to include 2020 copyright notices WT-5398 Adding more correctness tasks into rhel80 Evergreen build variant WT-5526 Remove visibility check in __wt_value_return_upd WT-5536 Add zstd as a builtin compressor for WiredTiger Python package WT-5538 Change format to ignore Evergreen timestamps in configuration files WT-5553 Return error if primary cursor is not an incremental source WT-5554 Account for logpath when retrieving file size in incremental backup WT-5557 Fix the wrong page type returned when checking on-page cell WT-5564 Buffer not extended properly when incremental bitstring grows
* Import wiredtiger: 168c7f1b3859516115721868f312544abb0caf5b from branch ↵Luke Chen2020-01-312-8/+6
| | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: d790f9057c..168c7f1b38 for: 4.3.4 WT-5159 Make wiredtiger work with SWIG 4.0.0 beyond WT-5219 Btree walk code read the lock WT_REF.addr field without locking WT-5376 WT_UPDATE.type field can race with visibility checks when returning key/value pairs WT-5387 Prepared transaction resolution can stall eviction on active pages WT-5393 Prepared transaction rollback and API error handling fixes WT-5405 Make format LSM test a separate Evergreen task WT-5437 Salvage's excessive consumption of cache memory causing eviction to stall WT-5444 Re-enable PPC format tests in Evergreen WT-5449 Increase contention in history store stress workload WT-5458 Fix Evergreen timeout failures in linux-directio test WT-5460 Buffer alignment failure captured by linux-directio test WT-5468 Improve documentation for "wt load" WT-5480 Don't take threads resolving prepared transactions to assist with eviction WT-5481 DIAGNOSTIC split code assert can race with WT_REF locking WT-5488 Dump the failing CONFIG for Evergreen test/format tasks
* Import wiredtiger: 5bd9fdfc0bb7f8fcf791e234b6e436c79dfe1fee from branch ↵Luke Chen2020-01-071-0/+168
| | | | | | | | | | | | | | mongodb-4.4 ref: 61bf0547c6..5bd9fdfc0b for: 4.3.3 WT-4968 Remove all_committed timestamp WT-4978 Migrate Jenkins “wiredtiger-pull-request-compilers” job to Evergreen WT-5192 Don't allow checkpoints to evict without a snapshot WT-5235 Craft a workload to show lookaside contention WT-5377 variable-length column store insert locking in format test program can stall eviction WT-5389 Add timestamps to format.sh test runs
* Import wiredtiger: 7dfd9391862bc9a6d84868c4dc51689c45a3aacf from branch ↵Luke Chen2019-08-212-41/+31
| | | | | | | | | | | mongodb-4.4 ref: c809757d8b..7dfd939186 for: 4.3.1 WT-4658 Apply Clang Format WT-4810 Adding WT_ERR_ASSERT and WT_RET_ASSERT macros WT-5046 Prepared transactions aren't properly cleared from global table with WT_CONN_LOG_DEBUG_MODE enabled
* Import wiredtiger: d9ec69f9111b036ee0b19b47368e15bff8d4818d from branch ↵Luke Chen2019-05-0712-21/+35
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.2 ref: 617a81369c..d9ec69f911 for: 4.1.11 WT-4278 Clarify in docs that schema operations are not transactional WT-4309 Increase the maximum expected LAS test reads WT-4352 Resolve birthmarks during eviction in more cases WT-4582 Respect prepared updates in lookaside WT-4642 Store transaction IDs durably WT-4670 Remove support for WiredTiger LevelDB APIs WT-4688 Fix test and docs for correct log cursor usage WT-4690 Make sure eviction does not split during checkpoints WT-4697 Python3: change workgen to work with Python3 WT-4706 Add a statistic to track the lookaside table size WT-4723 Restructure the reconciliation code WT-4725 Python3: change miscellaneous scripts to run under Python3 WT-4726 Python3: set up pull request tester to run with Python3 WT-4728 Remove the stop timestamp from the WT_UPDATE structure WT-4738 Tighten rules around use of timestamps WT-4745 Update upgrading documentation before 3.2.0 WiredTiger release WT-4746 Document that transactions without timestamps clear history WT-4749 Fix error message formatting (possible SEGV) for prepare_transaction WT-4751 Change __wt_timestamp_to_string() to return a pointer to simplify verbose WT-4752 WiredTiger autoconfig check for the compiler incorrectly quoted WT-4753 Strip the timing_stress configuration options from the base configuration WT-4754 Change the checkpoint code to not require a list order WT-4755 Switch to a better timestamp and transaction ID ordering convention WT-4756 Fix comment in python integer encoder WT-4759 Save a copy when an old overflow value is discarded WT-4764 Avoid choosing a transaction frequency of 0 in test/format
* Import wiredtiger: 617a81369c810c0b99493a09d3fce862f4d0cdec from branch ↵Luke Chen2019-04-261-2/+2
| | | | | | | | | | | | | | | mongodb-4.2 ref: 9416282c42..617a81369c for: 4.1.11 WT-4450 Add testing around timestamping updates in the future WT-4575 Use wt_err instead of wt_errx for corruption messages WT-4647 Avoid splitting words when wrapping lines in wiredtiger.in WT-4717 Remove usages of "round_to_oldest" configuration WT-4720 Coverity complaint #111697: handle tiny sizes in block manager reads WT-4721 Add verbose output for failures in the wt2853_perf test WT-4731 Add new retries to the checkpoint integrity test
* Import wiredtiger: afdead1093b5c5b41dd54ddddf6f42d92bef1666 from branch ↵Luke Chen2019-03-0511-24/+454
| | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.2 ref: 37e1570f82..afdead1093 for: 4.1.9 WT-4413 Add optional compact progress messages WT-4465 Add documentation for a dhandle's lifecycle WT-4514 Implement assert=durable_timestamp WT-4517 Change WT data format to avoid writing stable timestamps WT-4537 Fix WiredTiger cursor prev/next traversal failure on prepare retry WT-4554 Enhance WT salvage to handle the case of corrupted WiredTiger.turtle WT-4556 workgen: add synchronization points during run time WT-4558 WiredTiger connection statistics cursor incorrectly provides doubled-up values WT-4568 Operation tracking visualization incorrectly displays call stacks WT-4573 Reducing calls to __wt_epoch from session reset WT-4587 Parallelize the script that parses operation tracking files WT-4595 Coverity "null pointer dereference" complaints WT-4596 Simplify wt utility's session/connection handling WT-4599 Show latency threshold violations in operation visualizations WT-4605 workgen: read_write_storms.py needs a public domain notice WT-4606 workgen: remove lsm from the default table type in wtperf emulation WT-4613 Skip the wt4333_handle_locks test on OS X WT-4615 Sync backup file before returning backup cursor WT-4617 Cursor next/prev returns PREPARE_CONFLICT only once
* Import wiredtiger: 0c6ba8d8be02dd34a46c3e9533971f1739b6ad8e from branch ↵Luke Chen2019-02-144-21/+184
| | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.2 ref: 92719d6bc9..0c6ba8d8be for: 4.1.9 WT-4053 Add statistic for data handle size WT-4296 Add aggressive mode to sweep server WT-4313 Update query_timestamp documentation for last_checkpoint and recovery timestamp WT-4369 random_directio shouldn't assume children threads wrote any data WT-4433 Enable dynamic compression for snappy WT-4447 Add prototype implementation allowing limiting of IO per subsystem WT-4484 workgen: wtperf.py should store python intermediate files in home directory WT-4489 Store correct timestamp in cells on disk WT-4492 Automate testing of versioned data format WT-4501 Fix a race condition opening/closing the shared cache WT-4533 Upgrade to v3 toolchain for Evergreen tests WT-4546 Add workgen improvements and test files to simulate read and write "storms" WT-4547 Consolidate capacity and block manager bytes written WT-4557 Remove error_prefix from base configuration file, set error_prefix in wt command WT-4559 Create a marker file when a test leaves a database corrupted WT-4561 WiredTiger LSM chunk drop can race with hot backups WT-4562 Coverity: possible divide by zero conn_capacity:434 WT-4569 WT_CONN_DATA_CORRUPTION incorrectly set in Btree verify code. WT-4576 Coverity warning in conn_capacity.c
* Import wiredtiger: fa402fef1974b30ef61770caff58b0eabda97781 from branch ↵Luke Chen2019-01-1024-24/+24
| | | | | | | | | | | | | mongodb-4.2 ref: 86012f8e40..fa402fef19 for: 4.1.7 WT-4444 Extend cursor operation tracking statistics WT-4483 Improve caching of small updates to large values WT-4505 Add ability to manage when prepared transactions appear in checkpoints WT-4518 Give applications a chance to handle panic before API panic returns WT-4522 Update WiredTiger copyrights to 2019
* Import wiredtiger: fcb59a43a44222716ddae6d94d45cdfd36b915f7 from branch ↵Luke Chen2018-12-051-4/+5
| | | | | | | | | | | | | | | | | | | | | | mongodb-4.2 ref: 74aa2f92a9..fcb59a43a4 for: 4.1.7 WT-4192 Remove WiredTiger raw compression support WT-4319 Improvements to csuite tests WT-4331 Further extend max wait time for test_bug019.py WT-4393 Document cursor behaviour for read committed isolation WT-4410 Split 'unit-test' task to reduce Evergreen Ubuntu build variant runtime WT-4417 Make os_cache_max and os_cache_dirty_max reconfigurable WT-4421 Add a way to calculate modify operations WT-4434 Modify zstd compression level from 3 to 6 WT-4442 Add the ability to duplicate a backup cursor WT-4455 test_wt4156_metadata_salvage with HAVE_ATTACH fails on zSeries WT-4457 Add a maximum of dirty system buffers for the logging subsystem WT-4463 Reduce runtime for csuite handle locks testing WT-4464 In debug output row-store internal page keys may not format correctly WT-4469 Coverity #105148: redundant test
* Import wiredtiger: a065c83d8dd73d1c0199f742d6ee15d73c7e1394 from branch ↵Luke Chen2018-11-214-26/+333
| | | | | | | | | | | | | mongodb-4.2 ref: fe4a3f763b..a065c83d8d for: 4.1.6 WT-4372 For throughput testing, create a standard metric to measure latency smoothness WT-4378 Create new auto functions and cursor for session level statistics WT-4403 Add statistic tracking accumulated dirty cache WT-4405 Fix cursor next and prev for prepared transactions WT-4409 Fix workgen throttling
* Import wiredtiger: 849c21c26c879bb1195f211b63bdea74868094ea from branch ↵Luke Chen2018-11-131-4/+6
| | | | | | | | | | | | | | | | mongodb-4.2 ref: e8cf194d81..849c21c26c for: 4.1.6 WT-4043 Take locks while dumping the cache to avoid crashes WT-4399 Fix compression for workgen's wtperf emulation WT-4401 workgen: wtperf emulation: sample_interval broken with integer values WT-4402 Add rollback support and monitor JSON output in wtperf WT-4411 Added connection statistic for current total of cached cursors WT-4412 wtperf coverity fixes WT-4418 Don't keep key/value memory buffers allocated for cached cursors WT-4422 Don't queue clean pages for urgent eviction
* Import wiredtiger: e8cf194d813096cc2b30c0dd2d9d9c93ade79756 from branch ↵Luke Chen2018-11-024-75/+200
| | | | | | | | | | | | | | | | | mongodb-4.2 ref: 22b1224ee0..e8cf194d81 for: 4.1.5 WT-4298 Fix workgen to retry on WT_ROLLBACK and clear ops after warmup WT-4343 Unlock when sleeping to allow other log threads to make progress WT-4371 Workgen improvements to create a MongoDB-like workload WT-4376 Fix a bug where table index open can race WT-4385 Prepare-conflict during a cursor scan can return the wrong key WT-4392 A large lint change WT-4395 Seg fault walking corrupted log with log cursor WT-4396 When retrying after prepare-conflict, cursor unable to find a valid update WT-4400 Fix workgen use of PRIxxx macros, needed for old C++ compilers
* Import wiredtiger: 22b1224ee0623db1ed03f6bf5dd681deb1aa8b2e from branch ↵Luke Chen2018-10-291-1/+2
| | | | | | | | | | | mongodb-4.2 ref: 0b8896b434..22b1224ee0 for: 4.1.5 WT-3898 Keep prepared updates in lookaside until they are read WT-4387 Fix ordering of referenced shared libraries in workgen WT-4389 Update wtperf runner script to accept multiple arguments
* Import wiredtiger: d235e0e71ef84c3f9d5a870f08feeff9a7c5581e from branch ↵Luke Chen2018-10-094-151/+380
| | | | | | | | | | | | | | mongodb-4.2 ref: e7d742daa2..d235e0e71e for: 4.1.4 WT-4214 Simplify timestamp handling for timestamp abort test WT-4220 Enable long running prepared support WT-4293 WT_CURSOR.remove can lose a cursor position WT-4297 Enhance steady throughput workload WT-4346 Remove prepared updates from lookaside on reading the page. WT-4351 Ensure resolving prepared transactions use updates from itself
* Import wiredtiger: 63b8cf2e0b786296f5b99c363e604a3348299c06 from branch ↵Luke Chen2018-08-271-0/+83
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.2 ref: c91b804126..63b8cf2e0b for: 4.1.3 WT-3735 Add a workgen workload that generates a lot of page splits WT-3894 Timestamp queue implementation and statistics improvements WT-4104 Fix test/format failure during comparing data content with berkeley db. WT-4144 Fix rollback_to_stable with lookaside history WT-4176 Expose a WT_SESSION.query_timestamp method WT-4211 Add automated test for long running prepared transactions WT-4212 Update lookaside schema to handle prepared transactions WT-4216 Use separate counters for page_swap yield and sleep WT-4233 Change log corruption errors to warnings and truncate log WT-4239 Don't allow checkpoints to perform insert-splits in the tree WT-4241 GNU-stack section should never be conditionally compiled out WT-4248 Fix checkpoints in schema_abort for slow machines WT-4249 Attempt to discard dirty page during verify operation. WT-4251 Prepared updates cannot be discarded WT-4252 Btree debug functions can leak scratch buffers on error. WT-4253 Btree debug function to do blind reads doesn't handle row-store internal pages WT-4256 Loosen check during rollback_to_stable WT-4257 Don't assume timestamps from lookaside are aligned in memory WT-4262 Lock deleted children in eviction of internal pages WT-4263 Use the right tree when copying a key for a lookaside write WT-4264 Compaction can race with page modifications
* Import wiredtiger: c91b80412603f283532e267893f9238dd4a5ec0f from branch ↵Luke Chen2018-08-131-4/+3
| | | | | | | | | | | | | | | | | | | mongodb-4.2 ref: 65531924e3..c91b804126 for: 4.1.2 WT-3856 Create a test that runs recovery to different points of time with schema operations WT-4026 Add implementation for existing file extension configuration API WT-4193 test/format snapshot-isolation search mismatch WT-4194 Improve fairness of eviction with multiple tables WT-4207 Coverity #1394567: null pointer dereference WT-4210 schema abort child process failing prematurely WT-4215 Allow recovery of backup without salvage WT-4229 Lint WT-4234 Remove documentation mention of legacy tool statlog.py WT-4235 Fix workgen tracking of table state across workloads WT-4242 New log file extension Python test failure
* Import wiredtiger: 65531924e397aeb55f6835b73e4c199ea378ec97 from branch ↵Luke Chen2018-08-065-39/+262
| | | | | | | | | | | | | | | | mongodb-4.2 ref: 376f355fb0..65531924e3 for: 4.1.2 WT-3968 Use compression ratio to tune page sizes WT-4010 Simplify test/format timestamp handling. WT-4134 Rework assertion that we don't discard required history WT-4201 Fix Coverity static analysis issues WT-4206 Fix error handling in cursor close routines WT-4208 tree walks can be interrupted by locked internal pages WT-4213 Rename lock statistics that have redundant or misleading text WT-4226 test/format LSM configurations can misconfigure prepare and timestamps
* Import wiredtiger: 9e5044823185feffa71e56a6593cfb92e0741a41 from branch ↵Luke Chen2018-01-0520-20/+20
| | | | | | | | | | | | | | | | | | | | | | | | mongodb-3.8 ref: 1a29eac4dc..9e50448231 for: 3.7.1 WT-2705 High throughput cache bound many threaded workloads can experience long latencies WT-3725 Add statistics to locks around timestamp structures WT-3750 Fast-path fs_directory_list of a single file. WT-3768 Lookaside optimization: birthmarks WT-3769 Fix a bug in reverse cursor walks with particular delete patterns and prefix compression enabled WT-3779 Add support for string formats with WT_CURSOR::modify WT-3800 test_wt2834_join_bloom_fix hang WT-3806 Make sure rdtsc values move forward in time WT-3807 clang static analysis updates WT-3810 wt_rdtsc calibration needs to be longer and verify validity WT-3812 debugging page output should handle complex key/value items. WT-3816 Enable prefix compression on the lookaside table WT-3819 clang static analysis improvements WT-3820 Add a WT_SESSION.breakpoint method for Python debugging. WT-3822 Update WiredTiger copyrights to 2018 WT-3824 tsc_nsec_ratio can compute to zero and cause divide by zero bug
* Import wiredtiger: 0cd3d5bbd8a5c8779f1129c6754b4463403e788f from branch ↵Alex Gorrod2017-10-106-158/+646
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-3.6 ref: 6f561957cb..0cd3d5bbd8 for: 3.5.14 WT-3200 LSM bug: Failed lookup in bloom filter. WT-3435 Lookaside eviction should be able to save unstable updates WT-3453 Enhance lookaside table test coverage in Python suite WT-3559 Detect when a checkpoint races with metadata changes WT-3579 Enhance support for running wtperf workloads with workgen WT-3582 Cache stuck full of internal pages WT-3593 Add an API to enforce consistent use of timestamps (#3667) WT-3599 reconciliation calculates block matching checksums too frequently. WT-3600 timestamp API lets you set timestamps with invalid characters WT-3612 Improve documentation of durability with backup cursors WT-3613 test/format cache full with LSM WT-3618 WT remove solaris from evergreen builds WT-3620 POSIX thread attribute structures must be destroyed WT-3621 Add test for full backups with concurrent table creation WT-3622 Allow upper case hexadecimal timestamps WT-3627 test_txn14.test_txn14.test_log_flush timeout WT-3631 Convert timestamps to integers in Python tests before comparing WT-3636 Account for page image sizes in cache consistently WT-3638 format failure, update list without complete visible record WT-3639 Test/format tried to drop named checkpoints during a hot backup WT-3641 Track maximum timestamp used in each btree WT-3642 Avoid lookaside reads for dead trees
* Import wiredtiger: 698847557ce7b3a938bbc8334d64a9430e4dc786 from branch ↵Alex Gorrod2017-08-091-0/+127
| | | | | | | | | | | | | | | | | | | | | | | | mongodb-3.6 ref: 2e9744d11a..698847557c for: 3.5.12 WT-3336 Review all jenkins jobs and ensure that they run with stats enabled and stat files are archived WT-3378 Create a workload where dirty cache usage is similar to eviction_checkpoint_target WT-3388 Online rollbackToStableTimestamp WT-3456 Investigate the impact of statistics logging when statistics are disabled WT-3458 Checkpoint should ignore stable_timestamp for logged tables WT-3470 Avoid a metadata cursor open for table open/drop WT-3471 Clear out each session's table cache WT-3472 WT_CURSOR.modify has incorrect API wrapping macros WT-3478 Coverity CID 1378760: Insecure data handling (TAINTED_SCALAR) WT-3479 resolving modify updates before writing them to the lookaside file causes snapshot isolation failures. WT-3480 WiredTiger connection close can hang joining async threads WT-3481 lsm merge span fails to collect chunks to span WT-3486 Discard obsolete updates as part of re-instantiating updates based on the lookaside table. WT-3489 Provide an API to reset the commit_timestamp during rollback WT-3490 WT_CURSOR.modify unaligned size_t access. WT-3494 __cursor_needvalue() calls __cursor_localkey(), not __cursor_localvalue()
* Import wiredtiger: 2e9744d11a65c63ba7445060dc78371250f04051 from branch ↵Alex Gorrod2017-08-011-2/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-3.6 ref: 6173a98979..2e9744d11a for: 3.5.11 WT-2309 Add yields and/or sleeps in #DIAGNOSTIC mode WT-3047 Add mode aimed at uncovering race conditions in split code WT-3308 Add statistics tracking around yield loops WT-3316 Add new engineering section to reference guide documentation WT-3338 Optimize cursor modify WT-3380 Special case 8-byte timestamps WT-3387 Add support for a stable timestamp WT-3389 Restructure split code to hold a split generation for the entire operation. WT-3406 Reconciliation is choosing reserved records for writing. WT-3410 Add developer documentation for table rename WT-3412 Add backoff logic to the btree delete and walk yield loops WT-3418 block manager object race WT-3422 WiredTiger upgrading documents out of date WT-3432 workgen needs braces around an "if" body WT-3433 session->alter method should not be supported in read-only mode WT-3439 lint/cleanup WT-3440 Add a log record when starting a checkpoint WT-3442 Coverity 1378213: false positive on diagnostic assignment. WT-3446 Temporarily disable timestamp testing in test/checkpoint WT-3447 test_stat_log02 can assert before table stats are printed WT-3461 Avoid long sleeps when the system clock is adjusted WT-3463 Add recovery of backup to test_timestamp03.py WT-3466 Track the first commit timestamp for each transaction WT-3467 Minor lint/cleanup
* Import wiredtiger: 6173a98979715ed727c432c1a31da64ea8a37048 from branch ↵Alex Gorrod2017-07-205-22/+111
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-3.6 ref: ff10db8811..6173a98979 for: 3.5.11 WT-3039 Enhance logging so new log files no longer need to wait for the previous log file to be synced WT-3138 Enhance eviction statistics WT-3140 Enhance json mode statistics to better support per-dhandle statistics WT-3310 Add support to WT_SESSION::alter to change table log setting WT-3329 With a uniform workload and a number of small collections, eviction does a poor job of selecting candidates for eviction. WT-3381 Improve concurrency in the transaction subsystem WT-3394 Build WiredTiger with gcc7 WT-3396 test/csuite/wt3363_checkpoint_op_races, test_utility cleanups WT-3397 Coverity lint WT-3398 in-memory configurations don't support schema_worker operations WT-3401 Lint and minor cleanup WT-3402 Move cached overflow records to the update list. WT-3403 Automated tests timeout running csuite WT-3409 WiredTiger generations can silently self-deadlock. WT-3413 Add more aggressive compile warning flags to Jenkins Windows job WT-3415 setting timestamp in txn_state requires the global write lock WT-3421 Compilation error unreachable code in test/csuite/wt3363_checkpoint_op_races WT-3424 additional gcc 7.1 compile warnings. WT-3425 workgen: add ability to reopen cursors WT-3426 Add new wtperf configuration to automated performance testing WT-3438 Don't tune eviction thread count when the count is fixed Also explicitly disable v2 log records via a configuration setting in MongoDB - this will later be plumbed into the feature compatability version mechanism.
* Import wiredtiger: 47e8c3d1d22018eaaa09f91dfd78addb49e0b49b from branch ↵Alex Gorrod2017-06-149-7/+685
| | | | | | | | | | | | | | | | | mongodb-3.6 ref: 7aaeaaa054..47e8c3d1d2 for: 3.5.9 WT-2596 Document behavior after a crash with a backup cursor open WT-3169 Add ability to log a message when the lookaside file is used WT-3326 workgen: run wtperf "runner" files WT-3332 Add statistic tracking connection wide transaction conflicts WT-3346 workgen: create JSON output for latency sampling WT-3349 Add timing stats to rwlocks WT-3361 Resolve Windows build warnings, build more test programs on Windows. WT-3362 Cursor opens should never block for the duration of a checkpoint WT-3369 WT_CURSOR->uri should always match the URI used to open the cursor
* Import wiredtiger: 7aaeaaa054d1ac27a95c79984f7ca69ba739caae from branch ↵Alex Gorrod2017-06-0718-0/+3667
mongodb-3.6 ref: 78109ca3fe..7aaeaaa054 for: 3.5.9 SERVER-28820 Recovery failed: WT_NOTFOUND: item not found SERVER-28835 Fix a memory leak in WiredTiger on error when creating thread group WT-2972 Add interface allowing partial updates to existing values WT-3041 Failure of test_perf01 on PPC WT-3063 Reserve records for read-modify-write WT-3076 Add a general-purpose epoch manager WT-3123 Thread group holding lock across thread join WT-3142 Add a workload generator application WT-3158 Fix structure layout on Windows. WT-3160 Improve eviction of internal pages from idle trees WT-3197 aarch64 CRC32C support fails to compile on non-linux ARM platforms WT-3219 Make the clang-analyzer job fail when lint is introduced WT-3222 Review and enhance log statistics WT-3245 Avoid hangs on shutdown when a utility thread encounters an error WT-3247 Test should exit instead of abort to avoid a core dump WT-3248 Performance degradation in workload with large overflow items WT-3253 txn07 test problem WT-3258 Improve visibility into thread wait time due to pages exceeding memory_page_max WT-3261 add a checkpoint epoch to avoid draining the eviction queue WT-3262 Schema operations shouldn't wait for cache WT-3263 Allow archive on restart/recovery if clean shutdown WT-3264 Permanent change to disable logging should eventually remove all logs WT-3265 Verify hits assertion in eviction when transiting handle to exclusive mode WT-3266 Thread group deadlock WT-3267 Upgrade copyright notices from 2016 to 2017. WT-3268 Failure to close cursor can get wiredtiger stuck in a cursor-close loop WT-3269 Miscellaneous cleanup changes WT-3271 Eviction tuning stuck in a loop WT-3275 stress test sanitizer failure WT-3278 log the row-store cursor key instead of page key WT-3281 stress test sanitizer failure WT-3282 Stuck in conn cache pool destroy join WT-3284 tree-walk restart bug WT-3287 review WiredTiger internal panic checks WT-3288 fix error codes for event_handler to be consistent in file operations WT-3292 review/cleanup full-barrier calls in WiredTiger WT-3293 Make internal symbols externally visible WT-3296 LAS table fixes/improvements WT-3297 support the gcc/clang -fvisibility=hidden flag WT-3300 Coverity 1374542: Dereference after null check WT-3302 Failure to create cache pool manager thread results in crash when destroying cache pool WT-3303 Deadlock during first access to lookaside table WT-3307 FI testing: segfault in python test test_bug013 when fault introduced reading turtle file WT-3312 encryption btree configuration test WT-3313 Replace calls to the deprecated LZ4_compress function WT-3314 clarify error handling WT-3327 Checkpoints can hang if time runs backward WT-3331 Test format aborted due to time rollback WT-3333 Make it possible to store 0 bytes into a 'u' format via Python WT-3334 static test suite's BaseDataSet class has 'u' value format bugs WT-3339 The CURSOR_UPDATE_API_CALL macro will dump core on a NULL btree handle WT-3342 Create a new WiredTiger 2.9.2 release WT-3343 WiredTiger database close can attempt unlock of a lock that's not held. WT-3345 Improve rwlock scaling WT-3348 Lint, Windows warnings. WT-3351 Recovery assertion failure: old_lognum < lognum WT-3354 Coverity issues 1375904-1375907 WT-3356 rwlock assertion failure on PPC