summaryrefslogtreecommitdiff
path: root/src/third_party
Commit message (Collapse)AuthorAgeFilesLines
* Import wiredtiger: 404b4a70af14e7d3aecf7f206380884af5d06786 from branch ↵r4.4.0-rc5Luke Chen2020-05-0819-86/+241
| | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 18dfb9e58e..404b4a70af for: 4.4.0-rc5 WT-6093 Fix and reenable test_random_abort in recovery-stress-test WT-6097 Let the Python test suite runner allocate tests to buckets for evergreen WT-6128 Reduce the data size in test_checkpoint04 so it completes quickly WT-6131 Add a test to verify checkpointing truncation in durable history WT-6137 Fix calculation of bits versus bytes for incremental bitmap WT-6138 Turn off non-timestamp testing in schema_abort WT-6141 Disable checkpoint deletion during backup WT-6142 Fix the assert with no more than one aborted update in chain WT-6144 Avoid configures verify_metadata in test/format when running on historic builds WT-6152 Fix accessing checkpoint durable timestamp including older version WT-6156 Enable format to select "backup.incremental=log"
* Import wiredtiger: 18dfb9e58e39927696affcd8e362364e23e1aa59 from branch ↵r4.4.0-rc4Luke Chen2020-05-06138-2925/+3280
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: a707df12a2..18dfb9e58e for: 4.4.0-rc4 WT-5242 Minimize checkpoints pinned during backup WT-5470 Reduce copies and allocations in read path WT-5673 Prepare support with durable history: modify verify and salvage as needed WT-5677 Prepare support with durable history: add test/format stress tests WT-5710 Review WT_PANIC usage WT-5716 Create the history store file at the same time as creating the metadata file in wiredtiger open WT-5839 Ignore non-globally visible tombstones for both data store and hs store in hs verification WT-5841 Return WT_TRY_SALVAGE when the history file is removed or truncated WT-5928 Cleanup stale FIXMEs from durable history WT-5977 WT_SESSION_NO_RECONCILE flag set by history cursor prevents eviction WT-5984 Allow prepared updates to be evicted in durable history WT-6009 Prepare support with durable history: add statistic for prepared updates evicted WT-6032 Turn on mongodb-4.4 branch upgrade/downgrade testing WT-6051 Fix reconstructing full value from modifies for string format WT-6068 Re-enable tests temporarily disabled during durable history development WT-6069 Remove WT_UPDATE_RESTORED_FROM_DISK flag WT-6070 Coverity : Copy paste error WT-6071 Coverity : Change format specifier WT-6086 Move time windows and aggregated time windows into structures WT-6087 Add a C2S(cursor) macro to simplify translation from a cursor to a session WT-6095 Verify on-disk page only for row store as part of rollback to stable WT-6109 Cleanup usage of cursor->session WT-6110 Cleanup cast from cbt to cursor WT-6120 Remove use-after-free in __verify_history_store_id WT-6130 Disable test_random_abort
* SERVER-47735 change mongo source over to logv2Billy Donahue2020-05-032-12/+8
| | | | | | | | - Remove several legacy logger/ files - Convert all MONGO_LOG_DEFAULT_COMPONENT to the LOGV2 version. - Globally replace logger::{LogSeverity,LogComponent} => logv2:: (cherry picked from commit eae31861e0f813f0099e1d490c4a622d75cd5a08)
* Import wiredtiger: a707df12a2503ad39ccdd82a84062faa6a07e082 from branch ↵Luke Chen2020-04-30125-1224/+1574
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 7b994a862e..a707df12a2 for: 4.4.0-rc4 WT-3726 Add documentation specifying build pre-requisites WT-5260 Restore assert that trees being discarded are not marked dirty WT-5544 Fix cache stuck during salvage WT-5573 Re-enable unit test test_util01.test_dump_process_timestamp_old WT-5614 Coverity: Redundant NULL check WT-5623 Support reading modify type updates in the history store for non-timestamp tables WT-5661 Make WiredTiger utilities self documenting WT-5676 Prepare support with durable history: add workgen stress tests WT-5697 Dropping or renaming tables returns EBUSY in incremental backup test WT-5728 Coverity analysis defect 114081: PW.SET_BUT_NOT_USED WT-5749 Only pass a non-NULL WT_ITEM value when allocating a WT_UPDATE with associated data WT-5764 Fix and reenable test_compact02 WT-5790 Disable test_wt2246_col_append WT-5883 Add upgrade/downgrade testing to WiredTiger standalone tests WT-5911 History store verification re-architecture WT-5912 Change page deletion assert condition in __split_insert() WT-5954 Turn off column store test and lower isolation levels in test_random_abort WT-6010 Workgen changes - Add session config at Thread level WT-6031 Remove legacy WT_PAGE_MODIFY.last_stable_timestamp WT-6033 Clean up unused unittest imports WT-6044 Coverity: Variable set but never used WT-6045 Minor cleanup for test_random_abort WT-6047 Coverity: Redundant NULL check WT-6049 Fix eviction evicting uncommitted changes WT-6050 Close the metadata cursor after bulk loading WT-6053 fixed-width column-store macro can step past the end of allocated memory WT-6073 Don't append the tombstone to the update chain if it is already there WT-6078 Temporarily disable hs verify to unblock wiredtiger drop WT-6081 Switch wtperf defaults to mirror MongoDB defaults
* Import wiredtiger: 7b994a862e899a12eb7c3ac814c9fada7d8d1ab9 from branch ↵r4.4.0-rc2Luke Chen2020-04-2287-1115/+1204
| | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 9bd1ece797..7b994a862e for: 4.4.0-rc2 WT-4701 Switch test/format to use WiredTiger locking primitives WT-5766 Separate out internal and shared transaction data WT-5791 Prepare checkpoint can finish in 0msec and reset prepare min stat WT-5794 Remove skew_newest option from reconciliation WT-5833 Fix caching issue for overflow key/value items WT-5919 Disallow logging archival testing with log-based incremental backup WT-5946 Eviction server handles can deadlock when opening HS cursors WT-5968 Make the WT_SESSION_IMPL.txn field an allocated structure WT-5986 Create script for emulating multiversion tests WT-6016 Fill source code comments where lines start with parentheticals WT-6020 __rec_append_orig_value() cleanup WT-6026 Fix s_all breakage on format.h
* Import wiredtiger: 9bd1ece7971714f947b47e589b0af5d7ee97a29d from branch ↵Luke Chen2020-04-16110-1212/+1434
| | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: da6c25fee0..9bd1ece797 for: 4.4.0-rc2 WT-5671 Prepare support with durable history: implement changes to prepare and commit/abort WT-5675 Prepare support with durable history: workgen changes WT-5765 Add an error return macro that skips codes but doesn't clear them WT-5825 Reduce the number of runs for checkpoint-stress-test WT-5982 Remove redundant fields used earlier for HS inserts WT-5989 Support arguments in workgen WT-5997 Disable mongodb-4.4 branch for release compatibility testing WT-5999 Update format so it's possible for it to restart on an existing database WT-6003 Remove duplicate open_cursor call WT-6007 Fix an assert for fixed length column store WT-6008 Turn off format stress testing for column-store
* Import wiredtiger: da6c25fee0c5c9b0376df0dc19caa40a553cc5a2 from branch ↵r4.4.0-rc0Luke Chen2020-04-0949-772/+1325
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 5b5d798856..da6c25fee0 for: 4.4.0-rc0 WT-5357 Document WT_SESSION.truncate of a log cursor WT-5527 Free the onpage updates when restoring update chains WT-5675 Prepare support with durable history: workgen changes WT-5778 Simplify __rec_append_orig_value WT-5796 Speed up verification of file's associated history store information WT-5811 Mark ASAN tests as running on a slow machine WT-5909 Coverity unused value issue WT-5930 (4.4-only) Journaled data from 4.2 binaries not recovered at startup WT-5932 Rollback to stable aborting on-disk updates for in-memory database WT-5938 Fix a memory corruption in rollback to stable WT-5941 Document how eviction works in durable history WT-5943 Consider WT_TS_NONE timestamped update also a valid update for rollback to stable WT-5944 Relax test_wt2853_perf performance parameters temporarily WT-5948 Search shouldn't ignore globally visible tombstone of history store WT-5952 Fix freeing updates racing with application threads WT-5953 Fix format CONFIG file "mmap_all" syntax incompatibility WT-5961 Respect write generations when constructing the root addr WT-5965 Ignore leading whitespace in format CONFIG files WT-5967 Remove named snapshot support WT-5978 Unstable prepared updates causing the update chain to be unnecessarily restored WT-5979 Add Evergreen release compatibility test for forward compatibility WT-5983 Remove diagnostic tests left over from WT-5043 WT-5985 Turn off format testing for relaxed isolation levels WT-5987 Turn off history store verification in the WT_SESSION.verify method WT-5988 Do not write log records as part recovery rollback to stable operation WT-5993 Restore disk page header version WT-5994 Turn off format testing for relaxed isolation levels (part 2)
* Import wiredtiger: 5b5d7988560a20dbe827a1fa16c0481e6c0e2821 from branch ↵Luke Chen2020-03-3036-689/+1005
| | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 4500a8ed93..5b5d798856 for: 4.4.0-rc0 WT-4523 Fix type incompatibilities during alloc and free of memory for async ops WT-5588 Only release cursor memory allocated by the API for cursor copy debug mode WT-5826 Fix a leak when a page splits and some updates aren't restored WT-5828 Reconciliation discards salvaged overflow blocks with stop time pairs WT-5891 Disable testing of checkpoint cursors in wt4333_handle_locks WT-5901 Fix branch checkout issue in release compatibility tests WT-5902 Fix history store using incorrect key for lookups WT-5914 Only configure log-incremental backup if archiving is off in test/format WT-5921 Fix wtperf_xray to detect builds that haven't been instrumented with XRay WT-5922 Separate out XRay and xray_to_optrack build instructions WT-5923 Avoid performing history store cleanup for modified trees WT-5925 Rework format CONFIG file syntax for clarity WT-5931 Recovery rollback to stable is leading to remove a record that is not expected
* SERVER-46413 Add tests for OCSP on Windows and OSXShreyas Kalyan2020-03-261-44/+45
| | | | (cherry picked from commit 7eab469f87e860ce9e74918fdd5a23e943eb2673)
* SERVER-46008 Remove thread specific attributes feature from boost::logHenrik Edin2020-03-264-11/+97
| | | | | | | | | Because we prefer to compile with BOOST_LOG_USE_COMPILER_TLS for performance reasons it is not safe to log during global shutdown because of the uses of thread_local. We are not using this feature so we remove it instead of removing BOOST_LOG_USE_COMPILER_TLS and affecting the server. The issue only affects unittests as we only do clean shutdown there. (cherry picked from commit 23a5160098996b401a1145504a7be356a3e6c8f1)
* Import wiredtiger: 4500a8ed93af91b15901d00a9f9c2587f94275f9 from branch ↵Luke Chen2020-03-2447-647/+1122
| | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: f6ab94b43b..4500a8ed93 for: 4.4.0-rc0 WT-5616 Coverity: Memory leak WT-5669 Prepare support with durable history: backport data format changes to 4.2 WT-5672 Prepare support with durable history: implement rollback_to_stable WT-5674 Prepare support with durable history: add/debug functional tests WT-5754 Ensure the value is globally visible before encode it into WT_ROW WT-5813 Fix heap-use-after-free in __split_parent WT-5855 Clean up operation tracking documentation WT-5880 test/format backup missing expected log file WT-5885 Improve WT rollback to stable verbose output for better debugging WT-5887 Turn off verbose output when test/format output is redirected to a file WT-5890 Bump log/WT version to facilitate upgrade/downgrade floor for MongoDB WT-5894 Don't persist durable timestamp if it is same as commit timestamp WT-5896 Recovery sometimes attempts rollback to stable with an absent history store file WT-5898 Fix memory leak in verifying history store WT-5899 Restore WT_PAGE_LAS_UPDATE on-disk page flag value to avoid break backward compatibility WT-5900 Display failed version numbers in error message for version mismatch failures WT-5910 Fix start_durable_ts when handling out-of-order updates
* Import wiredtiger: f6ab94b43bc56ce16ba0192ed15d1b602e9f2017 from branch ↵Luke Chen2020-03-1951-601/+1282
| | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 59c2abc4d9..f6ab94b43b for: 4.3.5 WT-5170 Convert the os_posix layer to use mmap for I/O instead of system calls WT-5259 Write wiki documentation on how to generate and use XRay traces WT-5617 Coverity: Memory leak WT-5630 Adding stage to turtle init to prevent startup on a too-low version WT-5721 Remove LAS file when upgrading to 4.4 WT-5735 Coverity analysis defect 114070: Explicit null dereferenced WT-5785 Fix potential deadlocks in eviction and verify code paths WT-5831 Fix the case of history store corruption WT-5834 Incremental backup returning too large offset WT-5843 Mark page dirty when reconciled page updates are aborted WT-5857 Prepend homedir for system call pathnames in format backup test WT-5858 Fix incremental backups both log/block based for first time WT-5859 Fix a seg fault in verification WT-5862 Add conditional around macro definition WT-5868 Fix test_txn19 because of changing of error message WT-5872 test/format not writing out isolation level WT-5874 Disable test_wt2323_join_visiblity WT-5879 Fix a bug reconciling metadata
* Import wiredtiger: 59c2abc4d95f7d29b8a4ed43c7f182cd3c515e90 from branch ↵Luke Chen2020-03-167-21/+420
| | | | | | | | | | | | | | mongodb-4.4 ref: 187983a50c..59c2abc4d9 for: 4.3.5 WT-5240 Update test/format to perform incremental backups WT-5729 Coverity analysis defect 114078: Unchecked return value from library WT-5730 Coverity analysis defect 114077: Unchecked return value WT-5733 Coverity analysis defect 114074: Logically dead code WT-5734 Coverity analysis defect 114073: PW.MIXED_ENUM_TYPE WT-5844 Adjust error codes for when we detect files that are too small to contain a descriptor block
* Import wiredtiger: 187983a50c696eb217a780bb6b29e4bd3433c13b from branch ↵Luke Chen2020-03-15225-7738/+14066
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 7e595e4a3a..187983a50c for: 4.4.0-rc0 WT-3821 Python test case fails due to pinned timestamp warning WT-4458 Only sweep btree handles that have been evicted from cache WT-4671 Remove Limbo pages WT-4674 Instantiate birthmark records using in-memory metadata WT-4676 Search LAS for the history and compare to in-memory update WT-4677 Re-initialize prepared updates WT-4678 Write the test workload for relevant history in cache WT-4681 Check if expired content is being swept from lookaside WT-4683 Reverse the modifies when writing to LAS WT-4685 Add new statistics for relevant history in cache WT-4868 Aggregate btree write gen from leaf pages in salvage WT-4954 Document duplicate backup cursors WT-5001 Migrate Jenkins “wiredtiger-test-format-stress-sanitizer-ppc” job to Evergreen WT-5045 Add more statistics tracking where checkpoint spends time WT-5052 Enhance lookaside search functionality to handle WT_MODIFY records WT-5058 Stop initializing a page with updates from lookaside WT-5066 Extend test_las06 to support column store. WT-5072 Modify __wt_rec_upd_select() to pull an update from lookaside WT-5073 Review update chain traversals WT-5089 test_las02.py fails: Unable to locate the correct record WT-5092 Modify lookaside schema to add timestamp and transaction id to the key WT-5098 Modify __wt_update_alloc() to accept NULL WT_ITEM values WT-5141 Handle multiple modifies for the same key on lookaside eviction WT-5146 Returning wrong record value for variable length columnar table WT-5158 Remove assertion in __wt_find_lookaside_upd for cursor comparison WT-5167 Fixing the missing pieces of page instantiation from las WT-5186 Handle reading of LAS modifies on top of a birthmark record WT-5191 Avoid LAS sweep server remove records that don't have disk image with proper version WT-5203 lookaside history should no longer be preferentially evicted WT-5212 Backup data validation tests WT-5214 Verify potential incremental failures WT-5215 Stress testing of incremental backup WT-5222 Make checkpoint always choose skew newest WT-5225 Create persistent file for History store WT-5227 Enable python test cursor04 on relevant history feature branch WT-5228 Several tests fail with incorrect or missing record after reconciliation changes WT-5233 Prepared update not visible in las06 WT-5236 Enhance workgen to support draft lookaside stress workload WT-5246 Update WiredTiger backup documentation WT-5253 Add History store file to checkpoint target list. WT-5254 Add aggregate timestamp info to the WT_REF. WT-5256 Fix relevant history build after develop merged brought LIMBO reference WT-5264 Add a delete record for every insert record into the WT history store to represent stop time pair WT-5267 Enable storing start/stop time pair for each record in the history store WT-5271 Remove WT_PAGE_LOOKASIDE structure. WT-5279 Disable failing tests in the preferred way WT-5280 Write all other versions to history store during checkpoint. WT-5281 Assert that we're no longer writing tombstones to the history store WT-5283 Eviction to create disk image with newest committed version. WT-5284 Test to check eviction is writing the newest version to data store WT-5286 Enable the data format to store time pair WT-5289 Remove the code that does garbage collection from sweep server WT-5290 Add new verbose flag and verbose logs for checkpoint garbage collection WT-5291 Additional statistics for checkpoint garbage collection WT-5292 Test the garbage collection by checkpoint WT-5295 Disable remaining failing tests in durable history branch WT-5298 Add a condition to verify the timestamp of a page during checkpoint of history store WT-5300 Traverse the history store internal page for obsolete child pages by checkpoint WT-5302 Begin writing validity window for new data format WT-5303 Update checkpoint statistics for the new history store file. WT-5308 Remove WT --enable-page-version-ts build configuration option WT-5317 Eviction writes uncommitted metadata changes to disk WT-5320 Save update restore to reuse lookaside eviction. WT-5321 Update the stats and counters that represent lookaside inserts according to durable history WT-5328 Evict obsolete history store page WT-5333 Fix search not found issue due to skipped birthmark and rework txn_read WT-5335 Read the start and stop time pairs back from cell when we reconstruct it on update chain WT-5341 Clang sanitiser was triggered by checkpoint writing to the history store change WT-5343 Show history store in the wt list WT-5345 Show aggregated timestamp information for internal pages and leaf pages WT-5347 Add ability for wt util to print historical versions of a key WT-5353 Verify data continuity between history and data store WT-5354 Verify history store key is not missing from the data store WT-5355 Add the ability to dump a given btree as of a timestamp WT-5361 Fix selecting aborted txn to write to disk WT-5369 Don't use transaction ids from a page with a previous startup generation WT-5385 Use WT_UPDATE_HISTORY_STORE to avoid repeatedly inserting updates to lookaside WT-5386 Re-enable test_inmem01 WT-5388 Fix write squash statistic caused by change in reverse delta WT-5392 Fall out of in-memory obsolete history page eviction WT-5414 Change the usage from durable timestamp to commit timestamp during eviction. WT-5416 Make sure that rollback to stable works on all objects in WT WT-5417 Skip the clean pages of each tree with aggregated stop timestamp is less than stable timestamp WT-5419 Create a TOMBSTONE update to represent the on-disk value state WT-5420 Reconcile should consider TOMBSTONE update to replace or remove the on-disk value WT-5421 Search the history store to find the value that can be replaced the on-disk value WT-5422 Remove the history updates for reconciled data pages WT-5423 Convert a history store modified value into a full update WT-5424 Add statistics for rollback to stable operations WT-5425 Add a new verbose flag to print the rollback to stable operation WT-5426 Ensure rollback to stable is executed from recovery WT-5427 Implement tests for rollback to stable WT-5431 Merge develop branch to durable history branch WT-5434 Remove develop-timestamp and add test for 4.0 and 4.2 pair to compatibility_test_for_mongodb_releases.sh after merge durable history to develop WT-5441 Fix known visibility issues WT-5446 Fix not writing to lookaside WT-5448 Reconciliation wrongly overwrites the cell with default time pairs WT-5451 Update reverse modify logic to always insert a modify into the history store WT-5453 Fix cell packing for globally visible values. WT-5454 Rename cache_overflow configuration option. WT-5455 Fix test_hs03.py WT-5457 single block reconciliation with saved updates can leak blocks WT-5461 Search should not return onpage value if nothing is found by transaction read WT-5462 Rebalance the Evergreen Python test buckets WT-5464 Open reading history cursors on the user session WT-5467 Make history store cursor part of each session, get rid of the cursor pool WT-5469 Support mixing timestamped and non-timestamped updates WT-5476 Continue writing tombstones when the tombstone is globally visable. WT-5478 Insert records directly into history store without a txn WT-5482 Increment cache usage when appending on-disk value to update list WT-5484 Check visibility before saving updates for in memory reconciliation WT-5489 page-read can race with threads locking in-memory page structures WT-5491 Add an option to wt verify to confirm that no data exists after the stable timestamp WT-5493 Re-enabling test_bug008 WT-5495 WT-5495 For column store, check the on-page value and history store even if the key is in the insert list WT-5496 upd should be reset to NULL if all upd on the chain are not visible in txn read WT-5500 Implement new history store format WT-5501 Do not use default session to create a history store cursor when configuring WT-5502 Re-add changes reverted by merge commit WT-5503 We can only free updates inserted into history store after a full update. WT-5508 Some of the txnids not cleared after restart WT-5509 Infinite loop when reading from history store at early specific timestamp in test_util01 WT-5510 Fix test_hs01.py, test_hs06.py (test_hs_prepare_reads) WT-5513 Don't consider TOMBSTONE/Stop time pair for history store reads WT-5515 Enable test_hs06 WT-5516 Backup starts with base_write_gen 1 WT-5518 Split-parent code can race with other threads when checking the WT_REF.state WT-5519 Apply version from datastore after finding a modify when possible. WT-5522 Remove update free logic in hs_insert_updates. WT-5523 Inserting history store needs to handle modify based on a tombstone WT-5525 Free up 3B in the WT_REF structure WT-5529 Improve usage of upd in txn.i WT-5540 Call cursor disable bulk insert on first insert to history store. WT-5541 Use snapshot isolation whenever we use history store cursors in verification WT-5542 History store not using the on disk value as the base value for modify when key boundary crossed WT-5547 Disable all the skipped rollback to stable tests for column store types WT-5549 Fix the recovery rollback to stable and enable the passing tests for both row and variable columnar types WT-5551 Fix the history store insert statistics WT-5552 Checkpoint reconciliation and page splits free the WT_REF.addr field without locking WT-5555 Update base write gen to the maximum write gen we have seen in recover WT-5556 Verify of a file should verify its history store content too WT-5558 Use durable timestamp from the update instead of start WT-5563 Transactions ID are getting wiped which causes errors in WT Verify WT-5565 Core dump is generated when running test_random_abort or test_random_direcio run on durable history branch WT-5566 Update rollback to stable tests to use new statistics WT-5567 Fix an assert in txn_read always be true WT-5569 Update WiredTiger source code to include 2020 copyright notices for durable history WT-5570 Refactor the __upd_alloc_tombstone() according to the new use in durable history WT-5574 Rolling back a prepared transaction with `cursor_copy` results in a use-after-free WT-5575 Fix the test_durable_ts01 test to expect older data after recovery WT-5576 Temporarily add lookaside score stat and cache_overflow config option WT-5579 Fix Evergreen memory sanitizer test failure WT-5581 Address sanitizer test failure running bloom filter testing WT-5582 Long unit testing sweeping cursors failing WT-5583 Applying operations in recovery encounters unexpected operation type WT-5587 Limit how many checkpoints are dropped by a subsequent checkpoint WT-5589 force_stop on duplicate cursor open not returning error WT-5590 Fix spellings so s_string passes WT-5593 test/format assertion failure addr->size != 0 WT-5595 test/format data mismatch errors WT-5596 Increase format stress testing scope. WT-5597 Fix the history store file access during recovery WT-5598 __verify_timestamp_to_pretty_string uses local buffer which is freed before access WT-5602 Rollback transaction core dumped with upd->start_ts >= unpack->stop_ts WT-5603 test/format assertion failure while discarding in-memory page WT-5605 Update test checkpoint to no longer use checkpoint cursors WT-5607 Successful 'verify -h' calls are returning not found WT-5610 Fix assertion for reconciling fixed length column store WT-5611 Don't write updates with different commit and durable timestamps to data store WT-5612 Remove history store values for non-timestamp tables WT-5613 Remove birthmark update type WT-5615 Coverity: Read of uninitialised value WT-5618 Skip timestamp range overlap check if start timestamp is zero WT-5620 Skip the history store TOMBSTONE only for rollback to stable operation WT-5624 Incremental unit test should use offset/length ranges WT-5625 corruption detected during validation - root page's aggregated timestamp incorrect WT-5626 Remove assert which checks for newer updates in the history store WT-5628 rollback_to_stable failed with no such file WT-5631 Recovery rollback to stable for timestamped logged tables WT-5632 Don't write stop_ts of 1 for non-timestamped delete WT-5633 Fix another assertion for reconciling fixed length column store WT-5636 prefix compression is slow in the history-store access pattern WT-5638 Ignore checking visibility of history store updates as they are implicitly committed WT-5640 test_wt2323_join_visibility fail when processing consecutive tombstones in __wt_hs_insert_updates WT-5641 Clear history store content when deleting a key due to a globally visible tombstone WT-5644 Appending onpage value to an aborted update triggers an assert WT-5647 replace the WT_REF structure's WT_REF_READING state with a flag WT-5648 Add a leaf or internal page type flag to the WT_REF structure WT-5649 Refactor WT_REF locking, review all WT_REF.addr reads for locking issues WT-5650 Fix a race condition between reading the WT_PAGE.modify field and the page being dirtied. WT-5651 Fix the RTS assert to consider error scenarios of search WT-5654 Add version information to the history store key format WT-5658 Fix heap-use-after-free in parent split code WT-5665 Data mismatch bug when running new version of test_checkpoint with timestamps WT-5666 Deleting a chunk of the namespace changes the WT_REF type WT-5667 Remove usage of checkpoint cursor in test/format WT-5668 Prepare support with durable history: implement data format changes WT-5678 Fix infinite looping behaviour in history store cursor positioning WT-5680 segfault when dereferencing NULL addr while reconciling WT-5682 Ensure that we can't apply modifies on top of tombstones WT-5684 overflow values must be discarded when there is no update for a key WT-5685 Set aspell dictionary to en_US WT-5688 Memory leak detected during page overflow read WT-5689 reduce work required for the cursor-pinned test. WT-5690 Rollback to stable assertion failure regarding update visibility WT-5692 Revert a test change to fix a Python hang WT-5695 Fixed incremental backup example to use O_CREAT in the backup range case WT-5696 test_timestamp_abort fails with data mismatch WT-5698 Disabling bulk cursor changes broke a Jenkins compile WT-5699 Refactor incremental backup RANGE code WT-5700 Add smoke test script for incremental backup stress test WT-5701 If an out-of-order update masks an on-disk value, don't append it WT-5704 Incremental backup smoke test core dumped WT-5706 Fix csuite-incr-backup-test calculation of value sizes WT-5707 Reduce the test load for checkpoint stress test WT-5712 Ensure WT command line utility treats history store consistently WT-5713 Fix failures so test_durable_rollback_stable.py can be enabled WT-5719 Incremental backup metadata should quote the ID string WT-5722 Incremental backup should do a name check on identifiers WT-5745 Don't copy a value into tombstones WT-5747 Cope with updates out of timestamp order WT-5753 Fix divide by zero error in test/csuite/test_incr_backup WT-5756 heap-use-after-free in __wt_row_modify WT-5762 Make test_hs10 more robust WT-5767 Fix search_near invocations for history store WT-5771 make-check-msan-test failed with use-of-uninitialized-value error on RHEL 8.0 WT-5774 Move stress test tasks into a separate build variant WT-5775 Fix leak of updates from history store WT-5777 Add statistic for tracking history store deletions due to key removal WT-5780 Fix timestamp_index_build.js in noPassthrough suite. WT-5781 Fix basic.js in parallel suite WT-5786 Detect if a file is too small to read a descriptor block WT-5792 Dump and verify can't see the history store WT-5795 Disable assertion that inserts to the history store are unique WT-5798 Check that the history store file exists before performing rollback to stable WT-5799 Dont assume we have ordered timestamps when doing rec append original value WT-5800 Temporarily disable history store verify WT-5806 Perform rollback to stable on a clean shutdown WT-5809 Invariant failure: stable timestamp does not equal appliedThrough timestamp WT-5820 Change format.sh to forcibly quit if a test runs out of disk space. WT-5822 Don't evict metadata updates from a running checkpoint WT-5827 Enable test_schema_abort WT-5830 Enable two c tests in evergreen
* Import wiredtiger: 7e595e4a3a9c30c9db0eb33f7da72c97526a2b99 from branch ↵r4.3.4Luke Chen2020-03-026-164/+135
| | | | | | | | | | | | mongodb-4.4 ref: 0a0a6354a8..7e595e4a3a for: 4.3.4 Revert below tickets: WT-5518 Split-parent code can race with other threads when checking the WT_REF.state WT-5552 Checkpoint reconciliation and page splits free the WT_REF.addr field without locking WT-5658 Fix heap-use-after-free in parent split code
* Import wiredtiger: 0a0a6354a8d7eea17c803877f9921ed6cedc31c5 from branch ↵Luke Chen2020-02-276-135/+164
| | | | | | | | | | | mongodb-4.4 ref: 58baf804dd..0a0a6354a8 for: 4.3.4 WT-5518 Split-parent code can race with other threads when checking the WT_REF.state WT-5552 Checkpoint reconciliation and page splits free the WT_REF.addr field without locking WT-5658 Fix heap-use-after-free in parent split code
* SERVER-46157 Logging from s2 uses logv2Henrik Edin2020-02-241-39/+37
|
* SERVER-46156 Deprecate LogstreamBuilder and more manual log conversionsHenrik Edin2020-02-231-4/+4
| | | | | | | * Remove setPlainConsoleLogger() * Update errorcodes linter to work with custom user defined log macros rename src/mongo/embedded/{embedded_log_appender.h => embedded_log_backend.h} (61%)
* SERVER-27675 Make all targets depend on the allocator shim to topsort it lastAndrew Morrow2020-02-213-4/+57
|
* Import wiredtiger: 58baf804dd6e5a72c4e122cfb696e2d06a9fc888 from branch ↵Luke Chen2020-02-1910-26/+80
| | | | | | | | | | | | mongodb-4.4 ref: d74cb1a913..58baf804dd for: 4.3.4 WT-5371 Fix test_stat08.py assertion failure WT-5521 Cache stuck during format initial load, configured with library checkpoints WT-5584 Change format to ignore Evergreen timestamps in configuration files WT-5587 Limit how many checkpoints are dropped by a subsequent checkpoint
* SERVER-45677 libunwind on by default where possibleBilly Donahue2020-02-143-4/+0
| | | | | - tcmalloc to not use libunwind API, as it uses slow cursor steps. - Remove UNW_LOCAL_ONLY from CXXFLAGS everywhere.
* SERVER-42938 Implement Infrastructure for Provisioning and Refreshing OCSP ↵Shreyas Kalyan2020-02-131-6/+6
| | | | | | Responses in the Server create mode 100644 jstests/ocsp/ocsp_server_refresh.js
* SERVER-45301 Not all expected aliases are present in the ninja generator outputMathew Robinson2020-02-132-13/+14
|
* SERVER-45048 Use hygienic builds in EvergreenMathew Robinson2020-02-132-12/+57
|
* Import wiredtiger: d74cb1a91399e1197a95667502002ffed2b7b82b from branch ↵Luke Chen2020-02-12792-868/+983
| | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 94c6c16014..d74cb1a913 for: 4.3.4 WT-5372 Skip known errors for long-running format stress sanitizer tasks WT-5383 Update WiredTiger source code to include 2020 copyright notices WT-5398 Adding more correctness tasks into rhel80 Evergreen build variant WT-5526 Remove visibility check in __wt_value_return_upd WT-5536 Add zstd as a builtin compressor for WiredTiger Python package WT-5538 Change format to ignore Evergreen timestamps in configuration files WT-5553 Return error if primary cursor is not an incremental source WT-5554 Account for logpath when retrieving file size in incremental backup WT-5557 Fix the wrong page type returned when checking on-page cell WT-5564 Buffer not extended properly when incremental bitstring grows
* Import wiredtiger: 94c6c16014292f335a5094669e850125d7432b14 from branch ↵Luke Chen2020-02-0725-387/+739
| | | | | | | | | | | | | mongodb-4.4 ref: 168c7f1b38..94c6c16014 for: 4.3.4 WT-4999 Migrate Jenkins “wiredtiger-test-format-stress-zseries” job to Evergreen WT-5206 Return the correct checkpoint-modified list of blocks WT-5489 page-read can race with threads locking in-memory page structures WT-5534 Incremental backup needs to accept older metadata WT-5537 Use correct WT_ITEM fields per memory sanitizer
* Revert "SERVER-45677 libunwind on by default where possible"William Schultz2020-02-062-3/+3
| | | | This reverts commit 969151e9ab69dcb53397cf40f810e718421db081.
* SERVER-23208 Pick SCons upstream fix for SCons issue #3469Andrew Morrow2020-02-053-18/+34
| | | | https://github.com/SCons/scons/commit/7c32091fccad5e70755dc46174fe516fff4549c3
* SERVER-45677 libunwind on by default where possibleBilly Donahue2020-02-052-3/+3
| | | | | | - SCons configure to probe for libunwind support - gracefully handle SIGUSR2 without libunwind - integrate libunwind on-by-default (linux-x86_64) into evergreen
* SERVER-45929 Fix issue with OCSP_basic_verifyShreyas Kalyan2020-02-031-0/+1
|
* SERVER-44549 Remove the mobile storage engineAndrew Morrow2020-02-039-249478/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mode change 100644 => 100755 buildscripts/evergreen_task_timeout.py delete mode 100644 buildscripts/resmokeconfig/suites/disk_mobile.yml delete mode 100644 src/mongo/db/storage/mobile/SConscript delete mode 100644 src/mongo/db/storage/mobile/mobile_index.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_index.h delete mode 100644 src/mongo/db/storage/mobile/mobile_index_test.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_init.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_kv_engine.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_kv_engine.h delete mode 100644 src/mongo/db/storage/mobile/mobile_kv_engine_test.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_options.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_options.h delete mode 100644 src/mongo/db/storage/mobile/mobile_options.idl delete mode 100644 src/mongo/db/storage/mobile/mobile_options_mongod.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_record_store.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_record_store.h delete mode 100644 src/mongo/db/storage/mobile/mobile_record_store_test.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_recovery_unit.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_recovery_unit.h delete mode 100644 src/mongo/db/storage/mobile/mobile_session.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_session.h delete mode 100644 src/mongo/db/storage/mobile/mobile_session_pool.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_session_pool.h delete mode 100644 src/mongo/db/storage/mobile/mobile_sqlite_statement.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_sqlite_statement.h delete mode 100644 src/mongo/db/storage/mobile/mobile_util.cpp delete mode 100644 src/mongo/db/storage/mobile/mobile_util.h delete mode 100755 src/third_party/scripts/sqlite_get_sources.sh delete mode 100644 src/third_party/shim_sqlite.cpp delete mode 100644 src/third_party/sqlite-amalgamation-3260000/SConscript delete mode 100644 src/third_party/sqlite-amalgamation-3260000/patches/gethostuuid.patch delete mode 100644 src/third_party/sqlite-amalgamation-3260000/sqlite/shell.c delete mode 100644 src/third_party/sqlite-amalgamation-3260000/sqlite/sqlite3.c delete mode 100644 src/third_party/sqlite-amalgamation-3260000/sqlite/sqlite3.h delete mode 100644 src/third_party/sqlite-amalgamation-3260000/sqlite/sqlite3ext.h
* Import wiredtiger: 168c7f1b3859516115721868f312544abb0caf5b from branch ↵Luke Chen2020-01-3141-603/+900
| | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: d790f9057c..168c7f1b38 for: 4.3.4 WT-5159 Make wiredtiger work with SWIG 4.0.0 beyond WT-5219 Btree walk code read the lock WT_REF.addr field without locking WT-5376 WT_UPDATE.type field can race with visibility checks when returning key/value pairs WT-5387 Prepared transaction resolution can stall eviction on active pages WT-5393 Prepared transaction rollback and API error handling fixes WT-5405 Make format LSM test a separate Evergreen task WT-5437 Salvage's excessive consumption of cache memory causing eviction to stall WT-5444 Re-enable PPC format tests in Evergreen WT-5449 Increase contention in history store stress workload WT-5458 Fix Evergreen timeout failures in linux-directio test WT-5460 Buffer alignment failure captured by linux-directio test WT-5468 Improve documentation for "wt load" WT-5480 Don't take threads resolving prepared transactions to assist with eviction WT-5481 DIAGNOSTIC split code assert can race with WT_REF locking WT-5488 Dump the failing CONFIG for Evergreen test/format tasks
* SERVER-45227 Remove tcmalloc based profiling supportAndrew Morrow2020-01-281-9/+0
| | | | delete mode 100644 src/mongo/db/commands/cpuprofile.cpp
* SERVER-45671 Fix ASN1 Generalized Time Format for Mock OCSP ResponderShreyas Kalyan2020-01-271-3/+4
| | | | create mode 100644 out.pcap
* Import wiredtiger: d790f9057cba1be8f2ec92e7d9e522583c0109a0 from branch ↵Luke Chen2020-01-2119-195/+255
| | | | | | | | | | | | | | | | | | mongodb-4.4 ref: c6962452f2..d790f9057c for: 4.3.3 WT-5041 Distribute modifications properly in test_calc_modify.py WT-5255 Turn off external programs if direct I/O is configured for test/format WT-5366 read-committed and read-uncommitted transactions can stall eviction WT-5380 Stat clear is not clearing the proper lookaside cursor stats WT-5395 Fix a bug in the read lock implementation when there is a lot of contention WT-5440 __wt_txn_clear_read_timestamp() has an unnecessary serialization point WT-5442 Fix failure in test_shared_cache01.py WT-5443 Disable PPC format tests in Evergreen WT-5445 Handle relative "home" directories in format.sh WT-5450 Support timeout setting for long-running operations in test/format
* Import wiredtiger: c6962452f2c3469c039edfcafb7702450bf14c3b from branch ↵Luke Chen2020-01-1525-146/+685
| | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 5bd9fdfc0b..c6962452f2 for: 4.3.3 WT-4886 Avoid depending on particular error message text for test_bug018 WT-5003 Migrate Jenkins “wiredtiger-test-race-condition-stress-sanitizer” job to Evergreen WT-5024 Migrate Jenkins “wiredtiger-compatibility” job to Evergreen WT-5081 Add support for ASan builds in the Python test suite WT-5119 Birthmark records can be read as normal updates if reads race with checkpoints WT-5165 Add cursor copy debug mode WT-5199 Adding correctness tasks into rhel80 Evergreen build variant WT-5261 coverage-report task timed out in Evergreen WT-5334 Add testing coverage for static wt build WT-5379 Missing varargs cleanup WT-5410 WiredTiger formatted timestamp string buffer size is too small
* SERVER-42470 libunwind linux_aarch64 SConstruct and config artifactsBilly Donahue2020-01-1310-39/+1564
|
* SERVER-42470 update libunwind to get mongo-local __asm__ patchBilly Donahue2020-01-1014-74/+95
| | | | import to new v1.4-stable-mongo tag
* SERVER-45390 Bring Subst improvements downstreamMathew Robinson2020-01-071-306/+341
|
* Import wiredtiger: 5bd9fdfc0bb7f8fcf791e234b6e436c79dfe1fee from branch ↵Luke Chen2020-01-0715-199/+342
| | | | | | | | | | | | | | mongodb-4.4 ref: 61bf0547c6..5bd9fdfc0b for: 4.3.3 WT-4968 Remove all_committed timestamp WT-4978 Migrate Jenkins “wiredtiger-pull-request-compilers” job to Evergreen WT-5192 Don't allow checkpoints to evict without a snapshot WT-5235 Craft a workload to show lookaside contention WT-5377 variable-length column store insert locking in format test program can stall eviction WT-5389 Add timestamps to format.sh test runs
* SERVER-45336 Speed up Subst by preventing unnecessary Frame allocationsMathew Robinson2020-01-021-356/+358
|
* Import wiredtiger: 61bf0547c6edfc6cd7c633c80f1c76f3e33e5aec from branch ↵Luke Chen2019-12-3155-577/+941
| | | | | | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 77f9aebf23..61bf0547c6 for: 4.3.3 WT-4919 Add debug mode which allocates exact amount of memory in __wt_realloc_def WT-4921 Add debug mode option that slows checkpoint creation WT-4997 Migrate Jenkins “wiredtiger-test-format-stress” job to Evergreen WT-4998 Migrate Jenkins “wiredtiger-test-format-stress-ppc” job to Evergreen WT-5000 Migrate Jenkins “wiredtiger-test-format-stress-sanitizer” job to Evergreen WT-5004 Migrate Jenkins “wiredtiger-test-checkpoint-stress” job to Evergreen WT-5005 Migrate Jenkins “wiredtiger-test-recovery-stress” job to Evergreen WT-5090 Log a message when rolling a thread back because it holds the oldest timestamp WT-5112 Handling goto labels with multiple words in s_goto.py WT-5312 Add thread doing random cursor operations to format's cache size calculation WT-5324 WiredTiger API error handling fixes WT-5327 Backup cursor API can fail to restore WT_SESSION name information WT-5330 Read-only transactions are being rolled back in MongoDB WT-5360 Add a template for building a glossary in developer docs WT-5365 Remove format's long-running transaction support
* SERVER-45198 Upgrade SCons to 3.1.2Mathew Robinson2019-12-20203-532/+592
|
* Import wiredtiger: 77f9aebf23bb7fcb3911345741f20d67128f8da6 from branch ↵Luke Chen2019-12-1941-298/+2701
| | | | | | | | | | | | | | | | | | | mongodb-4.4 ref: 81a6cd2196..77f9aebf23 for: 4.3.3 WT-4969 Remove lsm_merge configuration option WT-5006 Migrate Jenkins “wiredtiger-test-split-stress” job to Evergreen WT-5037 Move Application Developer Resources documentation in github to WT documentation WT-5077 Handle ENOENT without failure when copying the directory WT-5139 WiredTiger incremental backup API WT-5221 Bypass test_wt2853_perf in Evergreen make-check-msan-test WT-5257 Coverity analysis bug: 113971 Dereference after null check WT-5263 Prepared updates written to the lookaside file are not always read as needed WT-5309 Update format.sh script to add prefix command argument WT-5314 Avoid loading extensions that have blank name for Python tests WT-5319 Avoid clearing the saved last-key when no instantiated key
* SERVER-43743 Upgrade libfmt to 6.1.1Henrik Edin2019-12-1816-2121/+3629
|
* SERVER-44568 Update server's embedded time zone rules to version 2019c.David Storch2019-12-101-8637/+8183
| | | | | | | | | | | | | This applies commit 7100439d476a615466bac87e89eea45ca9ec55fc from the upstream third party repository, derickr/timelib. It also adds a test to ensure that the latest time zone rules are now respected by default (in particular, that the abolition of daylight savings time in Brazil is accounted for). 2019c is the most recent time zone database as of this writing, but the latest version can always be found at iana.org/time-zones.
* Import wiredtiger: 81a6cd219659835dd32ca563c24dadee54edef7d from branch ↵Luke Chen2019-12-1016-130/+245
| | | | | | | | | | | | | | | mongodb-4.4 ref: d47dcd1f0e..81a6cd2196 for: 4.3.3 WT-5044 Log more information when timestamp usage issue is encountered WT-5047 Always return WT_TRY_SALVAGE for corrupted log WT-5276 test/format needs to move the oldest timestamp forward during bulk load WT-5277 Cursor key out-of-order detected in the lookaside file WT-5288 format.sh must distinguish format timeouts and kill child processes WT-5305 format.sh must handle format's use of the wt utility WT-5311 Format timestamps identically to MongoDB
* SERVER-44546 Remove mobile variants and embedded benchmarksAndrew Morrow2019-12-091-78/+0
|
* SERVER-45013 Fix up boost to work with VS2019Andrew Morrow2019-12-092-2/+2
| | | | Apply https://github.com/boostorg/proto/pull/2
* Import wiredtiger: d47dcd1f0ea992775be3d60456593c575451c435 from branch ↵Luke Chen2019-12-0317-113/+713
| | | | | | | | | | | | | mongodb-4.4 ref: 58115abb6f..d47dcd1f0e for: 4.3.3 WT-4996 Migrate Jenkins “wiredtiger-test-check-long” job to Evergreen WT-5082 Application threads are tasked with eviction even when pinning the oldest transaction ID WT-5232 Create a wrapper script to support format stress tests in Evergreen WT-5265 Remove pip install gcovr from coverage-report test WT-5274 format.sh must handle core-dump signals and "gdb attach" build mode
View Lorry Controller Status