summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* WT-3000 Wait for previous writes on first write to new log file (#3139)mongodb-3.2.11sueloverso2016-11-154-37/+125
| | | | (cherry picked from commit 8b05389ae90d593bc2376c8c7f0fa72830ce5fbf)
* Merge branch 'mongodb-3.4' into mongodb-3.2Michael Cahill2016-11-074-5/+9
|\
| * Merge branch 'develop' into mongodb-3.4mongodb-3.4.0-rc3Michael Cahill2016-11-074-5/+9
| |\
| | * WT-3008 Move wtperf stress jobs to new stress runner folder (#3131)David Hows2016-11-072-0/+0
| | |
| | * WT-3009 Remove the eviction_dirty_target from test/format runs with less ↵David Hows2016-11-071-2/+1
| | | | | | | | | | | | than 20MB cache (#3132)
| | * WT-2968 Fix a segfault when a drop races with closing a backup cursor. (#3127)Michael Cahill2016-11-071-3/+8
| | | | | | | | | | | | | | | | | | We were clearing the shared pointer to the list of filenames in the backup, then releasing the hotbackup lock before clearing the hotbackup flag. That means drops need to check both the flag and that the pointer is non-NULL.
* | | Merge branch 'mongodb-3.4' into mongodb-3.2Michael Cahill2016-11-04141-1817/+2849
|\ \ \ | |/ /
| * | Merge branch 'develop' into mongodb-3.4Michael Cahill2016-11-04141-1817/+2849
| |\ \ | | |/
| | * SERVER-26753 Add a call to spin on rwlocks with no active writers (#3126)Michael Cahill2016-11-044-15/+36
| | |
| | * WT-2964 Walk for longer when only looking for dirty pages (#3123)Michael Cahill2016-11-041-20/+14
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * WT-2964 Alter evict walk to not fill all its slots with internal pages when running in aggressive mode * Test removal of the bump of aggressive by 10 * Change how likely we are to give up, based on if we are looking for dirty or clean pages. Add a stat to track these "dirty give ups" * Lint * Remove statistic. * Simplify decision about when to give up walking for eviction.
| | * Merge branch 'master' into developMichael Cahill2016-11-031-1/+1
| | |\
| | | * WT-3007 Remove duplicated word in comment (#3118)Hyeonseok Oh2016-11-031-1/+1
| | | |
| | * | WT-2999 Remove C99ism.Michael Cahill2016-11-031-2/+2
| | | |
| | * | WT-3003 Fix doxygen comment blocks. (#3124)Michael Cahill2016-11-031-6/+8
| | | |
| | * | WT-2964 Alter evict walk to not fill all its slots with internal pages when ↵David Hows2016-11-031-4/+4
| | | | | | | | | | | | | | | | running in aggressive mode (#3112)
| | * | WT-3001 WT_EXTENSION_API references are named inconsistently. (#3115)Keith Bostic2016-11-038-479/+486
| | | | | | | | | | | | Replace uses of "wtext" and "wtapi" with "wt_api".
| | * | WT-3005 Add top-level .gitignore file. (#3120)Keith Bostic2016-11-031-0/+123
| | | |
| | * | WT-3003 Don't generate log record and op types. (#3121)sueloverso2016-11-033-65/+44
| | | |
| | * | WT-2999 Added contributed test case that demonstrated the leak. (#3122)Don Anderson2016-11-032-0/+171
| | | |
| | * | SERVER-26753 Don't spin on a read-lock in a tight loop. (#3113)Michael Cahill2016-11-022-15/+14
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * SERVER-26753 Don't spin on a read-lock in a tight loop. We could be starving a thread that we are waiting on of CPU. * Switch to yielding on rwlocks rather than sleeping. * Revert the attempt to be clever when spinning on rwlocks. * Spin getting a read lock while it is available to readers.
| | * | WT-2999 free memory related to cursor used with custom extractors during ↵Don Anderson2016-11-021-0/+2
| | | | | | | | | | | | | | | | joins. (#3117)
| | * | WT-2975 Fix a leak of statistics data when reopening handles. (#3114)Michael Cahill2016-11-011-1/+1
| | | |
| | * | WT-2998 add error messages to error returns that might be confusing. (#3110)Keith Bostic2016-11-0137-187/+362
| | | |
| | * | WT-2961 Add a version drop-down to the web version of the docs. (#3089)Michael Cahill2016-11-013-3/+84
| | | |
| | * | WT-2975 Only allocate space for statistics when we open a data source (#3107)Keith Bostic2016-11-019-30/+78
| | | |
| | * | WT-2953 Only test for checkpoint/LAS collision if LAS was used. (#3111)David Hows2016-11-011-2/+5
| | | |
| | * | WT-2968 Fix Jenkins failures from merge. (#3108)sueloverso2016-10-262-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * WT-2968 Reduce number of files. * Free backup file names. * Don't need to clear the pointer.
| | * | WT-2968 Don't open file handles on backup. (#3101)sueloverso2016-10-269-60/+218
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * WT-2968 Don't open file handles on backup. * whitespace, KNF * Add timing to test and populate with thousands of tables. * Remove macro and meta function. Add schema backup check function. * Refactor new function per review. * Remove cursor backup entry data structure. Simplify test a bit. * Schema ops walk file list in memory instead of on-disk file. * Set connection list entry to NULL before freeing memory. * Remove call to backup_stop on error. Errors are handled above. * Add comment * Fix test description. * Fix new test to use new DataSet code.
| | * | WT-2971 Add details on raw-compression into WT documentation (#3093)David Hows2016-10-264-4/+46
| | | |
| | * | WT-2947 replace test suite populate functions with *DataSet classes (#3083)Don Anderson2016-10-2663-897/+981
| | | |
| | * | WT-2945 Occasional hang running reconfigure fuzz test (#3098)Keith Bostic2016-10-265-43/+46
| | | | | | | | | | | | | | | | | | | | * Add a write barrier in front of __wt_cond_signal() to ensure the caller's flags meant to cause a thread to exit are seen by the thread. * Make the LSM start/stop worker thread loops look the same.
| | * | WT-2415 Add support for joins to return false positives from the Bloom ↵Don Anderson2016-10-257-8/+145
| | | | | | | | | | | | | | | | filter. (#3099)
| | * | WT-2991 Fix coverity REVERSE_INULL (#3106)David Hows2016-10-241-2/+1
| | | |
* | | | Merge branch 'mongodb-3.4' into mongodb-3.2Alex Gorrod2016-10-26165-2804/+5215
|\ \ \ \ | |/ / /
| * | | Merge branch 'develop' into mongodb-3.4mongodb-3.4.0-rc2Alex Gorrod2016-10-24114-970/+3155
| |\ \ \ | | |/ /
| | * | WT-2904 Revert overly strong assertion. (#3105)Alex Gorrod2016-10-241-1/+3
| | | | | | | | | | | | It broke backward compatibility.
| | * | WT-2954 Enable fast appends with small in-memory pages. (#3094)Michael Cahill2016-10-244-18/+22
| | | | | | | | | | | | Eviction tuning to help improve the workload
| | * | WT-2987 Fix a bug where opening a cursor on an incomplete table drops core ↵Keith Bostic2016-10-242-12/+73
| | | | | | | | | | | | | | | | (#3103)
| | * | WT-2904 Fix a bug where the reported checkpoint size could be many times ↵Keith Bostic2016-10-242-5/+34
| | | | | | | | | | | | | | | | | | | | | | | | | | | | data size (#3102) Correct the rolling checkpoint size for the current checkpoint's root page size, it shouldn't be included because it's an allocation that's not part of the next checkpoint.
| | * | WT-2988 __wt_epoch potentially returns garbage values. (#3104)Keith Bostic2016-10-221-0/+9
| | | |
| | * | WT-2880 Add Zstandard compression support (#3075)Keith Bostic2016-10-2129-184/+905
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Fix a bug found by inspection in LZ4 code: we're going to offset the destination buffer by sizeof(LZ4_PREFIX), so we need to offset the destination buffer length by the same amount. * Prettiness pass through the snappy driver so it and the zstd driver look the same, minor cleanup in zlib. * Add the compression_level configuration option to the zstd extension initialization function so it's possible to set the compression level from an application. * Fix a bug in zlib raw compression: the destination buffer size (dst_len), can be smaller than the target page size (page_max), use the smaller of the two values to set the target compression size. * The zlib raw compression function could return without calling deflateEnd on its z_stream structures, potentially leaking memory and scratch buffers. * If the default reserved bytes for zlib raw compression isn't sufficient, we fail on compression of what might be very large blocks. We don't have information on how many bytes need to be reserved in order to know the final deflate() will succeed, and the default value was experimentally derived, for all we know there are workloads where the default will fail a lot. Add a fallback before failing hard, try with 2x the default reserved space.
| | * | WT-2985 checkpoint core dump (#3100)Keith Bostic2016-10-202-44/+93
| | | | | | | | | | | | | | | | | | | | | | | | * Checkpoint must not skip writing a leaf page that's never been written before. * Split out the code to make a tree dirty: checkpoint needs it, and it's relatively expensive to dirty a page.
| | * | WT-2976 Add a statistic tracking how long app threads spend reading and ↵Alex Gorrod2016-10-186-201/+250
| | | | | | | | | | | | | | | | writing (#3096)
| | * | WT-2977 Remove stash and check code from LSM test (#3097)David Hows2016-10-171-18/+1
| | | |
| | * | WT-2974 lint (#3095)Keith Bostic2016-10-176-68/+60
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | __evict_stat_walk(), __wt_curstat_cache_walk(), query_docs() don't return error values, switch to void declarations. __evict_stat_walk() unused variable, bytes_inmem. WT_CURSOR.{get_key,get_value} and pthread_join can all return errors, assert they don't fail. KNF, whitespace Update spelling list. Add a new test utility macro, testutil_assertfmt(), so it's possible to assert with more expansive error messages.
| | * | WT-1592 Add per-dhandle current cache usage statistics (#3062)Alex Gorrod2016-10-1428-147/+752
| | | | | | | | | | | | Exposed via a new 'cache_walk' statistics configuration option.
| | * | WT-2403 Remove custom_die from new test.Michael Cahill2016-10-141-1/+0
| | | |
| | * | WT-2403 Add next_random to LSM cursors (#2887)David Hows2016-10-1410-88/+529
| | | |
| | * | WT-2955 Add statistics tracking the amount of time threads spend waiting for ↵Keith Bostic2016-10-1315-258/+531
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | high level locks (#3086) * WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks Sort the statistics categories so it's easier to find stuff, no real change. * Add counters and usec wait times to long-term locks (currently the checkpoint, handle-list, metadata, schema and table locks). * mutex.i:295:26: error: conversion to int64_t {aka long int} from long unsigned int may change the sign of the result [-Werror=sign-conversion] [t->slot_usecs] += WT_TIMEDIFF_US(leave, enter); * Rename the lock statistics so they group together. Split lock wait times between internal and application threads. * Separate the connection's dummy session initialization out into its own function, that way it's clear what we're doing. * The session's connection statistics are fixed when the session ID is allocated, so we can cache a pointer to them and avoid u_int divisions (which are currently about the slowest thing you can do on a modern architecture). * A slightly different change: instead of caching a reference to the connection statistics, cache the offset into the array of statistics pointers, that way we can avoid the integer division when updating almost all statistics. * Review comments: Add comments describing the use of statistics array offsets in lock tracking. Rename WT_STATS_FIELD_TO_SLOT to WT_STATS_FIELD_TO_OFFSET. Whitespace cleanup. * __wt_cache_create() doesn't need to call __wt_cache_destroy() explicitly, if the connection open fails at any point, __wt_cache_destroy() will be called as part of that cleanup. * Append the suffix "_off" to the spinlock structure statistics field names, clarify they're offsets into the statistics structures.
| | * | WT-2965 Remove sleep and retry loop from __evict_exclusive (#3091)David Hows2016-10-121-11/+2
| | | |