summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Implement DEBUG_SYNC multiple signal firing capabilitybb-10.6-vicentiu-debug_syncVicențiu Ciorbaru2021-09-293-13/+37
| | | | | | | One can now do: set DEBUG_SYNC='... SIGNAL s1,s2,s3...' Multiple signals can be fired, they need to be split by commas.
* Extend Binary_string::strstr to also take in a const char pointerVicențiu Ciorbaru2021-09-292-12/+17
| | | | | One shouldn't have to instantiate a Binary_string every time a strstr call is needed.
* Revert "Fixed debug_sync timeout in deadlock_drop_table"Vicențiu Ciorbaru2021-09-296-30/+6
| | | | This reverts commit 93f5d40656e3faa6cac9fe66934f6d8f3aa15d98.
* debug_sync: Implement NO_CLEAR_EVENT syntaxVicențiu Ciorbaru2021-09-293-2/+43
| | | | | When waiting on a signal, NO_CLEAR_EVENT allows one to not clear the signal, effectively allowing other threads to wait for the same signal.
* Implement multiple-signal debug_syncVicențiu Ciorbaru2021-09-285-44/+156
| | | | | | | | | | | | | The patch is inspired from MySQL. Instead of using a single String to hold the current active debug_sync signal, use a Hash_set to store LEX_STRINGS. This patch ensures that a signal can not be lost, by being overwritten by another thread via set DEBUG_SYNC = '... SIGNAL ...'; All signals are kepts "alive" until they are consumed by a wait event. Follow-up work needed: Port the additional syntax that allows one to set multiple signals and also conditionally deactivate signals when waiting.
* Initialize the Hash_set during creationVicențiu Ciorbaru2021-09-281-0/+2
| | | | | If the Hash_set is not initialized, one can not call find() on it before at least one element has been inserted into it.
* Silence gcc-11 warningsVicențiu Ciorbaru2021-09-282-2/+3
|
* MTR: loops should divide milliseconds by millisecondsst-10.6-vicentiuVicențiu Ciorbaru2021-09-281-1/+1
| | | | | timeout is in seconds, sleeptime is in miliseconds. Otherwise we sleep for 10 times longer than the timeout.
* MDEV-26467: Actually use spinloop on block_lockMarko Mäkelä2021-09-282-1/+17
| | | | | In commit 277ba134ad1c994bda50de574a87a06a071fbecb we accidentally omitted this.
* MDEV-26467: Universally implement spin loopMarko Mäkelä2021-09-282-58/+104
| | | | | | | Previously, neither our wrapper of Microsoft Windows SRWLOCK nor the futex-less implementation SUX_LOCK_GENERIC supported spin loops. This was suggested by Vladislav Vaintroub.
* MDEV-26467: More cache friendlinessMarko Mäkelä2021-09-281-29/+72
| | | | | | | | | | | | | | | | | | | | | | | | | srw_mutex_impl<bool>::wait_and_lock(): In commit a73eedbf3fabd19ca7183b738056c30e3f7bbe35 we introduced an std::atomic::fetch_or() in a loop. Alas, on the IA-32 and AMD64, that was being translated into a loop around LOCK CMPXCHG. To avoid a nested loop, it is better to explicitly invoke std::atomic::compare_exchange_weak() in the loop, but only if the attempt has a chance to succeed (the HOLDER flag is not set). It is even more efficient to use LOCK BTS, but contemporary compilers fail to translate std::atomic::fetch_or(x) & x into that when x is a single-bit constant. On GCC-compatible compilers, we will use inline assembler to achieve that. On other ISA than IA-32 and AMD64, we will continue to use std::atomic::fetch_or(). ssux_lock_impl<spinloop>::rd_wait(): Use rd_lock_try(). A loop around std::atomic::compare_exchange_weak() should be cheaper than fetch_add(), fetch_sub() and a wakeup system call. These deficiencies were pointed out and the use of LOCK BTS was suggested by Thiago Macieira.
* MDEV-26669 Add MY_COLLATION_HANDLER functions min_str() and max_str()bb-10.6-bar-MDEV-26669Alexander Barkov2021-09-2723-87/+683
|
* MDEV-26631 InnoDB fails to fetch page from doublewrite bufferbb-10.6-MDEV-26631Thirunarayanan Balathandayuthapani2021-09-243-8/+27
| | | | | | | | | | | | | | Problem: ======== InnoDB fails to fetch the page0 from dblwr if page0 is corrupted.In that case, InnoDB defers the tablespace and doesn't find the INIT_PAGE redo log record for page0 and it leads to failure. Solution: ========= InnoDB should recover page0 from dblwr if space_id can be found for deferred tablespace.
* Merge 10.5 into 10.6Marko Mäkelä2021-09-2462-967/+1345
|\
| * Merge 10.4 into 10.5Marko Mäkelä2021-09-248-23/+37
| |\
| | * Merge 10.3 into 10.4Marko Mäkelä2021-09-247-37/+34
| | |\
| | | * MDEV-26672 innodb_undo_log_truncate may reset transaction ID sequenceMarko Mäkelä2021-09-248-37/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | trx_rseg_header_create(): Add a parameter for the value that is to be written to TRX_RSEG_MAX_TRX_ID. If we omit this write, then the updated test innodb.undo_truncate will fail for the 4k, 8k, 16k page sizes. This was broken ever since commit 947efe17ed8188ca4feef6deb0c2831a246b5c8f (MDEV-15158) removed the writes of transaction identifiers to the TRX_SYS page. srv_do_purge(): Truncate undo tablespaces also during slow shutdown (innodb_fast_shutdown=0). Thanks to Krunal Bauskar for noticing this problem.
| | * | Update wsrep-lib submoduleJan Lindström2021-09-241-0/+0
| | | |
| * | | Merge 10.4 into 10.5Marko Mäkelä2021-09-2438-603/+768
| |\ \ \ | | |/ /
| | * | MDEV-26566 : galera.galera_var_cluster_address MTR failed: InnoDB: Assertion ↵Jan Lindström2021-09-235-11/+220
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | failure in file row0ins.cc line 3206 Actual problem was that we tried to calculate persistent statistics to wsrep_schema tables in this case wsrep_streaming_log. These tables should not have persistent statistics. Therefore, in table creation tables should be created with STATS_PERSISTENT=0 table option. During rolling-upgrade tables naturally already exists, thus we need to alter them to contain STATS_PERSISTENT=0 table option.
| | * | MDEV-26571 : galera_sr.GCF-627 MTR failed: Result length mismatchJan Lindström2021-09-232-12/+8
| | | | | | | | | | | | | | | | | | | | Test changes only: do not output mysql.wsrep_streaming_log contents.
| | * | Merge 10.3 into 10.4Marko Mäkelä2021-09-2238-689/+738
| | |\ \ | | | |/
| | | * Merge 10.2 into 10.3Marko Mäkelä2021-09-2227-575/+311
| | | |\
| | | | * MDEV-26450: Corruption due to innodb_undo_log_truncatebb-10.2-MDEV-26450Marko Mäkelä2021-09-229-123/+219
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | At least since commit 055a3334adc004bd3a897990c2f93178e6bb5f90 (MDEV-13564) the undo log truncation in InnoDB did not work correctly. The main issue is that during the execution of trx_purge_truncate_history() some pages of the newly truncated undo tablespace could be discarded. fsp_try_extend_data_file(): Apply the peculiar rounding of fil_space_t::size_in_header only to the system tablespace, whose size can be expressed in megabytes in a configuration parameter. Other files may freely grow by a number of pages. fseg_alloc_free_page_low(): Do allow the extension of undo tablespaces, and mention the file name in the error message. mtr_t::commit_shrink(): Implement crash-safe shrinking of a tablespace file. First, durably write the log, then shrink the file, and finally release the page latches of the rebuilt tablespace. Refactored from trx_purge_truncate_history(). log_write_and_flush_prepare(), log_write_and_flush(): New functions to durably write log during mtr_t::commit_shrink().
| | | | * Silence a warning about unused Bison labelMarko Mäkelä2021-09-221-0/+3
| | | | |
| | | | * MDEV-26545 Spider does not correctly handle UDF and stored function in where ↵Daniel Ye2021-09-225-1/+418
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | conds - Handle stored function conditions correctly, with the same logic as with UDFs. - When running queries on Spider SE, by default, we do not push down WHERE conditions containing usage of UDFs/stored functions to remote data nodes, unless the user demands (by setting spider_use_pushdown_udf).
| | | | * MDEV-26441: Linux-dependent construct in SST scriptsbb-10.2-MDEV-26441-galeraJulius Goryavsky2021-09-203-3/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | SST scripts currently use Linux-specific construction to create a temporary directory if the path prefix for that directory is specified by the user. This does not work with FreeBSD. This commit adds support for FreeBSD. No separate test required.
| | | | * MDEV-26636: InnoDB defragmentation statistics cause races on TEMPORARY TABLEMarko Mäkelä2021-09-183-116/+62
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | btr_defragment_save_defrag_stats_if_needed(): Do not save defragmentation statistics for temporary tables. They are exempt of defragmentation anyway (ha_innobase::optimize() never invokes defragmentation for them), and the user-visible names are not available inside InnoDB. Furthermore, InnoDB assumes that temporary tables are never accessed by other threads than the one that handles the session with which the temporary table is associated with. Furthermore, we simplify the test innodb.innodb_defrag_stats and include a test case that demonstrates that defragmentation statistics are no longer being saved for temporary tables.
| | | | * MDEV-15675 encryption.innodb_encryption failed in buildbot with timeoutbb-10.2-MDEV-15675Thirunarayanan Balathandayuthapani2021-09-172-3/+5
| | | | | | | | | | | | | | | | | | | | | | | | | Test case fail to include undo tablespace while waiting for the encryption thread to encrypt all existing tablespace
| | | | * Give less memory to get reliable error.Oleksandr Byelkin2021-09-162-3/+3
| | | | |
| | | | * MDEV-26622: man mysqldump - insert-ignore not insert-intoDaniel Black2021-09-161-5/+5
| | | | | | | | | | | | | | | | | | | | Thanks Karl Levik
| | | | * MDEV-26574 An improper locking bug due to unreleased lock in the ds_xbstream.ccVladislav Vaintroub2021-09-151-3/+7
| | | | | | | | | | | | | | | | | | | | release lock in all as cases n xbstream_open, also fix the case where malloc would return NULL.
| | | | * MDEV-26573 : A static analyzer warning about ds_archive.ccVladislav Vaintroub2021-09-154-318/+0
| | | | | | | | | | | | | | | | | | | | | | | | | This file had not been compiled for long time. Remove this from the tree.
| | | | * MDEV-25702 Auxiliary FTS table evicts during optimize tableThirunarayanan Balathandayuthapani2021-09-131-1/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | InnoDB could evict the fts auxiliary table in row_fts_merge_insert(). So bulk insert could be dealing with garbage FTS auxiliary table.Patch should delay closing the table in row_fts_merge_insert().
| | | * | MDEV-26545 Spider does not correctly handle UDF and stored function in where ↵Daniel Ye2021-09-227-7/+429
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | conds - Handle stored function conditions correctly, with the same logic as with UDFs. - When running queries on Spider SE, by default, we do not push down WHERE conditions containing usage of UDFs/stored functions to remote data nodes, unless the user demands (by setting spider_use_pushdown_udf). - Disable direct update/delete when a udf condition is skipped.
| | | * | MDEV-26521 Remove mdev-504.testVladislav Vaintroub2021-09-212-104/+0
| | | | |
| | | * | MDEV-23506 mariadb-connector-c-devel package from standard RHEL 8 repo ↵bb-10.3-abychkoAlexey Bychko2021-09-211-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | conflicts with MariaDB's packages added alternative name for MariaDB-devel package to replace mariadb-connector-c-devel from RHEL 8 distribution. this patch is for 10.3+ on RHEL/Centos 8
| | | * | Fix Connect build with MSVC+NinjaVladislav Vaintroub2021-09-111-0/+1
| | | | |
| | * | | Fixed random failure of main.truncate_notembeddedMonty2021-09-212-2/+4
| | | | | | | | | | | | | | | | | | | | | | | | | The test depends on how the server allocates memory and may fail randomly. Fixed by accepting that TRUNCATE may work in some cases (happened to me)
| | * | | Updated main.alias test to fix max_lengthMonty2021-09-212-7/+7
| | | | | | | | | | | | | | | | | | | | | | | | | The test will work after libmariadb has been updated to return correct max_length for prepared statements
| | * | | Fixed max length calculation for embedded serverMonty2021-09-211-5/+7
| | | | | | | | | | | | | | | | | | | | | | | | | The old code did not take into account unsigned numbers when calculating max_lengths of fields.
| * | | | MDEV-26445 innodb_undo_log_truncate is unnecessarily slowMarko Mäkelä2021-09-248-279/+330
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | trx_purge_truncate_history(): Do not force a write of the undo tablespace that is being truncated. Instead, prevent page writes by acquiring an exclusive latch on all dirty pages of the tablespace. fseg_create(): Relax an assertion that could fail if a dirty undo page is being initialized during undo tablespace truncation (and trx_purge_truncate_history() already acquired an exclusive latch on it). fsp_page_create(): If we are truncating a tablespace, try to reuse a page that we may have already latched exclusively (because it was in buf_pool.flush_list). To some extent, this helps the test innodb.undo_truncate,16k to avoid running out of buffer pool. mtr_t::commit_shrink(): Mark as clean all pages that are outside the new bounds of the tablespace, and only add the newly reinitialized pages to the buf_pool.flush_list. buf_page_create(): Do not unnecessarily invoke change buffer merge on undo tablespaces. buf_page_t::clear_oldest_modification(bool temporary): Move some assertions to the caller buf_page_write_complete(). innodb.undo_truncate: Use a bigger innodb_buffer_pool_size=24M. On my system, it would otherwise hang 1 out of 1547 attempts (on the 40th repeat of innodb.undo_truncate,16k). Other page sizes were not affected.
| * | | | MDEV-26450: Corruption due to innodb_undo_log_truncateMarko Mäkelä2021-09-249-119/+173
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | At least since commit 055a3334adc004bd3a897990c2f93178e6bb5f90 (MDEV-13564) the undo log truncation in InnoDB did not work correctly. The main issue is that during the execution of trx_purge_truncate_history() some pages of the newly truncated undo tablespace could be discarded. This is improved from commit 1cb218c37cc3fe01a1ff2fe9b1cbfb591e90d5ce which was applied to earlier-version branches. fsp_try_extend_data_file(): Apply the peculiar rounding of fil_space_t::size_in_header only to the system tablespace, whose size can be expressed in megabytes in a configuration parameter. Other files may freely grow by a number of pages. fseg_alloc_free_page_low(): Do allow the extension of undo tablespaces, and mention the file name in the error message. mtr_t::commit_shrink(): Implement crash-safe shrinking of a tablespace: (1) durably write the log (2) release the page latches of the rebuilt tablespace (3) release the mutexes (4) truncate the file (5) release the tablespace latch This is refactored from trx_purge_truncate_history(). log_write_and_flush_prepare(), log_write_and_flush(): New functions to durably write log during mtr_t::commit_shrink().
| * | | | MDEV-26626 fixup: Do not advance checkpoint during startupMarko Mäkelä2021-09-241-1/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | While the redo log is being resized in srv_start(), we must not write checkpoint information to the old log. Thanks to Matthias Leich for noticing this.
| * | | | MDEV-24629 mariadb-connector-c-config conflicts with MariaDB's ↵bb-10.5-MDEV-24629Alexey Bychko2021-09-221-0/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | MariaDB-common-10.5.8-1.fc32.x86_64.rpm this fix is adding alternative name to MariaDB-common on Fedora. the fix is placed outside of IF/ELSEIF blocks to do not overwrite existing one for Fedora.
| * | | | MDEV-21286: bison warnings on ubuntu 20.04 on deprecated directive in ↵Anel Husakovic2021-09-222-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | sql_yacc.yy Results with ``` %define api.pure /* We have threads */ ``` in `<build-dir>/sql/[yy_mariadb|yy_oracle].yy` files. Reviewed by: wlad@mariadb.com
| * | | | Remove mention of FreenodeIan Gilfillan2021-09-222-5/+3
| | | | |
| * | | | MDEV-26657 : Initialize some fields in create_background_thd()Vladislav Vaintroub2021-09-211-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | | Avoid reading uninitialized memory by thd_get_error_context_description(). Note, that THD::real_id can't be initialized at this stage, so it will be zeroed.
* | | | | MDEV-26467 fixup: Fix cmake -DWITH_UNIT_TESTS=ON for SUX_LOCK_GENERICMarko Mäkelä2021-09-241-0/+8
| | | | |
* | | | | MDEV-25919 fixup: Acquire MDL also in defragmentationMarko Mäkelä2021-09-183-23/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dict_stats_process_entry_from_defrag_pool(): Acquire MDL on the table for which we are invoking dict_stats_save_defrag_stats(), to avoid any race condition with DROP TABLE or similar operations.