summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* MDEV-26467: Actually use spinloop on block_lockbb-10.6-MDEV-26467-2Marko Mäkelä2021-09-282-1/+17
|
* MDEV-26467: Universally implement spin loopMarko Mäkelä2021-09-282-58/+104
| | | | | Previously, neither our wrapper of Microsoft Windows SRWLOCK nor the futex-less implementation SUX_LOCK_GENERIC supported spin loops.
* fixup! 5ed6c49e84adba6a0fdace8103596b7a90c45691 non-x86 friendlinessMarko Mäkelä2021-09-281-0/+27
| | | | | | | Let us prefer fetch_or() to compare_exchange_weak() on ISAs that can support it efficiently. Even on IA-32 and AMD64 it would be possible to emit LOCK BTS, but unfortunately the contemporary compilers do not support that.
* MDEV-26467: More NUMA friendlinessMarko Mäkelä2021-09-281-40/+22
| | | | | | | | | | | | | | | | srw_mutex_impl<bool>::wait_and_lock(): In commit a73eedbf3fabd19ca7183b738056c30e3f7bbe35 we introduced an std::atomic::fetch_or() in a loop. Alas, on the IA-32 and AMD64, that can only be implemented by a loop around LOCK CMPXCHG. To avoid a nested loop, it is better to explicitly invoke std::atomic::compare_exchange_weak() in the loop, but only if the attempt has a chance to succeed (the HOLDER flag is not set). ssux_lock_impl<spinloop>::rd_wait(): Use rd_lock_try(). A loop around std::atomic::compare_exchange_weak() should be cheaper than fetch_add(), fetch_sub() and a wakeup system call. These deficiencies were pointed out by Thiago Macieira.
* Merge 10.5 into 10.6Marko Mäkelä2021-09-2462-967/+1345
|\
| * Merge 10.4 into 10.5Marko Mäkelä2021-09-248-23/+37
| |\
| | * Merge 10.3 into 10.4Marko Mäkelä2021-09-247-37/+34
| | |\
| | | * MDEV-26672 innodb_undo_log_truncate may reset transaction ID sequenceMarko Mäkelä2021-09-248-37/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | trx_rseg_header_create(): Add a parameter for the value that is to be written to TRX_RSEG_MAX_TRX_ID. If we omit this write, then the updated test innodb.undo_truncate will fail for the 4k, 8k, 16k page sizes. This was broken ever since commit 947efe17ed8188ca4feef6deb0c2831a246b5c8f (MDEV-15158) removed the writes of transaction identifiers to the TRX_SYS page. srv_do_purge(): Truncate undo tablespaces also during slow shutdown (innodb_fast_shutdown=0). Thanks to Krunal Bauskar for noticing this problem.
| | * | Update wsrep-lib submoduleJan Lindström2021-09-241-0/+0
| | | |
| * | | Merge 10.4 into 10.5Marko Mäkelä2021-09-2438-603/+768
| |\ \ \ | | |/ /
| | * | MDEV-26566 : galera.galera_var_cluster_address MTR failed: InnoDB: Assertion ↵Jan Lindström2021-09-235-11/+220
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | failure in file row0ins.cc line 3206 Actual problem was that we tried to calculate persistent statistics to wsrep_schema tables in this case wsrep_streaming_log. These tables should not have persistent statistics. Therefore, in table creation tables should be created with STATS_PERSISTENT=0 table option. During rolling-upgrade tables naturally already exists, thus we need to alter them to contain STATS_PERSISTENT=0 table option.
| | * | MDEV-26571 : galera_sr.GCF-627 MTR failed: Result length mismatchJan Lindström2021-09-232-12/+8
| | | | | | | | | | | | | | | | | | | | Test changes only: do not output mysql.wsrep_streaming_log contents.
| | * | Merge 10.3 into 10.4Marko Mäkelä2021-09-2238-689/+738
| | |\ \ | | | |/
| | | * Merge 10.2 into 10.3Marko Mäkelä2021-09-2227-575/+311
| | | |\
| | | | * MDEV-26450: Corruption due to innodb_undo_log_truncatebb-10.2-MDEV-26450Marko Mäkelä2021-09-229-123/+219
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | At least since commit 055a3334adc004bd3a897990c2f93178e6bb5f90 (MDEV-13564) the undo log truncation in InnoDB did not work correctly. The main issue is that during the execution of trx_purge_truncate_history() some pages of the newly truncated undo tablespace could be discarded. fsp_try_extend_data_file(): Apply the peculiar rounding of fil_space_t::size_in_header only to the system tablespace, whose size can be expressed in megabytes in a configuration parameter. Other files may freely grow by a number of pages. fseg_alloc_free_page_low(): Do allow the extension of undo tablespaces, and mention the file name in the error message. mtr_t::commit_shrink(): Implement crash-safe shrinking of a tablespace file. First, durably write the log, then shrink the file, and finally release the page latches of the rebuilt tablespace. Refactored from trx_purge_truncate_history(). log_write_and_flush_prepare(), log_write_and_flush(): New functions to durably write log during mtr_t::commit_shrink().
| | | | * Silence a warning about unused Bison labelMarko Mäkelä2021-09-221-0/+3
| | | | |
| | | | * MDEV-26545 Spider does not correctly handle UDF and stored function in where ↵Daniel Ye2021-09-225-1/+418
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | conds - Handle stored function conditions correctly, with the same logic as with UDFs. - When running queries on Spider SE, by default, we do not push down WHERE conditions containing usage of UDFs/stored functions to remote data nodes, unless the user demands (by setting spider_use_pushdown_udf).
| | | | * MDEV-26441: Linux-dependent construct in SST scriptsbb-10.2-MDEV-26441-galeraJulius Goryavsky2021-09-203-3/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | SST scripts currently use Linux-specific construction to create a temporary directory if the path prefix for that directory is specified by the user. This does not work with FreeBSD. This commit adds support for FreeBSD. No separate test required.
| | | | * MDEV-26636: InnoDB defragmentation statistics cause races on TEMPORARY TABLEMarko Mäkelä2021-09-183-116/+62
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | btr_defragment_save_defrag_stats_if_needed(): Do not save defragmentation statistics for temporary tables. They are exempt of defragmentation anyway (ha_innobase::optimize() never invokes defragmentation for them), and the user-visible names are not available inside InnoDB. Furthermore, InnoDB assumes that temporary tables are never accessed by other threads than the one that handles the session with which the temporary table is associated with. Furthermore, we simplify the test innodb.innodb_defrag_stats and include a test case that demonstrates that defragmentation statistics are no longer being saved for temporary tables.
| | | | * MDEV-15675 encryption.innodb_encryption failed in buildbot with timeoutbb-10.2-MDEV-15675Thirunarayanan Balathandayuthapani2021-09-172-3/+5
| | | | | | | | | | | | | | | | | | | | | | | | | Test case fail to include undo tablespace while waiting for the encryption thread to encrypt all existing tablespace
| | | | * Give less memory to get reliable error.Oleksandr Byelkin2021-09-162-3/+3
| | | | |
| | | | * MDEV-26622: man mysqldump - insert-ignore not insert-intoDaniel Black2021-09-161-5/+5
| | | | | | | | | | | | | | | | | | | | Thanks Karl Levik
| | | | * MDEV-26574 An improper locking bug due to unreleased lock in the ds_xbstream.ccVladislav Vaintroub2021-09-151-3/+7
| | | | | | | | | | | | | | | | | | | | release lock in all as cases n xbstream_open, also fix the case where malloc would return NULL.
| | | | * MDEV-26573 : A static analyzer warning about ds_archive.ccVladislav Vaintroub2021-09-154-318/+0
| | | | | | | | | | | | | | | | | | | | | | | | | This file had not been compiled for long time. Remove this from the tree.
| | | | * MDEV-25702 Auxiliary FTS table evicts during optimize tableThirunarayanan Balathandayuthapani2021-09-131-1/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | InnoDB could evict the fts auxiliary table in row_fts_merge_insert(). So bulk insert could be dealing with garbage FTS auxiliary table.Patch should delay closing the table in row_fts_merge_insert().
| | | * | MDEV-26545 Spider does not correctly handle UDF and stored function in where ↵Daniel Ye2021-09-227-7/+429
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | conds - Handle stored function conditions correctly, with the same logic as with UDFs. - When running queries on Spider SE, by default, we do not push down WHERE conditions containing usage of UDFs/stored functions to remote data nodes, unless the user demands (by setting spider_use_pushdown_udf). - Disable direct update/delete when a udf condition is skipped.
| | | * | MDEV-26521 Remove mdev-504.testVladislav Vaintroub2021-09-212-104/+0
| | | | |
| | | * | MDEV-23506 mariadb-connector-c-devel package from standard RHEL 8 repo ↵bb-10.3-abychkoAlexey Bychko2021-09-211-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | conflicts with MariaDB's packages added alternative name for MariaDB-devel package to replace mariadb-connector-c-devel from RHEL 8 distribution. this patch is for 10.3+ on RHEL/Centos 8
| | | * | Fix Connect build with MSVC+NinjaVladislav Vaintroub2021-09-111-0/+1
| | | | |
| | * | | Fixed random failure of main.truncate_notembeddedMonty2021-09-212-2/+4
| | | | | | | | | | | | | | | | | | | | | | | | | The test depends on how the server allocates memory and may fail randomly. Fixed by accepting that TRUNCATE may work in some cases (happened to me)
| | * | | Updated main.alias test to fix max_lengthMonty2021-09-212-7/+7
| | | | | | | | | | | | | | | | | | | | | | | | | The test will work after libmariadb has been updated to return correct max_length for prepared statements
| | * | | Fixed max length calculation for embedded serverMonty2021-09-211-5/+7
| | | | | | | | | | | | | | | | | | | | | | | | | The old code did not take into account unsigned numbers when calculating max_lengths of fields.
| * | | | MDEV-26445 innodb_undo_log_truncate is unnecessarily slowMarko Mäkelä2021-09-248-279/+330
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | trx_purge_truncate_history(): Do not force a write of the undo tablespace that is being truncated. Instead, prevent page writes by acquiring an exclusive latch on all dirty pages of the tablespace. fseg_create(): Relax an assertion that could fail if a dirty undo page is being initialized during undo tablespace truncation (and trx_purge_truncate_history() already acquired an exclusive latch on it). fsp_page_create(): If we are truncating a tablespace, try to reuse a page that we may have already latched exclusively (because it was in buf_pool.flush_list). To some extent, this helps the test innodb.undo_truncate,16k to avoid running out of buffer pool. mtr_t::commit_shrink(): Mark as clean all pages that are outside the new bounds of the tablespace, and only add the newly reinitialized pages to the buf_pool.flush_list. buf_page_create(): Do not unnecessarily invoke change buffer merge on undo tablespaces. buf_page_t::clear_oldest_modification(bool temporary): Move some assertions to the caller buf_page_write_complete(). innodb.undo_truncate: Use a bigger innodb_buffer_pool_size=24M. On my system, it would otherwise hang 1 out of 1547 attempts (on the 40th repeat of innodb.undo_truncate,16k). Other page sizes were not affected.
| * | | | MDEV-26450: Corruption due to innodb_undo_log_truncateMarko Mäkelä2021-09-249-119/+173
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | At least since commit 055a3334adc004bd3a897990c2f93178e6bb5f90 (MDEV-13564) the undo log truncation in InnoDB did not work correctly. The main issue is that during the execution of trx_purge_truncate_history() some pages of the newly truncated undo tablespace could be discarded. This is improved from commit 1cb218c37cc3fe01a1ff2fe9b1cbfb591e90d5ce which was applied to earlier-version branches. fsp_try_extend_data_file(): Apply the peculiar rounding of fil_space_t::size_in_header only to the system tablespace, whose size can be expressed in megabytes in a configuration parameter. Other files may freely grow by a number of pages. fseg_alloc_free_page_low(): Do allow the extension of undo tablespaces, and mention the file name in the error message. mtr_t::commit_shrink(): Implement crash-safe shrinking of a tablespace: (1) durably write the log (2) release the page latches of the rebuilt tablespace (3) release the mutexes (4) truncate the file (5) release the tablespace latch This is refactored from trx_purge_truncate_history(). log_write_and_flush_prepare(), log_write_and_flush(): New functions to durably write log during mtr_t::commit_shrink().
| * | | | MDEV-26626 fixup: Do not advance checkpoint during startupMarko Mäkelä2021-09-241-1/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | While the redo log is being resized in srv_start(), we must not write checkpoint information to the old log. Thanks to Matthias Leich for noticing this.
| * | | | MDEV-24629 mariadb-connector-c-config conflicts with MariaDB's ↵bb-10.5-MDEV-24629Alexey Bychko2021-09-221-0/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | MariaDB-common-10.5.8-1.fc32.x86_64.rpm this fix is adding alternative name to MariaDB-common on Fedora. the fix is placed outside of IF/ELSEIF blocks to do not overwrite existing one for Fedora.
| * | | | MDEV-21286: bison warnings on ubuntu 20.04 on deprecated directive in ↵Anel Husakovic2021-09-222-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | sql_yacc.yy Results with ``` %define api.pure /* We have threads */ ``` in `<build-dir>/sql/[yy_mariadb|yy_oracle].yy` files. Reviewed by: wlad@mariadb.com
| * | | | Remove mention of FreenodeIan Gilfillan2021-09-222-5/+3
| | | | |
| * | | | MDEV-26657 : Initialize some fields in create_background_thd()Vladislav Vaintroub2021-09-211-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | | Avoid reading uninitialized memory by thd_get_error_context_description(). Note, that THD::real_id can't be initialized at this stage, so it will be zeroed.
* | | | | MDEV-26467 fixup: Fix cmake -DWITH_UNIT_TESTS=ON for SUX_LOCK_GENERICMarko Mäkelä2021-09-241-0/+8
| | | | |
* | | | | MDEV-25919 fixup: Acquire MDL also in defragmentationMarko Mäkelä2021-09-183-23/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dict_stats_process_entry_from_defrag_pool(): Acquire MDL on the table for which we are invoking dict_stats_save_defrag_stats(), to avoid any race condition with DROP TABLE or similar operations.
* | | | | MDEV-24258 fixup: Correct a conditionMarko Mäkelä2021-09-181-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | dict_stats_process_entry_from_defrag_pool(): Restore a condition as it was before commit 82b7c561b7919fa24e3d24b3f04a16046e24374f.
* | | | | Merge 10.5 into 10.6Marko Mäkelä2021-09-1712-32/+137
|\ \ \ \ \ | |/ / / /
| * | | | Merge 10.4 into 10.5Marko Mäkelä2021-09-1713-32/+140
| |\ \ \ \ | | |/ / /
| | * | | Fixed alias.test to also works with psMonty2021-09-172-7/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The issue is that max_length for prepared statements are different from normal queries, which can optimize the max_length based on the result length.
| | * | | MDEV-19950 addendum: galera_ssl_upgrade removed from the list of disabled ↵bb-10.4-MDEV-19950-addendum-galeraJulius Goryavsky2021-09-172-1/+3
| | | | | | | | | | | | | | | | | | | | tests and adapted for 10.4+
| | * | | MDEV-26053 : TRUNCATE on table with Foreign Key Constraint no longer ↵bb-10.4-truncateJan Lindström2021-09-176-23/+102
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | replicated to other nodes Problem was that there was extra condition !thd->lex->no_write_to_binlog before call to begin TOI. It seems that this variable is not initialized. TRUNCATE does not support [NO_WRITE_TO_BINLOG | LOCAL] keywords, thus we should not check this condition. All this was hidden in a macro, so I decided to remove those macros that were used only a few places with actual function calls.
| | * | | MDEV-26621 assertion failue "index->table->persistent_autoinc" in ↵bb-10.4-kevgsEugene Kosov2021-09-163-1/+28
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | /storage/innobase/btr/btr0btr.cc during IMPORT dict_index_t::clear_instant_alter(): when searhing for an AUTO_INCREMENT column don't skip the beginning of the list because the field can be at the beginning of the list
* | | | | MDEV-26623 Possible race condition between statistics and bulk insertMarko Mäkelä2021-09-175-512/+424
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When computing statistics, let us play it safe and check whether an insert into an empty table is in progress, once we have acquired the root page latch. If yes, let us pretend that the table is empty, just like MVCC reads would do. It is unlikely that this race condition could lead into any crashes before MDEV-24621, because the index tree structure should be protected by the page latches. But, at least we can avoid some busy work and return earlier. As part of this, some code that is only used for statistics calculation is being moved into static functions in that compilation unit.
* | | | | Cleanup: Make btr_root_block_get() more robustMarko Mäkelä2021-09-174-20/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | btr_root_block_get(): Check for index->page == FIL_NULL. btr_root_get(): Declare static. Other callers can invoke btr_root_block_get() directly. btr_get_size(): Remove conditions that are checked in btr_root_block_get().