summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* MDEV-26623 Possible race condition between statistics and bulk insertbb-10.6-MDEV-26623Marko Mäkelä2021-09-175-512/+424
| | | | | | | | | | | | | | | When computing statistics, let us play it safe and check whether an insert into an empty table is in progress, once we have acquired the root page latch. If yes, let us pretend that the table is empty, just like MVCC reads would do. It is unlikely that this race condition could lead into any crashes before MDEV-24621, because the index tree structure should be protected by the page latches. But, at least we can avoid some busy work and return earlier. As part of this, some code that is only used for statistics calculation is being moved into static functions in that compilation unit.
* Cleanup: Make btr_root_block_get() more robustMarko Mäkelä2021-09-174-20/+9
| | | | | | | | | | btr_root_block_get(): Check for index->page == FIL_NULL. btr_root_get(): Declare static. Other callers can invoke btr_root_block_get() directly. btr_get_size(): Remove conditions that are checked in btr_root_block_get().
* MDEV-26356 fixup: integer type mismatch on 32-bitMarko Mäkelä2021-09-171-1/+1
|
* MDEV-26356 fixup: Adjust innodb_max_purge_lag_waitMarko Mäkelä2021-09-161-0/+8
| | | | | | | | innodb_max_purge_lag_wait_update(): To align with purge_coordinator_state::refresh(), we must trigger a page flush batch if the last log checkpoint is too old. This was caught in a hang of the test innodb_gis.rtree_compress.
* Merge 10.5 into 10.6Marko Mäkelä2021-09-1633-85/+243
|\
| * MDEV-26626 InnoDB fails to advance the log checkpointMarko Mäkelä2021-09-161-0/+9
| | | | | | | | | | | | | | | | | | | | buf_flush_page_cleaner(): Always try to advance the log checkpoint, even when no pages were flushed during the latest batch. Maybe, since the previous batch, there was an LRU flush that removed the last dirty pages. Failure to advance the log checkpoint will cause unnecessary work in Mariabackup and on crash recovery.
| * Updated rocksdb test resultMonty2021-09-163-21/+21
| | | | | | | | | | | | | | | | | | This was required as I added a new error code to my_base.h and rocksdb is adding it's own errors after the last official one Updated result file also for index_merge_rocksdb2. This is a big test and we have probably not before noticed that some optimizer changes caused a difference.
| * Fixed bug in aria_chk that overwrote sort_buffer_lengthMonty2021-09-154-8/+10
| | | | | | | | | | | | | | | | This bug happens when one runs aria_chk on multiple tables. It does not affect REPAIR TABLE. aria_chk tries to optimize the sort buffer size to minimize memory usage when used with small tables. The bug was that the adjusted value was used as a base for the next table, which could cause problems.
| * Merge branch '10.4' into 10.5Monty2021-09-1514-18/+137
| |\ | | | | | | | | | Fixed also an error in suite/perfschema/t/transaction_nested_events-master.opt
| | * MDEV-23519 Protocol packet - "Original Name" info is showing alias name,Monty2021-09-144-7/+52
| | | | | | | | | | | | | | | | | | | | | | | | | | | instead of original name of the column When doing refactoring of temporary table field creation a mistake was done when copying the column name when creating internal temporary tables. For internal temporary tables we should use the original field name, not the item name (= alias).
| | * MDEV-26601: mysys - O_TMPFILE ^ O_CREATDaniel Black2021-09-141-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | Thanks to Fabian Vogt for noticing the mutual exclusions of these open flags on tmpfs caused by mariadb opening it incorrectly. As such we clear the O_CREAT flag while opening it as O_TMPFILE.
| | * MDEV-21613 Failed to open table mysql.wsrep_streaming_log for writingbb-10.4-MDEV-21613Daniele Sciascia2021-09-145-8/+73
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fix sporadic failure for MTR test galera_sr.GCF-1018B. The test sometimes fails due to an error that is logged to the error log unnecessarily. A deterministic test case (included in this patch) shows that the error is loggen when a transaction is BF aborted right before it opens the streaming log table to perform fragment removal. When that happens, the attempt to open the table fails and consequently an error is logged. There is no need to log this error, as an ER_LOCK_DEADLOCK error is returned to the client. Reviewed-by: Jan Lindström <jan.lindstrom@mariadb.com>
| * | Improve error messages from Ariatmp-10.5-montyMonty2021-09-156-7/+32
| | | | | | | | | | | | | | | | | | - Error on commit now returns HA_ERR_COMMIT_ERROR instead of HA_ERR_INTERNAL_ERROR - If checkpoint fails, it will now print out where it failed.
| * | Fixed compiler warnings in CONNECTMonty2021-09-152-3/+4
| | |
| * | Deb: Fix Gitlab-CI/Salsa-CI builds failuresOtto Kekäläinen2021-09-134-29/+32
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The debian/salsa-ci.yml used to work also on upstream MariaDB.org branches, but has recently regressed and several jobs stopped working. These fixes are necessary to get it working again. * Partially revert 8642f592 that never worked, as MariaDB 10.2 does not have a mysql.global table nor a mariadb.sys user. Those features weren't introduced until MariaDB 10.4. * Partially revert 0268b871 as we don't want ColumnStore as part of the native Debian build. It should build only when the build is triggered via autobake-deb.sh (MariaDB.org builds). * Adjust salsa-ci.yml to cope with various Stretch to Sid upgrade issues and remove the legacy mariadb-connector-c job completely as that package hasn't been around for years anymore. * Extend Lintian overrides to be otherwise Lintian clean
| * | perfschema: use correct type for left shiftsSergei Golubchik2021-09-121-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | set_item() uses 1UL << bit, so is_set_item() must do the same. This fixes sporadic perfschema.show_aggregate failures (sporadic, because `bit` is the thread id, so depending on how many tests were run before perfschema.show_aggregate it can be above or below 32).
* | | MDEV-26356 Adaptive purge scheduling based on redo log fill factorbb-10.6-MDEV-26356Marko Mäkelä2021-09-142-10/+101
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This should be equivalent to pull request #1889 by Krunal Bauskar. The existing logic in purge_coordinator_state::do_purge() activates a number of the configured innodb_purge_threads based on the history list length. Activating more purge worker tasks should shrink the history list faster. But, more purge workers will also generate more redo log, which may slow down writes by user connections. row_purge_parse_undo_rec(): Revert the work-around that was added in commit 4690442411b75ea0fc1a6aacabe767d6fb1d1f62. purge_coordinator_state: Keep track of the redo log fill factor (how big percentage of innodb_log_file_size is being occupied by log records that were generated since the latest checkpoint). If the redo log is getting full, log checkpoints will be triggered more frequently, and user threads may end up waiting in log_free_check(). We try to reduce purge-induced jitter in overall throughput by throttling down the active number of purge tasks as the log checkpoint age is approaching the log size (in other words, the redo log fill factor is approaching 100%).
* | | MDEV-26356 preparation: Refactor purge_stateMarko Mäkelä2021-09-141-141/+94
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | purge_coordinator_timer_callback(): Remove. We will have purge_coordinator_timer invoke purge_coordinator_callback() directly. srv_master_callback(): Invoke srv_wake_purge_thread_if_not_active() instead of purge_coordinator_timer_callback(). That is, we will trigger purge_coordinator_callback() once per second if there is any work to be done. purge_state::do_purge(): Replaces srv_do_purge(), purge_coordinator_callback_low(), and purge_coordinator_timer_callback(). The static variables inside srv_do_purge() were moved to purge_state data members.
* | | MDEV-24512 fixup: Remove after_task_callbackst-10.6-marko2Marko Mäkelä2021-09-145-35/+4
| | | | | | | | | | | | | | | | | | In commit ff5d306e296350e7489dd3decb01bad18d135411 we removed dbug_after_task_callback but forgot to revert the rest of commit bada05a88369051ee60623b006929dd728f704e8.
* | | MDEV-24258 fixup: Do not update dict_table_t::n_ref_countMarko Mäkelä2021-09-131-5/+2
| | | | | | | | | | | | | | | | | | row_purge_remove_clust_if_poss_low(): The table identified by SYS_INDEXES.TABLE_ID is protected by exclusive dict_sys.latch. There is no need to touch its reference count.
* | | Merge branch '10.5' into 10.6Vladislav Vaintroub2021-09-111-1/+1
|\ \ \ | |/ / | | | | | | | | | # Conflicts: # appveyor.yml
| * | Merge branch '10.4' into 10.5Vladislav Vaintroub2021-09-110-0/+0
| |\ \ | | |/
| | * Merge branch '10.3' into 10.4Vladislav Vaintroub2021-09-113-16/+62
| | |\
| * | | Use mariadb- named targets for minbuildVladislav Vaintroub2021-09-111-15/+16
| | | |
| * | | Fix Windows warnings and tests for -DPLUGIN_PERFSCHEMA=NOVladislav Vaintroub2021-09-112-0/+5
| | | |
| * | | Merge branch '10.4' into 10.5Vladislav Vaintroub2021-09-113-14/+60
| |\ \ \ | | | | | | | | | | | | | | | | | | | | # Conflicts: # appveyor.yml
| | * \ \ Merge branch '10.3' into 10.4Vladislav Vaintroub2021-09-113-16/+62
| | |\ \ \ | | | |/ / | | |/| / | | | |/
| | | * Merge branch '10.2' into 10.3Vladislav Vaintroub2021-09-113-16/+62
| | | |\ | | | | | | | | | | | | | | | | | | | | | | | | | # Conflicts: # cmake/os/Windows.cmake # sql/sql_yacc.yy
| | | | * MDEV-26527 speedup appveyor build - 10.2st-10.2-wlad-appveyorVladislav Vaintroub2021-09-111-15/+24
| | | | |
| | | | * Bison 3.7 - fix "conversion from 'ptrdiff_t' to 'ulong', possible loss of data"Vladislav Vaintroub2021-09-112-4/+4
| | | | |
| | | | * Define minbuild target for 10.2Vladislav Vaintroub2021-09-111-0/+37
| | | | |
| | | | * Fix MYSQL_MAINTAINER_MODE=ERR, on Windows, with Ninja , in 10.2Vladislav Vaintroub2021-09-111-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | A conversion warning 4267 that we want to disable(prior to 10.3), was suppressed with cmake VS generator for C++ and C, despite being set only for CXX flags. The fix is to disable the warning in C flags, too. In 10.2, this warning is noisy, in 10.3 it is fixed.
* | | | | Merge 10.5 into 10.6Marko Mäkelä2021-09-11241-10037/+5668
|\ \ \ \ \ | |/ / / /
| * | | | remove redundant select in the perfschema.show_aggregate testSergei Golubchik2021-09-112-22/+15
| | | | | | | | | | | | | | | | | | | | instead, include handler_rollback in the following per-connection selects
| * | | | remove unused result fileSergei Golubchik2021-09-111-6482/+0
| | | | |
| * | | | Merge 10.4 into 10.5Marko Mäkelä2021-09-117-7/+29
| |\ \ \ \ | | |/ / /
| | * | | Merge 10.3 into 10.4Marko Mäkelä2021-09-116-7/+27
| | |\ \ \ | | | |/ /
| | | * | Merge 10.2 into 10.3Marko Mäkelä2021-09-116-7/+27
| | | |\ \ | | | | |/
| | | | * Fix an occasional timeout in innodb.alter_partitionedMarko Mäkelä2021-09-112-0/+8
| | | | |
| | | | * MDEV-26537 InnoDB corrupts files due to incorrect st_blksize calculationMarko Mäkelä2021-09-103-7/+19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The st_blksize returned by fstat(2) is not documented to be a power of 2, like we assumed in commit 58252fff15acfe7c7b0452a87e202e3f8e454e19 (MDEV-26040). While on Linux, the st_blksize appears to report the file system block size (which hopefully is not smaller than the sector size of the underlying block device), on FreeBSD we observed st_blksize values that might have been something similar to st_size. Also IBM AIX was affected by this. A simple test case would lead to a crash when using the minimum innodb_buffer_pool_size=5m on both FreeBSD and AIX: seq -f 'create table t%g engine=innodb select * from seq_1_to_200000;' \ 1 100|mysql test& seq -f 'create table u%g engine=innodb select * from seq_1_to_200000;' \ 1 100|mysql test& We will fix this by not trusting st_blksize at all, and assuming that the smallest allowed write size (for O_DIRECT) is 4096 bytes. We hope that no storage systems with larger block size exist. Anything larger than 4096 bytes should be unlikely, given that it is the minimum virtual memory page size of many contemporary processors. MariaDB Server on Microsoft Windows was not affected by this. While the 512-byte sector size of the venerable Seagate ST-225 is still in widespread use, the minimum innodb_page_size is 4096 bytes, and innodb_log_file_size can be set in integer multiples of 65536 bytes. The only occasion where InnoDB uses smaller data file block sizes than 4096 bytes is with ROW_FORMAT=COMPRESSED tables with KEY_BLOCK_SIZE=1 or KEY_BLOCK_SIZE=2 (or innodb_page_size=4096). For such tables, we will from now on preallocate space in integer multiples of 4096 bytes and let regular writes extend the file by 1024, 2048, or 3072 bytes. The view INFORMATION_SCHEMA.INNODB_SYS_TABLESPACES.FS_BLOCK_SIZE should report the raw st_blksize. For page_compressed tables, the function fil_space_get_block_size() will map to 512 any st_blksize value that is larger than 4096. os_file_set_size(): Assume that the file system block size is 4096 bytes, and only support extending files to integer multiples of 4096 bytes. fil_space_extend_must_retry(): Round down the preallocation size to an integer multiple of 4096 bytes.
| | | | * Speedup build of the MSI packageVladislav Vaintroub2021-09-101-1/+1
| | | | |
| | * | | MDEV-25951 followup: Add #ifdef around debug codeMarko Mäkelä2021-09-111-1/+3
| | | | |
| * | | | Merge fixup 7c33ecb6651fb80f46bf9f3d8fee2e2f2b70995dMarko Mäkelä2021-09-113-43/+53
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The merge accidentally omitted the 10.4 commit 472b35c7efe7c46abe8ab0e9a61b44a5f010f094 and reverted the 10.5 commit 6e3bd663d0fc669ffa6ab4c5f5aa57a1244ac555.
| * | | | Backport "Fix generation of bison output for out-of-source builds."to 10.5Vladislav Vaintroub2021-09-113-9/+6
| | | | | | | | | | | | | | | | | | | | Apply 115fec58f16d3c49 to 10.5
| * | | | Expand performance_schema tables definitions with column commentsVicențiu Ciorbaru2021-09-1051-880/+880
| | | | | | | | | | | | | | | | | | | | | | | | | Cover all columns that did not have comments. Adjust docs based off of MariaDB implementation.
| * | | | MDEV-25325 built-in documentation for performance_schema tablesHaidong Ji2021-09-1023-219/+383
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Improve documentation of performance_schema tables by appending COLUMN comments to tables. Additionally improve test coverage and update corresponding tests. This is part of the patch covering newer columns and tables in 10.5.
| * | | | Merge remote-tracking branch 'upstream/10.4' into 10.5Vicențiu Ciorbaru2021-09-10189-2521/+4439
| |\ \ \ \ | | |/ / /
| | * | | MDEV-25951 followupEugene Kosov2021-09-101-4/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | FTS indexes has a prefix_len=1 or prefix_len=0 as stated by comment in mysql_prepare_create_table(). Thus, a newly added assertion should be relaxed for FTS indexes.
| | * | | Merge branch '10.3' into 10.4Sergei Golubchik2021-09-094-54/+55
| | |\ \ \ | | | |/ /
| | | * | Merge branch '10.2' into 10.3Sergei Golubchik2021-09-094-54/+55
| | | |\ \ | | | | |/