summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch '10.2' into bb-10.2-extSergei Golubchik2017-08-25585-12279/+79336
|\
| * Update README.mdKenny John Jacob2017-08-241-1/+1
| | | | | | Fix minor typo.
| * MDEV-13534 InnoDB STATS_PERSISTENT fails to ignore garbage delete-mark flag ↵Marko Mäkelä2017-08-243-16/+62
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | on node pointer pages This bug was a regression caused by MDEV-12698. On non-leaf pages, the delete-mark flag in the node pointer records is basically garbage. (Delete-marking only makes sense at the leaf level anyway. The purpose of the delete-mark is to tell MVCC, locking and purge that a leaf-level record does not exist in the READ UNCOMMITTED view, but it used to exist.) Node pointer records and non-leaf pages are glue that attaches multiple leaf pages to an index. This glue is supposed to be transparent to the transactional layer. When a page is split, InnoDB creates a node pointer record out of the child page record that the cursor is positioned on. The node pointer record for the parent page will be a copy of the child page record, amended with the child page number. If the child page record happened to carry the delete-mark flag, then the node pointer record would also carry this flag (even though the flag makes no sense outside child pages). (On a related note, for the first node pointer record in the first node pointer page of each tree level, if the MIN_REC_FLAG is set, the rest of the record contents (except the child page number) is basically garbage. From this garbage you could deduce at which point the child was originally split.) page_scan_method_t: Replace with bool, as there are only 2 values. dict_stats_scan_page(): Replace the parameter scan_method with is_leaf. Ignore the bogus (garbage) delete-mark flag if !is_leaf.
| * MDEV-13602: rocksdb.index_merge_rocksdb2 failed in buildbotSergei Petrunia2017-08-2310-27/+2122
| | | | | | | | | | | | | | | | | | | | | | | | | | - Add include/index_merge*. Upstream has different files than MariaDB, use copies theirs, not ours. - There was a prblem with running "DDL-like" commands with binlog=ON: MariaDB sets binlog_format=STATEMENT for the duration of such command to prevent RBR replication from catching (and replicating) updates to system tables. However, MyRocks tries to prevent any writes to MyRocks tables with binlog_format!=ROW. - Added exceptions for DDL-type commands (ANALYZE TABLE, OPTIMIZE TABLE) - Added special handling for "LOCK TABLE(s) myrocks_table WRITE".
| * The test failed once on Buildbot with the result difference:Marko Mäkelä2017-08-233-5/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | # ib_logfile0 expecting FOUND -FOUND 3 /public|gossip/ in ib_logfile0 +FOUND 2 /public|gossip/ in ib_logfile0 The most plausible explanation for this difference should be that the redo log payload grew was so big that one of the strings (for writing the undo log record, clustered index record, and secondary index record) was written to ib_logfile1 instead of ib_logfile0. Let us run the test with --innodb-log-files-in-group=1 so that only a single log file will be used.
| * Adjust InnoDB debug assertions for Oracle Bug#25551311 aka Bug#23517560Marko Mäkelä2017-08-232-3/+12
| | | | | | | | | | | | | | | | | | | | | | | | The MySQL 5.6.36 merge (commit 0af9818240a0745aca3fd94891664fe008de24fe in MariaDB Server 10.0.31, 10.1.24, 10.2.7) introduced a change from Oracle: Bug#25551311 BACKPORT BUG #23517560 REMOVE SPACE_ID RESTRICTION FOR UNDO TABLESPACES Some debug assertions in MariaDB 10.2 were still assuming that the InnoDB undo tablespace IDs start from 1. With the above mentioned change, the undo tablespace IDs must be contiguous and nonzero.
| * MDEV-13167 InnoDB key rotation is not skipping unused pagesMarko Mäkelä2017-08-231-43/+41
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | In key rotation, we must initialize unallocated but previously initialized pages, so that if encryption is enabled on a table, all clear-text data for the page will eventually be overwritten. But we should not rotate keys on pages that were never allocated after the data file was created. According to the latching order rules, after acquiring the tablespace latch, no page latches of previously allocated user pages may be acquired. So, key rotation should check the page allocation status after acquiring the page latch, not before. But, the latching order rules also prohibit accessing pages that were not allocated first, and then acquiring the tablespace latch. Such behaviour would indeed result in a deadlock when running the following tests: encryption.innodb_encryption-page-compression encryption.innodb-checksum-algorithm Because the key rotation is accessing potentially unallocated pages, it cannot reliably check if these pages were allocated. It can only check the page header. If the page number is zero, we can assume that the page is unallocated. fil_crypt_rotate_pages(): Skip pages that are known to be uninitialized. fil_crypt_rotate_page(): Detect uninitialized pages by FIL_PAGE_OFFSET. Page 0 is never encrypted, and on other pages that are initialized, FIL_PAGE_OFFSET must contain the page number. fil_crypt_is_page_uninitialized(): Remove. It suffices to check the page number field in fil_crypt_rotate_page().
| * Code clean-up related to MDEV-13167Marko Mäkelä2017-08-234-101/+89
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | xdes_get_descriptor_const(): New function, to get read-only access to the allocation descriptor. fseg_page_is_free(): Only acquire a shared latch on the tablespace, not an exclusive latch. Calculate the descriptor page address before acquiring the tablespace latch. If the page number is out of bounds, return without fetching any page. Access only one descriptor page. fsp_page_is_free(), fsp_page_is_free_func(): Remove. Use fseg_page_is_free() instead. fsp_init_file_page(): Move the debug parameter into a separate function. btr_validate_level(): Remove the unused variable "seg".
| * MDEV-13485 MTR tests fail massively with --innodb-sync-debugMarko Mäkelä2017-08-2318-57/+43
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The parameter --innodb-sync-debug, which is disabled by default, aims to find potential deadlocks in InnoDB. When the parameter is enabled, lots of tests failed. Most of these failures were due to bogus diagnostics. But, as part of this fix, we are also fixing a bug in error handling code and removing dead code, and fixing cases where an uninitialized mutex was being locked and unlocked. dict_create_foreign_constraints_low(): Remove an extraneous mutex_exit() call that could cause corruption in an error handling path. Also, do not unnecessarily acquire dict_foreign_err_mutex. Its only purpose is to control concurrent access to dict_foreign_err_file. row_ins_foreign_trx_print(): Replace a redundant condition with a debug assertion. srv_dict_tmpfile, srv_dict_tmpfile_mutex: Remove. The temporary file is never being written to or read from. log_free_check(): Allow SYNC_FTS_CACHE (fts_cache_t::lock) to be held. ha_innobase::inplace_alter_table(), row_merge_insert_index_tuples(): Assert that no unexpected latches are being held. sync_latch_meta_init(): Properly initialize dict_operation_lock_key at SYNC_DICT_OPERATION. dict_sys->mutex is SYNC_DICT, and the now-removed SRV_DICT_TMPFILE was wrongly registered at SYNC_DICT_OPERATION. buf_block_init(): Correctly register buf_block_t::debug_latch. It was previously misleadingly reported as LATCH_ID_DICT_FOREIGN_ERR. latch_level_t: Correct the relative latching order of SYNC_IBUF_PESS_INSERT_MUTEX,SYNC_INDEX_TREE and SYNC_FILE_FORMAT_TAG,SYNC_DICT_OPERATION to avoid bogus failures. row_drop_table_for_mysql(): Avoid accessing btr_defragment_mutex if the defragmentation thread has not been started. This is the case during fts_drop_orphaned_tables() in recv_recovery_rollback_active(). fil_space_destroy_crypt_data(): Avoid acquiring fil_crypt_threads_mutex when it is uninitialized. We may have created crypt_data before the mutex was created, and the mutex creation would be skipped if InnoDB startup failed or --innodb-read-only was specified.
| * Remove the unused redo log record type MLOG_INIT_FILE_PAGEMarko Mäkelä2017-08-232-26/+1
| | | | | | | | | | | | | | | | | | InnoDB stopped generating the MLOG_INIT_FILE_PAGE record in MySQL 5.7.5. Starting with MySQL 5.7.9 (which was imported to MariaDB Server 10.2.2), the InnoDB redo log format tag prevents crash recovery from old-format redo logs. Remove the dead code for dealing with MLOG_INIT_FILE_PAGE.
| * MDEV-13452 Assertion `!recv_no_log_write' failed at startupMarko Mäkelä2017-08-231-1/+0
| | | | | | | | | | | | | | | | | | | | The previous fix (commit dcdc1c6d09b4a49b13fa8b1448064110bc296f86) should have removed the assertion from log_close(), because every caller that requires this assertion is already asserting that log writes are allowed. When fil_names_clear() is called, it must be able to write the MLOG_CHECKPOINT records. The purpose of the debug variable recv_no_log_write is to prevent the creation of page-level redo log records, or modifications to persistent data.
| * Fix rocksdb.bulk_load testSergei Petrunia2017-08-212-1/+1
| | | | | | | | | | - Remove the merge error - Update test results
| * MDEV-13600: Update test results for rocksdb.bulk_load_rev_cfSergei Petrunia2017-08-211-0/+3
| |
| * MDEV-13559 encryption.innodb-redo-badkey failed in buildbotMarko Mäkelä2017-08-182-2/+6
| | | | | | | | | | | | | | Add suppressions for the read and decompression errors. This may be 10.3 specific and related to MDEV-13536 which increases purge activity. But it does not hurt to suppress rarely occurring and plausible error messages for this fault-injection test already in 10.2.
| * MDEV-13570 Assertion failure !srv_read_only_mode in --innodb-read-only ↵Marko Mäkelä2017-08-181-0/+1
| | | | | | | | | | | | | | shutdown when buf_resize_thread is active logs_empty_and_mark_files_at_shutdown(): Skip the debug assertion when the buf_resize_thread is active.
| * MDEV-13575 On failure, Mariabackup --backup --safe-slave-backup may forget ↵Marko Mäkelä2017-08-183-70/+91
| | | | | | | | | | | | | | | | | | | | | | | | | | to START SLAVE SQL_THREAD backup_release(): New function, refactored from backup_finish(). Release some resources that may have been acquired by backup_startup() and should be released even after a failed operation. xtrabackup_backup_low(): Refactored from xtrabackup_backup_func(). xtrabackup_backup_func(): Always call backup_release() after calling backup_start().
| * bump the VERSIONDaniel Bartholomew2017-08-181-1/+1
| |
| * MDEV-13754 Memory leak in mariabackup.incremental_backupMarko Mäkelä2017-08-181-14/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The test mariabackup.incremental_backup revealed a memory leak in have_queries_to_wait_for(). The problem is that xb_mysql_query() is being invoked with bool use_result=true but the result is not being freed by mysql_store_result(). There are similar leaks in other functions. have_queries_to_wait_for(): Invoke mysql_free_result() to clean up after the mysql_store_result() that was invoked by xb_mysql_query(). select_incremental_lsn_from_history(): Plug the leak on failure. kill_long_queries(): Plug the memory leak. (This function always leaked memory when it was called.)
| * MDEV-13574 related Mariabackup code cleanup (non-functional change)Marko Mäkelä2017-08-181-14/+8
| | | | | | | | | | have_queries_to_wait_for(), kill_long_queries(): Declare and initialize variables in one go.
| * Follow-up fix to MDEV-12988 backup fails if innodb_undo_tablespaces>0Marko Mäkelä2017-08-184-6/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The fix broke mariabackup --prepare --incremental. The restore of an incremental backup starts up (parts of) InnoDB twice. First, all data files are discovered for applying .delta files. Then, after the .delta files have been applied, InnoDB will be restarted more completely, so that the redo log records will be applied via the buffer pool. During the first startup, the buffer pool is not initialized, and thus trx_rseg_get_n_undo_tablespaces() must not be invoked. The apply of the .delta files will currently assume that the --innodb-undo-tablespaces option correctly specifies the number of undo tablespace files, just like --backup does. The second InnoDB startup of --prepare for applying the redo log will properly invoke trx_rseg_get_n_undo_tablespaces(). enum srv_operation_mode: Add SRV_OPERATION_RESTORE_DELTA for distinguishing the apply of .delta files from SRV_OPERATION_RESTORE. srv_undo_tablespaces_init(): In mariabackup --prepare --incremental, in the initial SRV_OPERATION_RESTORE_DELTA phase, do not invoke trx_rseg_get_n_undo_tablespaces() because the buffer pool or the redo logs are not available. Instead, blindly rely on the parameter --innodb-undo-tablespaces.
| * Updated list of unstable tests for 10.2.8Elena Stepanova2017-08-181-175/+182
| |
| * gcol.gcol_rollback could fail with errors in server logElena Stepanova2017-08-181-0/+5
| | | | | | | | | | If previous tests opened system tables, the test could fail because it crashes the server. Added FLUSH TABLES to avoid it
| * MDEV-12948 : do not spam error log, if ↵Vladislav Vaintroub2017-08-171-4/+16
| | | | | | | | | | | | | | | | | | | | | | DeviceIoControl(IOCTL_STORAGE_QUERY_PROPERTY) fails with ERROR_INVALID_FUNCTION This DeviceIoControl seems to happen on different boxes from time to time, and there is not much user can do about it. Instead of error, log a single INFO message, so it does not disturb users much.
| * MDEV-12988 backup fails if innodb_undo_tablespaces>0Marko Mäkelä2017-08-171-13/+22
| | | | | | | | | | srv_undo_tablespaces_init(): In Mariabackup backup and restore modes, do initialize the array of undo_tablespace_ids[].
| * MDEV-11240: Server crashes in check_view_single_update or Assertion ↵mariadb-10.2.8Oleksandr Byelkin2017-08-173-9/+3
| | | | | | | | | | | | `derived->table' failed in mysql_derived_merge_for_insert Before "merge" view shoud be inited to maintaing transitive attributes like "multitable".
| * Merge branch '10.1' into 10.2Sergei Golubchik2017-08-17360-2809/+40982
| |\
| | * Merge branch '10.0' into 10.1Sergei Golubchik2017-08-152-4/+4
| | |\
| | | * compilation fix for SLES 11 SP4Sergei Golubchik2017-08-141-2/+2
| | | | | | | | | | | | | | | | also fix innodb
| | | * compilation fix for SLES 11 SP4Sergei Golubchik2017-08-131-2/+2
| | | |
| | * | MDEV-8579 - Some sysvars in I_S are missing any meaningful help (comment) textSergey Vojtovich2017-08-158-144/+157
| | | | | | | | | | | | | | | | Follow-up to original patch: fixing test cases.
| | * | MDEV-8579 Expand system variable documentation=Ian Gilfillan2017-08-151-56/+147
| | | |
| | * | allow OpenSSL 0.9.8 againSergei Golubchik2017-08-131-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | this disables the check, added in d937916c06 Applications shouldn't police OpenSSL versions that users are using. And 0.9.8 on Mac OS X seems to have new fixes, despite being "0.9.8"
| | * | bump the VERSIONDaniel Bartholomew2017-08-101-1/+1
| | | |
| | * | Merge 10.0 into 10.1Marko Mäkelä2017-08-093-36/+7
| | |\ \ | | | |/
| | | * Revert an InnoDB Memcached plugin fix that was merged from MySQL 5.6.37Marko Mäkelä2017-08-093-36/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Revert the following change, because Memcached is not present in MariaDB Server. We had better avoid adding dead code. commit d9bc5e03d788b958ce8c76e157239953db60adb2 Author: Aakanksha Verma <aakanksha.verma@oracle.com> Date: Thu May 18 14:31:01 2017 +0530 Bug #24605783 MYSQL GOT SIGNAL 6 ASSERTION FAILURE
| | * | Updated list of unstable tests for 10.1.26 releasemariadb-10.1.26Elena Stepanova2017-08-091-49/+99
| | | |
| | * | MDEV-12725 select on federated table crashes serverSergei Golubchik2017-08-086-25/+64
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | NET can only store current_thd if this NET (or its MYSQL) is not moved between threads. In FederatedX MYSQL is part of the TABLE, and a TABLE can migrate between threads. Fix: associate NET with THD in txn->acquire() , and dissociate in txn->release()
| | * | MDEV-12863 No table can be created after second encryption plugin attempted ↵Sergei Golubchik2017-08-083-6/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | | to load when deinitializing encryption plugins, disable server-wide encryption only if this plugin is the one that is used for encryption.
| | * | Merge branch '10.0' into 10.1Sergei Golubchik2017-08-08313-2122/+36827
| | |\ \ | | | |/
| | | * bump the VERSIONDaniel Bartholomew2017-08-071-1/+1
| | | |
| | | * Merge branch 'bb-10.0-vicentiu' into 10.0mariadb-10.0.32Vicențiu Ciorbaru2017-08-04127-514/+34128
| | | |\ | | | | | | | | | | | | | | | Includes Percona XtraDB and TokuDB 5.6.36-82.1
| | | | * Disable rpl_tokudb_row_img_* testsbb-10.0-vicentiu-post-rewriteVicențiu Ciorbaru2017-08-0414-7/+7
| | | | | | | | | | | | | | | | | | | | | | | | | We need to pull rpl config files from MySQL before these tests can be run.
| | | | * Merge branch 'merge-tokudb-5.6' into 10.0Vicențiu Ciorbaru2017-08-0488-1087/+123
| | | | |\
| | | | | * Move tokudb_rpl to rpl-tokudb suiteVicențiu Ciorbaru2017-08-03186-0/+0
| | | | | |
| | | | * | Fix tokudb compilation post mergeVicențiu Ciorbaru2017-08-033-5/+6
| | | | | |
| | | | * | Merge branch 'merge-tokudb-5.6' into 10.0Vicențiu Ciorbaru2017-08-03118-479/+35042
| | | | |\ \ | | | | | |/
| | | | | * 5.6.36-82.1Vicențiu Ciorbaru2017-08-03118-521/+34166
| | | | | |
| | | | * | Merge branch 'merge-xtradb-5.6' into 10.0Vicențiu Ciorbaru2017-08-023-3/+17
| | | | |\ \
| | | | | * | 5.6.36-82.1Vicențiu Ciorbaru2017-08-023-3/+18
| | | | | | |
| | | * | | | Remove extra trailing spaces from the result fileElena Stepanova2017-08-041-2/+2
| | | | | | |