summaryrefslogtreecommitdiff
path: root/myisam/rt_mbr.c
diff options
context:
space:
mode:
authorunknown <holyfoot/hf@mysql.com/hfmain.(none)>2007-10-05 15:40:32 +0500
committerunknown <holyfoot/hf@mysql.com/hfmain.(none)>2007-10-05 15:40:32 +0500
commit6d54b5771bf3cce3e5a5e8ca295219fdbae80c00 (patch)
tree36d6a636c837dca7a96045954b04b2d4ff2b4a98 /myisam/rt_mbr.c
parenta3d5f64c92fdb986432ea9a61cb529c531c1e0c3 (diff)
downloadmariadb-git-6d54b5771bf3cce3e5a5e8ca295219fdbae80c00.tar.gz
Bug #30286 spatial index cause corruption and server crash!
As the result of DOUBLE claculations can be bigger than DBL_MAX constant we use in code, we shouldn't use this constatn as a biggest possible value. Particularly the rtree_pick_key function set 'min_area= DBL_MAX' relying that any rtree_area_increase result will be less so we return valid key. Though in rtree_area_increase function we calculate the area of the rectangle, so the result can be 'inf' if the rectangle is huge enough, which is bigger than DBL_MAX. Code of the rtree_pick_key modified so we always return a valid key. myisam/rt_index.c: Bug #30286 spatial index cause corruption and server crash! always set the best_key with the first key we get, so we always return somthing valid. myisam/rt_mbr.c: Bug #30286 spatial index cause corruption and server crash! function comment extended mysql-test/r/gis-rtree.result: Bug #30286 spatial index cause corruption and server crash! test result mysql-test/t/gis-rtree.test: Bug #30286 spatial index cause corruption and server crash! test case
Diffstat (limited to 'myisam/rt_mbr.c')
-rw-r--r--myisam/rt_mbr.c5
1 files changed, 4 insertions, 1 deletions
diff --git a/myisam/rt_mbr.c b/myisam/rt_mbr.c
index 897862c1c9a..31eaac0ae70 100644
--- a/myisam/rt_mbr.c
+++ b/myisam/rt_mbr.c
@@ -525,7 +525,10 @@ double rtree_overlapping_area(HA_KEYSEG *keyseg, uchar* a, uchar* b,
}
/*
-Calculates MBR_AREA(a+b) - MBR_AREA(a)
+ Calculates MBR_AREA(a+b) - MBR_AREA(a)
+ Note: when 'a' and 'b' objects are far from each other,
+ the area increase can be really big, so this function
+ can return 'inf' as a result.
*/
double rtree_area_increase(HA_KEYSEG *keyseg, uchar* a, uchar* b,
uint key_length, double *ab_area)