优化MySQL查询以避免“使用临时”和“使用filesort”

问题描述:

我知道这里有上千个类似的问题,但我已经花了两周的时间来为这个查询找到真正的解决方案。优化MySQL查询以避免“使用临时”和“使用filesort”

此查询来自于销售点程序。此查询与用户选择他需要的报告(期间,总计等)以及是否希望分组结果的表单相关。

这很不方便。查询是在VB.NET中生成的,我的意思是,通过代码生成,它会根据用户的选择(不同总计,期间,组等)而变化,所以通过解决这个问题,我应该能够继续“创建“通过编码表单的所有其他查询。

在这种情况下,此查询是按家庭分组的总计查询。

大多数时候(> 99%)在发送数据(查询#显示轮廓)是浪费

的表如下所示:

CREATE TABLE `product` (
    `idProduct` smallint(5) unsigned NOT NULL AUTO_INCREMENT, 
    `idFamily` tinyint(3) unsigned DEFAULT NULL, 
    `Codigo` char(10) NOT NULL, 
    `Nombre` char(70) DEFAULT NULL COMMENT 'Nombre corto', 
-- five more integer columns 
    PRIMARY KEY (`idProduct`), 
    KEY `fk_p_idFamily` (`idFamily`), 
    CONSTRAINT `fk_p_idFamily` FOREIGN KEY (`idFamily`) REFERENCES `family` (`idFamily`), 
) ENGINE=InnoDB AUTO_INCREMENT=19420 DEFAULT CHARSET=latin1 PACK_KEYS=0; 

CREATE TABLE `family` (
    `idFamily` tinyint(3) unsigned NOT NULL AUTO_INCREMENT, 
    `Nombre` char(30) NOT NULL, 
    `Descripcion` char(255) DEFAULT NULL, 
    `Borrado` tinyint(1) NOT NULL DEFAULT '0', 
    PRIMARY KEY (`idFamily`) 
) ENGINE=InnoDB AUTO_INCREMENT=34 DEFAULT CHARSET=latin1 PACK_KEYS=0 

CREATE TABLE `document` (
`idDocument` tinyint(3) unsigned NOT NULL AUTO_INCREMENT, 
`Nombre` char(25) NOT NULL, 
`Descripcion` char(100) DEFAULT NULL, 
`Borrado` tinyint(1) NOT NULL DEFAULT '0', 
`NoComputa` tinyint(1) NOT NULL DEFAULT '0', 
    `Rectifica` tinyint(1) NOT NULL DEFAULT '0', 
    `CalculoSumatorioPVP` tinyint(1) NOT NULL DEFAULT '0', 
    PRIMARY KEY (`idDocument`) 
) ENGINE=InnoDB AUTO_INCREMENT=5 DEFAULT CHARSET=latin1 PACK_KEYS=0 

CREATE TABLE `soldproduct` (
    `idProduct` smallint(5) unsigned NOT NULL, 
    `idSale` int(10) unsigned NOT NULL, 
    `PrecioCompra` decimal(7,2) NOT NULL , 
    `PrecioVenta` decimal(7,2) NOT NULL , 
    `DtoProd` decimal(7,4) DEFAULT NULL , 
    `BrutoUd` decimal(7,2) NOT NULL , 
    `PVPUd` decimal(7,2) NOT NULL , 
    `Cantidad` decimal(9,3) DEFAULT NULL , 
    PRIMARY KEY (`idProduct`,`idSale`), 
    KEY `fk_pv_idSale` (`idSale`), 
    CONSTRAINT `fk_pv_idProduct` FOREIGN KEY (`idProduct`) REFERENCES `product` (`idProduct`), 
    CONSTRAINT `fk_pv_idSale` FOREIGN KEY (`idSale`) REFERENCES `sales` (`idSale`) 
) ENGINE=InnoDB DEFAULT CHARSET=latin1 PACK_KEYS=0 

CREATE TABLE `sales` (
    `idSale` int(10) unsigned NOT NULL AUTO_INCREMENT, 
    `idDocument` tinyint(3) unsigned NOT NULL, 
    `idEstadoVenta` tinyint(3) unsigned NOT NULL, 
    `idCliente` smallint(5) unsigned NOT NULL, 
    `idFormaPago` tinyint(3) unsigned NOT NULL, 
    `idEmpleado` tinyint(3) unsigned NOT NULL , 
    `idTienda` tinyint(3) unsigned DEFAULT NULL, 
    `idTipoVenta` tinyint(3) unsigned NOT NULL, 
    `FechaVenta` datetime DEFAULT NULL COMMENT 'Fecha de Venta', 
    `PrecioCompraTotal` decimal(10,2) DEFAULT NULL, 
    `IVA` decimal(7,4) DEFAULT NULL, 
    -- ten more decimal columns 
    -- five more datetime columns 
    -- ten more char columns 
    `Borrado` tinyint(1) NOT NULL DEFAULT '0' , 
    `Historia` tinyint(1) NOT NULL DEFAULT '0', 
    PRIMARY KEY (`idVenta`), 
    KEY `fk_v_idTienda` (`idTienda`), 
    KEY `fk_v_idCliente` (`idCliente`), 
    KEY `fk_v_idEmpleado` (`idEmpleado`), 
    KEY `fk_v_idTipoVenta` (`idTipoVenta`), 
    KEY `fk_v_idFormaPago` (`idFormaPago`), 
    KEY `fk_v_idDocument` (`idDocument`), 
    KEY `fk_v_idEstadoVenta` (`idEstadoVenta`), 
    KEY `idx_v_FechaVenta` (`FechaVenta`), 
    CONSTRAINT `fk_v_idCliente` FOREIGN KEY (`idCliente`) REFERENCES `cliente` (`idCliente`), 
    CONSTRAINT `fk_v_idDocument` FOREIGN KEY (`idDocument`) REFERENCES `document` (`idDocument`), 
    CONSTRAINT `fk_v_idEmpleado` FOREIGN KEY (`idEmpleado`) REFERENCES `empleado` (`idEmpleado`), 
    CONSTRAINT `fk_v_idEstadoVenta` FOREIGN KEY (`idEstadoVenta`) REFERENCES `estadoventa` (`idEstadoVenta`), 
    CONSTRAINT `fk_v_idFormaPago` FOREIGN KEY (`idFormaPago`) REFERENCES `formapago` (`idFormaPago`), 
    CONSTRAINT `fk_v_idTienda` FOREIGN KEY (`idTienda`) REFERENCES `tienda` (`idTienda`), 
    CONSTRAINT `fk_v_idTipoVenta` FOREIGN KEY (`idTipoVenta`) REFERENCES `tipoventa` (`idTipoVenta`) 
) ENGINE=InnoDB AUTO_INCREMENT=101770 DEFAULT CHARSET=latin1 PACK_KEYS=0 

和查询是这样的:

SELECT f.Nombre ,SUM(sp.PrecioVenta*sp.Cantidad) 
FROM soldproduct sp, sales s, document doc, family f, product p 
WHERE s.idDocument = doc.idDocument AND doc.NoComputa = FALSE 
AND p.idProduct = sp.idProduct AND sp.idSale = s.idSale 
AND p.idFamily = f.idFamily AND p.Borrado = FALSE 
AND s.Borrado = FALSE AND s.Historia = FALSE AND s.idTienda = 1 
AND s.FechaVenta BETWEEN '2013-01-01' AND '2014-01-01' GROUP BY f.idFamily; 

我也试试这个(我也删除的情况下,它是负责文件表)

SELECT ProductFamily.Nombre, SUM(sp.PrecioVenta*sp.Cantidad) 
FROM 
(SELECT idSale FROM sales WHERE Borrado = FALSE AND Historia = FALSE AND idTienda = 1 
AND FechaVenta BETWEEN '2013-01-01' AND '2014-01-01') SalesidSale 
JOIN 
soldproduct sp 
ON sp.idSale = SalesidSale.idSale 
JOIN 
(SELECT p.idProduct, p.idFamily, f.Nombre FROM product p, family f WHERE 
p.idFamily = f.idFamily AND p.Borrado = FALSE) ProductFamily 
ON ProductFamily.idProduct = sp.idProduct 
GROUP BY ProductFamily.idFamily; 

所花费的时间是非常大的,并且它的输出解释命令(第一查询):

id select_type table type possible_keys            key     key_len ref      rows Extra 
1 SIMPLE  v  range PRIMARY,fk_v_idTienda,fk_v_idDocument,idx_v_FechaVenta  idx_v_FechaVenta 6  NULL     7387 "Using index condition; Using where; Using MRR; Using temporary; Using filesort" 
1 SIMPLE  doc  ALL  PRIMARY              NULL    NULL NULL     4  "Using where; Using join buffer (Block Nested Loop)" 
1 SIMPLE  pv  ref  PRIMARY,fk_pv_idSale          fk_pv_idSale  4  gemalia.s.idSale  4  NULL 
1 SIMPLE  p  eq_ref PRIMARY,fk_p_idFamily          PRIMARY    2  gemalia.sp.idProduct 1  "Using where" 
1 SIMPLE  f  eq_ref PRIMARY              PRIMARY    1  gemalia.p.idFamily  1  NULL 

我希望有人能帮助我,我试图创建索引,子查询等。但我不能得到低于40秒的任何东西,这太多了,而且我确信我做错了什么。

每张表的行数大约为: 销售:100,000 产品:20,000 家庭:35 已售出产品:1,100,000 文件:4

非常感谢。

+0

试着用'WHERE'在第一个查询..前尝试把这些条件'p.Borrado条款= FALSE AND s.Borrado =虚假和s.Historia打=联合条件之前首先= FALSE AND s.idTienda = 1'。 – Meherzad 2013-04-04 09:32:58

+0

嗨Meherzad,你说第一个查询或第二个查询? – h2ohgh2o 2013-04-04 09:37:25

+0

我也试着做了没有聚合函数和GROUP BY CLAUSE的查询。查询时间是,但问题是服务器不得不发送数据(这是真正的问题),然后,我将不得不通过代码“总和”它们(问题少)。我收到了62458行。查询结果:持续时间(4.366秒)取(174.852秒)。我在“show profile output”中看到了一些奇怪的东西:输出是一串“'等待查询缓存锁定'”(0秒)和“发送数据”(2或3秒),最后还有最后的“发送数据”为40秒。可能是关于服务器配置的东西? – h2ohgh2o 2013-04-04 10:49:04

试试这个查询,我们试图利用短路。

编辑

SELECT 
    f.Nombre, 
    SUM(sp.PrecioVenta*sp.Cantidad) 
FROM 
    soldproduct sp 
INNER JOIN 
    sales s 
ON 
    (s.idTienda = 1 AND AND 
    s.Borrado = FALSE AND 
    s.Historia = FALSE AND 
    sp.idSale = s.idSale) 
INNER JOIN 
    document doc 
ON 
    (doc.NoComputa = FALSE AND 
    s.idDocument = doc.idDocument) 
INNER JOIN 
    family f 
ON 
    (p.idFamily = f.idFamily) 
INNER JOIN 
    product p 
ON 
    (p.Borrado = FALSE AND   
    p.idProduct = sp.idProduct) 
WHERE 
    s.FechaVenta BETWEEN '2013-01-01' AND '2014-01-01' 
GROUP BY 
    f.idFamily; 
+0

谢谢,**但它不起作用**。看起来,在MySQL 5.6.10(我正在处理的版本)中,顺序无关紧要。 EXPLAIN输出是一样的。 “发送数据”时间正在浪费>总时间的99%。 – h2ohgh2o 2013-04-04 10:37:10

+0

检查编辑现在它应该工作... – Meherzad 2013-04-04 11:00:57

+0

我检查了它,它并没有改善。在更改my.ini文件后,我现在在10秒钟内。 – h2ohgh2o 2013-04-04 11:44:49