Skip to content

Backoffice category tree takes an incredibly long time to display in 2.4.8 #39829

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
1 of 5 tasks
Dnd-Mafer opened this issue Apr 17, 2025 · 4 comments · May be fixed by #39830
Open
1 of 5 tasks

Backoffice category tree takes an incredibly long time to display in 2.4.8 #39829

Dnd-Mafer opened this issue Apr 17, 2025 · 4 comments · May be fixed by #39830
Assignees
Labels
Issue: ready for confirmation Reported on 2.4.8 Indicates original Magento version for the Issue report.

Comments

@Dnd-Mafer
Copy link

Preconditions and environment

  • Magento 2.4.8
  • Setup a catalog with:
    • 7 root categories
    • 1500 categories spread in these 7 categories
    • 175k products associated randomly to several categories (around 226k link between categories and products)

Steps to reproduce

  • Go in backofiice
  • Click on Catalog -> Categories
  • Take a coffe, a shower, look at a TVShow and come back

Expected result

Category page appears quickly

Actual result

Category page doesn't appear quickly AT ALL !

Additional information

This is due to this commit.

More precisely there is an awful subselect here in the new function getCountFromCategoryTableBulk leading to this kind of query

SELECT `ce`.`entity_id`,
       COUNT(DISTINCT cp.product_id) AS `product_count`
FROM   `catalog_category_entity` AS `ce`
       LEFT JOIN `catalog_category_product` AS `cp`
              ON cp.category_id IN (SELECT `ce2`.`entity_id`
                                    FROM   `catalog_category_entity` AS `ce2`
                                    WHERE  ( ce2.path LIKE CONCAT(ce.path, '/%')
                                              OR ce2.path = ce.path ))
WHERE  ( ce.entity_id IN( 3, 4, 5, 6, ..., 5484, 5487, 5489, 5490 ) )
GROUP  BY `ce`.`entity_id`; 

killing performances.

This can be easily improved using a simple join

SELECT ce.entity_id,
       COUNT(DISTINCT cp.product_id) AS product_count
FROM   catalog_category_entity ce
       LEFT JOIN catalog_category_entity ce2
              ON ce2.path LIKE CONCAT(ce.path, '/%')
                  OR ce2.path = ce.path
       LEFT JOIN catalog_category_product cp
              ON cp.category_id = ce2.entity_id
WHERE  ce.entity_id IN ( 3, 4, 5, 6, ..., 5484, 5487, 5489, 5490 )
GROUP  BY ce.entity_id; 

Release note

No response

Triage and priority

  • Severity: S0 - Affects critical data or functionality and leaves users without workaround.
  • Severity: S1 - Affects critical data or functionality and forces users to employ a workaround.
  • Severity: S2 - Affects non-critical data or functionality and forces users to employ a workaround.
  • Severity: S3 - Affects non-critical data or functionality and does not force users to employ a workaround.
  • Severity: S4 - Affects aesthetics, professional look and feel, “quality” or “usability”.
Copy link

m2-assistant bot commented Apr 17, 2025

Hi @Dnd-Mafer. Thank you for your report.
To speed up processing of this issue, make sure that the issue is reproducible on the vanilla Magento instance following Steps to reproduce.


Join Magento Community Engineering Slack and ask your questions in #github channel.
⚠️ According to the Magento Contribution requirements, all issues must go through the Community Contributions Triage process. Community Contributions Triage is a public meeting.
🕙 You can find the schedule on the Magento Community Calendar page.
📞 The triage of issues happens in the queue order. If you want to speed up the delivery of your contribution, join the Community Contributions Triage session to discuss the appropriate ticket.

@Dnd-Mafer
Copy link
Author

Dnd-Mafer commented Apr 17, 2025

Here is the patch for Magento Open Source

diff --git a/vendor/magento/module-catalog/Model/ResourceModel/Category/Collection.php b/vendor/magento/module-catalog/Model/ResourceModel/Category/Collection.php
--- a/vendor/magento/module-catalog/Model/ResourceModel/Category/Collection.php
+++ b/vendor/magento/module-catalog/Model/ResourceModel/Category/Collection.php	(date 1744890081397)
@@ -375,19 +375,21 @@
         array $categoryIds,
         int $websiteId
     ) : array {
-        $subSelect = clone $this->_conn->select();
-        $subSelect->from(['ce2' => $this->getTable('catalog_category_entity')], 'ce2.entity_id')
-            ->where("ce2.path LIKE CONCAT(ce.path, '/%') OR ce2.path = ce.path");
-
         $select = clone $this->_conn->select();
         $select->from(
             ['ce' => $this->getTable('catalog_category_entity')],
             'ce.entity_id'
         );
-        $joinCondition =  new \Zend_Db_Expr("cp.category_id IN ({$subSelect})");
+
+        $select->joinLeft(
+            ['ce2' =>  $this->getTable('catalog_category_entity')],
+            new \Zend_Db_Expr("ce2.path LIKE CONCAT(ce.path, '/%') OR ce2.path = ce.path"),
+            []
+        );
+
         $select->joinLeft(
             ['cp' => $this->getProductTable()],
-            $joinCondition,
+            'cp.category_id = ce2.entity_id',
             'COUNT(DISTINCT cp.product_id) AS product_count'
         );
         if ($websiteId) {

@Dnd-Mafer Dnd-Mafer changed the title Backoffice category tree is incredibly long to be displayed in 2.4.8 Backoffice category tree takes an incredibly long time to display in 2.4.8 Apr 17, 2025
@engcom-Bravo engcom-Bravo self-assigned this Apr 17, 2025
Copy link

m2-assistant bot commented Apr 17, 2025

Hi @engcom-Bravo. Thank you for working on this issue.
In order to make sure that issue has enough information and ready for development, please read and check the following instruction: 👇

  • 1. Verify that issue has all the required information. (Preconditions, Steps to reproduce, Expected result, Actual result).
  • 2. Verify that issue has a meaningful description and provides enough information to reproduce the issue.
  • 3. Add Area: XXXXX label to the ticket, indicating the functional areas it may be related to.
  • 4. Verify that the issue is reproducible on 2.4-develop branch
    Details- If the issue is reproducible on 2.4-develop branch, please, add the label Reproduced on 2.4.x.
    - If the issue is not reproducible, add your comment that issue is not reproducible and close the issue and stop verification process here!
  • 5. Add label Issue: Confirmed once verification is complete.
  • 6. Make sure that automatic system confirms that report has been added to the backlog.

@engcom-Bravo engcom-Bravo added the Reported on 2.4.8 Indicates original Magento version for the Issue report. label Apr 17, 2025
@Dnd-Mafer Dnd-Mafer linked a pull request Apr 17, 2025 that will close this issue
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Issue: ready for confirmation Reported on 2.4.8 Indicates original Magento version for the Issue report.
Projects
Status: Ready for Confirmation
Development

Successfully merging a pull request may close this issue.

2 participants