Maximum Number of Products HikaShop can Handle?

  • Posts: 60
  • Thank you received: 3
10 years 11 months ago #175241

-- HikaShop version -- : 2.3.3

I am working on a project with HikaShop that contains a LOT of products. A LOT being in the neighborhood of more than 300,000 products. Will HikaShop be able to handle this?

What's the number of products that HikaShop could handle prior to having performance issues?

Lastly- if HikaShop could handle anywhere close to this many products, what is the suggested method of getting the images into HikaShop? I know that we can provide the URL in the import function, but I believe that HikaShop is actually importing the image into the server. Correct?

Suggestions? Feedback?

Thanks.

Please Log in or Create an account to join the conversation.

  • Posts: 84319
  • Thank you received: 13707
  • MODERATOR
10 years 11 months ago #175243

Hi,

300K products is indeed a lot. We've had users with 1 or 2 millions and they had some problems with the performances that we were able to reduce. It should be able to work but it depends the type of server you're using, how you configure your shop, if you use some caching or not, ...

Regarding the import, you're right, if you put the URL of the image, HikaShop will download the image and put it in the local upload folder. With 300K products, that's impossible.
Instead, you want to put your images in the media/com_hikashop/upload folder via FTP and then just provide the relative path from the root of the upload folder to the image.
So if you put an image in media/com_hikashop/upload/category1/subcategory1/product1.png then you want to put category1/subcategory1/product1.png in your CSV. That way, the image won't be processed at all during the import and it won't slowdown the import process.

Please Log in or Create an account to join the conversation.

  • Posts: 60
  • Thank you received: 3
10 years 11 months ago #175255

Server Specs:

  • 8 GB Memory
  • 4 Core Processor
  • 80 GB SSD Disk
  • 5 TB Transfer
If I supplied server and FTP access, could anyone help with optimization? We're having some trouble and would highly appreciate some help with the importing of the images.

For instance, the product listing page in the administrator area generates a 500 error about half the time. The page loads in the admin area with anything that loads a product list are VERY slow.

I'm in a time crunch with this site, and desperately need some optimization as soon as possible. I'm willing to pay for the services if someone can help get the site optimized for such a large list of products.

Thanks!

Last edit: 10 years 11 months ago by blueagle1829.

Please Log in or Create an account to join the conversation.

  • Posts: 84319
  • Thank you received: 13707
  • MODERATOR
10 years 11 months ago #175259

Regarding the display of the products listing in the backend, it's probably because of the categories explorer or the sub element filter.
Try to turn off the "category explorer" option of the HikaShop configuration.
If that doesn't help, change the "all sub elements" dropdown of the products listing and see if it gets faster after that. If yes, you can edit your hikashop_config table and add/update an entry with the namekey sub_products_display_all and the value 0 so that it gets set to "direct sub elements" by default.

We can potentially help if you have other issues, but we would need more information.
Ideally, if you can turn on the debug mode option of the joomla configuration and provide the slow queries displayed at the bottom of the pages which are slow, that would help identify the problem of the slow down.

Please Log in or Create an account to join the conversation.

  • Posts: 60
  • Thank you received: 3
10 years 11 months ago #175282

Thanks, Nicolas.

How would I get that information to you for additional assistance? We could definitely use the help... Thanks!

Please Log in or Create an account to join the conversation.

  • Posts: 26275
  • Thank you received: 4046
  • MODERATOR
10 years 11 months ago #175301

Hi,

By having more precise specifications about the server or how it is configured.
For example "4 Core Processor" is not really helpful because we know that there is a 4 core processor but there is no frequency or CPU type. So it does not provide any information about the server processing capabilities.
Having details about the server specs (software installed and their version) can also help to know how fast they could run..
Even if you have a powerful server, if the server is not quite configured or optimized, you can "loose" some power. Specially for the MYSQL server tuning.

Regards,

Jerome - Obsidev.com
HikaMarket & HikaSerial developer / HikaShop core dev team.

Also helping the HikaShop support team when having some time or couldn't sleep.
By the way, do not send me private message, use the "contact us" form instead.

Please Log in or Create an account to join the conversation.

  • Posts: 60
  • Thank you received: 3
10 years 11 months ago #175389

Thanks, Jerome.

The server is a DELL with hardware RAID, 8 GB of memory, and quad core Intel Xeon processors.

The software installed is as follows:

  • CentOS 6.5 (x86_64)
  • vesta core package Version: 0.9.8 (x86_64)
  • vesta-php Version: 0.9.7 (x86_64)
  • vesta-nginx Version: 0.9.8 (x86_64)

More:
Apache Version Apache/2.2.15 (CentOS)
Apache API Version 20051115

PHP Built On Linux JRC 2.6.32-431.1.2.0.1.el6.x86_64 #1 SMP Fri Dec 13 13:06:13 UTC 2013 x86_64
Database Version 5.5.40-log
Database Collation utf8_general_ci
PHP Version 5.4.33
Web Server Apache/2.2.15 (CentOS)
WebServer to PHP Interface apache2handler
Joomla! Version Joomla! 3.3.6 Stable [ Ember ] 01-October-2014 02:00 GMT
Joomla! Platform Version Joomla Platform 13.1.0 Stable [ Curiosity ] 24-Apr-2013 00:00 GMT

PHP Version 5.4.33
System Linux JRC 2.6.32-431.1.2.0.1.el6.x86_64 #1 SMP Fri Dec 13 13:06:13 UTC 2013 x86_64
Build Date Sep 20 2014 16:20:53
Server API Apache 2.0 Handler
Virtual Directory Support disabled
PHP API 20100412
PHP Extension 20100525
Zend Extension 220100525
Zend Extension Build API220100525, NTS
PHP Extension Build API20100525, NTS
Debug Build no
Thread Safety disabled
Zend Signal Handling disabled
Zend Memory Manager enabled
Zend Multibyte Support provided by mbstring
IPv6 Support enabled
DTrace Support disabled
Registered PHP Streams https, ftps, compress.zlib, compress.bzip2, php, file, glob, data, http, ftp, phar, zip
Registered Stream Socket Transports tcp, udp, unix, udg, ssl, sslv3, sslv2, tls
Registered Stream Filters zlib.*, bzip2.*, convert.iconv.*, string.rot13, string.toupper, string.tolower, string.strip_tags, convert.*, consumed, dechunk, mcrypt.*, mdecrypt.*

Does this help? If you need more information, please let me know.

Thank you again for your assistance.

Please Log in or Create an account to join the conversation.

  • Posts: 84319
  • Thank you received: 13707
  • MODERATOR
10 years 11 months ago #175392

So that's great to know your server configuration, but you didn't tell where were your slowdowns ? Which pages ? Could you give the URLs ? What is the slow query on these pages ?

Please Log in or Create an account to join the conversation.

Time to create page: 0.066 seconds
Powered by Kunena Forum