Author Topic: Speed and Navigation in very large VM site  (Read 2302 times)

behemoth

  • Jr. Member
  • **
  • Posts: 81
Speed and Navigation in very large VM site
« on: April 05, 2019, 09:58:01 am »
VM is currently 3.4 but ideally we want an extension that is supported by the widest possible selection of versions for future-proofing.

We have a site with currently 1.8 million products, but due to the nature of our business this is set to grow - slowly but indefinitely.

Both site search and product filtering are incredibly slow (in the order of tens of seconds) and clearly this not acceptable for customers. I've done a lot of work on the front end and I'm getting reasonable pagespeed scores for specific metrics, but the backend / database is clearly the bottleneck.

We've had some good results implementing an ElasticSearch component to handle site search, but the results it returns can't be filtered.

I'm currently testing implementing varnish cache, and while it performs fantastically for cached pages, it doesn't help uncached ones and logged in users don't see cached pages. It's also a massive job (perhaps impossible?) to try to warm a cache of that size.

I can provide a more detailed specification if you're interested in the job.

haydenmellins

  • Readers
  • *
  • Posts: 0
  • Web Professional and Developer
Re: Speed and Navigation in very large VM site
« Reply #1 on: April 06, 2019, 14:28:54 pm »
Hi @behemoth,

Hope you are doing well.

I sent you PM. Please revert back to me for further discussion.

Regards,
Hayden  :)

Studio 42

  • Contributing Developer
  • Sr. Member
  • *
  • Posts: 4351
  • Joomla & Virtuemart developper
    • Studio 42 - Virtuemart & Joomla extentions
  • VirtueMart Version: 2.6 & 3
Re: Speed and Navigation in very large VM site
« Reply #2 on: April 06, 2019, 22:39:10 pm »
reader with 0 post ?
Be a little serious.

hellorain

  • Jr. Member
  • **
  • Posts: 127
    • Raincreatives - Virtuemart & Mobile Commerce Experts
  • Skype Name: raincreatives
Re: Speed and Navigation in very large VM site
« Reply #3 on: April 07, 2019, 06:30:49 am »
Hello,

We are ready to start.

Best Regards,
hellorain.
Raincreatives - Virtuemart & Mobile Commerce Experts

JoomlaGeek.com

  • Readers
  • *
  • Posts: 0
  • A beginner
    • JoomlaGeek.com
  • Skype Name: vietthanh.nguyen
  • VirtueMart Version: 3
Re: Speed and Navigation in very large VM site
« Reply #4 on: September 10, 2019, 08:59:43 am »
Hello,

You can use our Geek ElasticSearch component, it supports VirtueMart and many other 3rd party extensions.
https://www.joomlageek.com/product/component-geek-elasticsearch

You can checkout demo for VirtueMart search and filters here
http://elasticsearch.demo.joomlageek.com/virtuemart-filters

Studio 42

  • Contributing Developer
  • Sr. Member
  • *
  • Posts: 4351
  • Joomla & Virtuemart developper
    • Studio 42 - Virtuemart & Joomla extentions
  • VirtueMart Version: 2.6 & 3
Re: Speed and Navigation in very large VM site
« Reply #5 on: September 11, 2019, 23:23:52 pm »
demo with 1200 products only ? You should do a demo with 100 000 products or more, so we can verify the speed.
And how big is the server ?

JoomlaGeek.com

  • Readers
  • *
  • Posts: 0
  • A beginner
    • JoomlaGeek.com
  • Skype Name: vietthanh.nguyen
  • VirtueMart Version: 3
Re: Speed and Navigation in very large VM site
« Reply #6 on: August 11, 2020, 10:24:52 am »
Hello,

You can test the website below of our client, it has more than one million products, and the search + filters works very fast
https://www.azeeda.com/search

pinochico

  • 3rd party VirtueMart Developer
  • Full Member
  • *
  • Posts: 579
    • MiniJoomla
  • Skype Name: support-easysoftware
  • VirtueMart Version: 3
Re: Speed and Navigation in very large VM site
« Reply #7 on: August 11, 2020, 12:49:26 pm »
We use geekelasticsearch on cosmetic website with 45000 products.

They was very quickly, but every month we must pay to amazon for special DB server 100-200 USD.
And view for result was not as we need (we must develop custom view with a lot of hours...)

Then I stop use this solution after 4 months.

This year we creating new own solution together with Rupostel with Free DB.
www.minijoomla.org  - new portal for Joomla!, Virtuemart and other extensions
XML Easy Feeder - feeds from products, orders and database table
Virtuemart Email Manager - customs email templates

JoomlaGeek.com

  • Readers
  • *
  • Posts: 0
  • A beginner
    • JoomlaGeek.com
  • Skype Name: vietthanh.nguyen
  • VirtueMart Version: 3
Re: Speed and Navigation in very large VM site
« Reply #8 on: Yesterday at 13:08:24 »
Hello Pinochico,

You can download Elasticsearch on its official website and install it on your server, it is totally free
https://www.elastic.co/downloads/elasticsearch

So you don't have to pay monthly fees for cloud search providers.