Again: massive server overload with J 3.9.1

Studio 42 · December 04, 2018, 17:23:42 PM

Some .htaccess rule can bad redirect too. So check your rewriting rules.
Another problem is when you hardcode the http links and have rewrite rules to https, Joomla can use and rewrite relative links not absolute links. If you have image links that are not relative, the problem is same.

marscom · December 04, 2018, 17:35:16 PM

Hi Studio42,

we'll check that. Thanks for this precious hint! Although, I'm still wondering why we have the issue after updating to J3.9.1 and even more after updating VM to the beta version.

Cheers

Martin

marscom · December 05, 2018, 10:36:06 AM

So we tried everything that was proposed so far. We could track down the problem a little:
Google indexes more than 1.4 URLs of the site www.kauer.ch - every second, a few thousands more. The URLs in Google look something like:

https://www.kauer.ch/index.php/de/produktsuche-ergebnisse/bett__or__gartenstuhl__or__gastrolounge__or__kommoden__or__buerotisch__or__regale2013-03-07-14-06-13__or__beistelltische__or__badmoebel__or__nachttische__or__duvet-kissen__or__test__or__schaffner-gartenm%c3%b6bel/

Now the weird thing: when you modify one of the words or numbers, there is no error page, but simply a new listing. But when one modifies the URL of non-shop-related addresses, then we have a correct 404 page.

Help... the server consumes actually the capacity of around 300 webspaces...

Thanks for every hint!

Martin

AH · December 05, 2018, 10:59:46 AM

Even very badly worded "product url" with a valid category urls give a result

example:-
https://www.kauer.ch/index.php/de/produktsuche-ergebnisse/bad-url-from-me

Network tools:
Shows your site gives a 200 response to this url
However - there is also NO "canonical url" in the <Head> - so google will potentially index this url and keep visiting it

marscom · December 05, 2018, 11:14:58 AM

Hi AH,

thanks so far. So what do you propose to put in the head of index.php?

GJC Web Design · December 05, 2018, 11:19:47 AM

Have u disabled the VM 404 error handling? this is in the VM config

IMHO non existing urls should give a 404 response otherwise there is nothing to tell Google not to index them

marscom · December 05, 2018, 11:23:13 AM

Yes, the 404 error handling is disabled (see previous post in this thread).

GJC Web Design · December 05, 2018, 11:25:21 AM

try to track down then why no 404 is given .. try without sef and use the full VM url with a non existent product id etc .. what happens?

Is it VM, Joomla or at server level?

jenkinhill · December 05, 2018, 11:42:45 AM

Canonicals are generated in view.html.php for products, categories etc - last year I fixed a site where the template developer had hacked the view.html.php files (not recommended!) and for some reason the canonical code was removed.

marscom · December 05, 2018, 12:47:21 PM

Hi jenkinhill,

Now THAT's a hint! Because I had to modify view.html.php (adding a module), I probably screwed up the code. Now I renamed it to NEWview.html.php in the html directory and we'll see what happens.

Thanks a lot!

Martin

Milbo · December 06, 2018, 00:03:05 AM

Why did you change the view.html.php to add a module?

marscom · December 06, 2018, 06:01:32 AM

Hi Milbo,

the client wanted a half-width slider for just one category at the end of the shop entry page. The other half should have been filled with another custom module. Therefore I added these in the view.html.php. This worked with no problem, but the slider module itself didn't do the job as expected. So we're back to normal with this page.

But the problem with the overload still persists. We're really, really at the end of our wisdom.

marscom · December 06, 2018, 07:35:51 AM

Hi again,

since the 3.4.3 update, there is another problem, not related (obviously) to the overload: The product modules are going crazy in the backend (see attachment). They cannot be modified anymore. Hope there don't come out more such surprises with the beta version...
What can we do in the meantime?

GJC Web Design · December 06, 2018, 10:18:57 AM

switch on Joomla debug and full reporting so u can see WHERE VMlang is missing

AIO updated?
no module over ride etc?

marscom · December 06, 2018, 12:06:12 PM

Hi,

I had installed the complete beta package. But when I try to update the AIO database, I get an empty page in return. And: there are no modules overridden. The problem still persists: VM-modules cannot be modified in the BE (see previous screenshot)

News:

Again: massive server overload with J 3.9.1