Product Image Resizing blowing up my file quota

[kittmaster]

I have image resize active. All default paths. My virtuemart is not accessible to public and only seen by registered users. I have 92K product images....I have deleted the resized folder images......and it appears the issues seem to be when the site is spidered, somehow it triggers to allow the resize to be generated even if a registered user is not present. I've added disallow to the entire stories/viruemart path in the robots.txt file.....but it keeps happening.

I need the resize for when the category view is used but it is causing my quote to get bumped into by all the additional triggers.

Any ideas how to correct this?

Thanks.

[AH]

https://docs.virtuemart.net/tutorials/templating-layouts/222-different-thumbnail-sizes.html

Turn off auto thumbnail resize if you want to stop thumbnails - NOTE - I am unsure as to why you would want to do that!

The thumbnail creation only happens when the product appears on a page - and when a thumbnail for the size stated does not exist - resize should happen only the first time the product is viewed

As a one off, you could always create your thumbnails manually using some automation tool that names them according to the thumbnail sizes set -  you could then just upload these images to the resized folder via FTP

Thereafter for new items the volume of new items and auto resize should not matter

[kittmaster]

Thanks for the response....

You are correct, I don't want to turn off resizing as it is used in email and the page categories......I think I set to 250 for thumb and default image is 350 based on my needs.

So last night I zeroed the resized folder.......today there 2601 resized images there.

I'm a DJ company using it to create music playlists for clients as I don't sell music, its more of a customer can create their party music playlist type of thing. We are busy but with the clients I have now.....not 2K busy and I've looked, no one has been logged in for at least 6 days.......so where is the 2601 thumbnails coming from?

In my mind, I have to believe it's a spidering issue that creates the pages and forcing the thumbs to be built.....

As a side note, I can live with 350 size and can do without the resized images.....my question is the category A-Z page is using resized to display the info and song album art.......Where do I override it (which file controls it?) to use the regular sized product images vs the resized version?

If I can figure that out, I will nix the resized all together for expediency.

TY

[Studio 42]

when you access and edit products, if you use thumbs in orders ... the resized image get generate, if not exist.

[kittmaster]

As I mentioned, there is NO ONE logged into the system and accessing that area for the non existent products to start the thumb generation. So I need to make it stop.

[GJC Web Design]

So u never want any thumbs generated?

because as soon as a visitor or spider accesses the page the thumb is produced

if so then dynamic resizing needs to be switched off and all your templates changed to call the full sized image and resize by css

surely getting a larger hosting would be cheaper/easier/simpler?

[kittmaster]

Yes, you have it now, I only want thumb generated when actual people are using the site (more manageable).

If I could keep the spiders out, it would be a non-issue.

I'm on a shared host and the next step up is like $125 a month, I can't justify that cost at this time as we are selective on how many jobs a year we take.

I can't move because my domain is tied into my contract, so I kind of screwed myself a few years back.

I have no issue using full size only, but for some reason the catagory view is using thumbs and when turned off, don't display the images.....somehow I need an override (which I have currently for multiple areas of the site), but not sure where for this issue.

Is there a way for banning all traffic to that folder EXCEPT for virtuemart access only from a registered user and not a spider?

Thank you.
Chris

[GJC Web Design]

but how can a spider be accessing your cat pages if you say the site is only accessible to registered users?

you need to search your logs to find how the pages are being accessed that trigger the thumb creation

and to show full size instead of thumbs in your cat pages is just a simple change in the template.. but we have no info on what template etc

or even versions

just compare the image call from the details page

[kittmaster]

That is where my confusion comes from, I have only registered user able to access the menu links to the virtuemart area i.e. song playlists.

So I am assuming it has to be a spider with how fast the images are being created the resized area......and it "seems" to be being done by index product ID value as the time file names are using an ascending format.

What logs would those be? I'm not sure how or where to access the logs you mention. Is this inside of VM or on the webhost in the admin area?

I'm using Joomla 3.4.8 and VM 3.0.10. The site template is the Beez_20 from 2.5 because of all the overrides that allow the site to operate based on my needs.

You can see it working here:

http://aaron-beachproductions.com

User: demo
Pass: demo

Under client portal > Songs A-Z

Thanks for your responses......I may have a few thoughts to fix it. I'm thinking I don't have the modules and plugs for VM set to registered vs public....maybe that could be a possible cause.

[jenkinhill]

Access logs can usually be viewed/downloaded from the server cPanel and/or downloaded by ftp from the server, where they may be found in a logs directory below the normal web root.

[GJC Web Design]

but I can access any  cat or song I like by using std. VM urls

e.g. http://aaron-beachproductions.com/index.php?option=com_virtuemart&view=category&virtuemart_category_id=3

this is not logged in etc

so can any spider I guess

tell me if u want this post deleted

[Studio 42]

I think some of your registred user using HTTrack or similar, to get all files.
Have you check your PHP acces log file ? This should answer your question.
Vm cannot add thumbs when no one access your site.

[kittmaster]

but I can access any  cat or song I like by using std. VM urls

e.g. http://aaron-beachproductions.com/index.php?option=com_virtuemart&view=category&virtuemart_category_id=3

this is not logged in etc

so can any spider I guess

tell me if u want this post deleted

I agree, I think this is part of the problem, not exactly sure how to remedy it. Is this something .htaccess could contend with?

[jenkinhill]

Yes, you can use .htaccess to limit access - but you need to check the access logs to grab their IPs and confirm this is the problem.  I fixed a client site that went over its bandwidth quota regularly. It was a competitor harvesting his site every night presumably to check prices.....

[GJC Web Design]

agree with jenks.. u need to find what/who visits all your cats  .. access logs