News:

Looking for documentation? Take a look on our wiki

Main Menu

[solved] Import 100000 products with images

Started by gba, December 05, 2013, 10:54:14 AM

Previous topic - Next topic

gba

Dear all,

I am building a web shop that shall contain product data originating from an external source.
The amount of products to be imported once a day will be about 100000.
The images to be imported are stored on an external server and the import file (CSV) contains the URL of the image, only.
The import shall start at about 5:30am and should be finished within one hour.

What is the most effective and secure way to get so much product data into VM2?

Thank you very much in advance for any help!

Best regards,
Gerald

911websiterepair

we could help you with this as it is a little more complicated as you may think

you use http://www.csvimproved.com/overview

and you set the import to run as a cron

but you have to format the import file so it has corresponding fields in virtuemart so it knows what to populate. this is the only complication

as for time, there are a lot of factors that will go into this, but you must have a persistent connection in order for this work
joomla components, modules and extensions @ http://www.madeforjoomla.com
joomla development, customizations and repair speshitpillts, http://www.911websiterepair.com

Virtuemart 2.0 PayPalPro Module
Virtuemart 2.0 Fedex Shipping Module
Virtuemart 2.0 Express Order Module
Virtuemart 2.0 Authorize.net SIM payment module
http://www.virtuemartmailordermanager.com

Milbo

The best way is to write a real script for that. Franzpeter is running his stores that way.
Should I fix your bug, please support the VirtueMart project and become a member
______________________________________
Extensions approved by the core team: http://extensions.virtuemart.net/

911websiterepair

that is correct          it is not as simple as just doing an import

we specialize in this
joomla components, modules and extensions @ http://www.madeforjoomla.com
joomla development, customizations and repair speshitpillts, http://www.911websiterepair.com

Virtuemart 2.0 PayPalPro Module
Virtuemart 2.0 Fedex Shipping Module
Virtuemart 2.0 Express Order Module
Virtuemart 2.0 Authorize.net SIM payment module
http://www.virtuemartmailordermanager.com

gba

Hello!

Thank you for your replies!
I am already using CSVI.
But it is way too slow, although image processing is not necessary anymore - I display images using the URL of the originals.

Best regards,
Gerald

gba

Hi all!

I sticked to CSVI and could contribute to big improvements concerning processing speed import a large amount of product data.  ;)
Meanwhile CSVI 6 is available and way more performant than ever before.
By the way: It already supports VM3!

Best regards,
Gerald