Installation and deployment
Version 7.x > Installation and deployment > Import Toolkit Performance View modes: 
User avatar
Kentico Legend
Kentico Legend
Brenden Kehren - 8/2/2013 8:01:48 AM
   
Import Toolkit Performance
I've got 60,000+ users I need to import into Kentico with roles and a custom table linking a user to another account (3rd party software). I'm able to import everything I need using the Import Toolkit although it takes upwards of 3-4 ours just to import the users. I've even went as far as turning off versoning, content staging (and logging), commented out any code that migt be executed in our global handlers and it still takes 3-4 hours. Importing the custom table records (same 60,000+ records and does an inner join during the insert) takes about 1.5 hours. Then the roles for the 60,000+ records (1 role per user) takes about 30 minutes.

My question is what are the implications of performing a insert into the Users table without using the Toolkit, API or UI? I really need to speed up the import process and would like to run in under an hour if possible.

User avatar
Kentico Customer Success
Kentico Customer Success
kentico_martind2 - 8/2/2013 5:21:02 PM
   
RE:Import Toolkit Performance
Hi Brenden,

Unfortunately, the Import toolkit wasn't created for such a huge amount of imported data. You can try to run it just from the Command line which should speed it up. In other wise I would probably recommend you to import the data rather using the API than Import toolkit. I'm sorry for this but we already know that Import toolkit needs more improvements.

Best Regards,
Martin Danko

User avatar
Kentico Legend
Kentico Legend
Brenden Kehren - 8/2/2013 5:41:21 PM
   
RE:Import Toolkit Performance
Thanks Martin. I had thought of using that and still may test it out yet.

So if I were to import directly into the cms_users and cms_usersettings tables directly what would be the ramifications of this? I don't need any logging and be a one time dump (after I do a test run of course).

User avatar
Kentico Customer Success
Kentico Customer Success
kentico_martind2 - 8/6/2013 5:55:38 PM
   
RE:Import Toolkit Performance
No problem, in general, system shouldn't be affected by making any changes directly into this tables, so yes.. of course you will need to test it as first and I hope that limits of the Import toolkit will be enhanced soon.

Regards,
Martin danko