Kentico solution for millions of records

hadi tag asked on September 12, 2015 14:37

Hi,

i using kentico 8.1 and i have aboute 75,000,000 Documents with one attachment per document. Also, I want all the files stored on the file system.

kentico what the solution to this number of records. Should I use a page type or custom table to get the best performance and maximum speed for load each document and search whitin?? kentico How many of record supports without any performance problem??

also for this case, what should be the server requirement??

millions records performance

Recent Answers

Olivier Cozette answered on September 12, 2015 20:40 (last edited on September 13, 2015 17:12)

Eager to see a valid answer to this one !

75 M docs... wow.. that's a lot of data right there.

I'll try thinking some basics facts: you should have no more than 1000 docs per node. So you will need 75.000 nodes. And then you will need 75 super nodes, containing 1000 nodes each one...

Having said that, we will need more info about your 75M documents to state a solution: what type of attachments, size of e/o, do you need to index also the attachments ? what's the logic about your documents, is there any numbered sequence, alphabetical order, etc. etc.

0 votesVote for this answer Mark as a Correct answer

hadi tag answered on September 12, 2015 21:53

Thank you for your attention.

yes i have 75M record and each record have a pdf file. And each file is about 1 MB size and i do not need to index the attachments .

Is there a solution to this case??

0 votesVote for this answer Mark as a Correct answer

Brenden Kehren answered on September 13, 2015 04:45

Have you read the performance report on Kentico 8? It is only tested with 100,000 pages but if you're looking for more, you might reach out to Kentico Support directly (support at kentico dot com) and ask them directly.

0 votesVote for this answer Mark as a Correct answer

Lukas Martinak answered on September 13, 2015 12:06

Before we jump into conclusions, we need to have some additional information about the story behind. If you send us an e-mail to consulting[at]kentico[dot]com, one of our solution architects will reach out to you and suggest the right way to implement it based on your requirements. Then, we can share the results here.

I know for sure that 75M pages in the content tree without any customization and optimization is not an option (it goes far beyond Kentico's limits and its common usage).

0 votesVote for this answer Mark as a Correct answer