Drupal 7.x
The search module's indexing maintenance sql query takes a couple of minutes to complete each time cron gets triggered.
SELECT t.word AS realword, i.word FROM search_total t LEFT JOIN search_index i ON t.word = i.word WHERE i.word IS NULL`Database search info data info:
127k nodes
37m search_index
1.3m search_total
Search settings:100 Number of item to index per cron ron
Indexing settings:2 Minimum word length to index
Search is only enabled for nodes and once indexed, searches are fairly fast. However the actual process of re-indexing takes it's toll in our database server. Do you guys have any suggestions on how to mitigate this problem caused by extremely large websites? How do large websites scale Drupal's built-in search functionality without using additional tools like solr, elatisticsearch, etc.? All indications I'm seeing is to probably throw more hardware at this problem.