Solr results returns contents of files and pages

[torleif]

The solr extension is configured to return all indexed fields. This is redundant as only class name, ID, and a few others are needed. returning a large file will cause memory exceeded errors on some large files.

[dhensby]

Interesting; @torleif do you have any suggestions as to how we could fix this? Would you be willing to submit a PR?

[torleif]

there's a way to tell solr to only return some fields. but forcing it to not return content for files, but for database indexes might be a bit of a challenge.

our solution was pretty heavy handed and we just removed all files from our index.

I'm willing to do a PR, but i've promised PRs in the past and not had time to do them :(

[emteknetnz]

Hi, can you still remember this one? Can you remember what was causing the memory to be exceeded? Was it the XML results returned by Apache_Solr, or was it the contents of 100 File DataObjects?

[torleif]

Hi @emteknetnz

The problem was the XML returned by Solr contained the file contents. If your search result happened to have one 200MB file, or say four 50MB files, it would exceed the PHP memory limit and cause an error.

I wanted to write a patch that would tell Solr to not return the file contents (after all, only the title, ID and summary are needed).

[emteknetnz]

OK, do you know where we could make code change, would it happen within one of the SolrService / SolrService_Core / Solr4Service_Core type of classes? Are you able to do a PR for this?