As a staff user, I would like a CSV downloads of search results to include a usable selection of fields, not all fields in Solr

Description

As noted in the comments for issue AR-1442, the "Download CSV" function, "the CSV rows are all the rows for all the records involved. It's kind of just a dump out of solr. It would be another feature to constrain the rows."

This makes the CSV download essentially unusable for large datasets. I'm not entirely clear on what is going on, but when I download the CSV for a result set of 174 accessions, I get the following error from Excel when I try to open the file:

The file contains more than 1,048,576 rows or 16,384 columns. To fix this problem, open the source file in a text editor such as Microsoft Word. Save the source file as several smaller files that conform to this row and column limit, and then open the smaller files in Microsoft Excel. If the source data cannot be opened in a text editor, try importing the data into Microsoft Access, and then exporting subsets of the data from Access to Excel.

Clearly some thought needs to go into what fields are included in the CSV download, rather than dumping everything from Solr.

Environment

None

Activity

Show:

Christine Di BellaApril 12, 2021 at 5:24 PM

There are multiple options for this now - a user can download a CSV with everything or only the columns on the screen, which are set by preferences. Closing.

Natalie AdamsDecember 15, 2020 at 2:56 PM

Just adding a comment that this would be extremely useful for our installation in Cambridge. We would like to export data for unpublished and published records on the SUI and include more fields than are possible at the moment.

Specific use cases we need this for at the moment are:-

  1. Producing reports of various different formats (eg 'audiocassette') mentioned in metadata migrated to AS (e.g. title, medium, scope content and other notes).

  2. Producing reports for internal administrative staff about records that have not been published and cannot be published.

Alston CobournFebruary 25, 2019 at 9:20 PM

see above

Lydia TangJanuary 16, 2019 at 6:44 PM

Additionally, I would like a checkbox to select rows or all rows of search results to export, not always the entire list.

Lydia TangJanuary 16, 2019 at 6:20 PM

, I wonder if Reports team would be interested in expanding their scope to address the CSV export? It seems in spirit to be part of "Reports."

Done

Details

Assignee

Reporter

Priority

Harvest Time Tracking

Open Harvest Time Tracking

Created November 15, 2016 at 2:27 PM
Updated April 12, 2021 at 5:24 PM
Resolved April 12, 2021 at 5:24 PM
Harvest Time Tracking