What to do with old topAnat result files?

[fbastian]

In GitLab by @smoretti on Feb 20, 2018, 09:57

What to do with old topAnat result files @fbastian & @marcrr ?

Today (Feb 20, 2018) those files occupy 95GB on disk and this will continue to increase.

Should we:

• Delete some results after a while?
• Store them compressed (this is not the case currently for most of them)
• Reduce redundancy (the zip file we store contains tsv, pdf, R script, log, ... files we also store)

[fbastian]

In GitLab by @fbastian on Feb 20, 2018, 11:07

95 GB in more than 2 years of existence of TopAnat is not a concern IMO. We have the disk space to keep storing them, so just let's keep them untouched.

[fbastian]

In GitLab by @marcrr on Feb 20, 2018, 11:32

From the discussion with @smoretti @vrechdelaval @jwollbrett , I would suggest the following:

• include the release number in the hash, to allow more flexible solutions in the future.

• consider storing only zip files, in all cases or after a while (1 month?)

[fbastian]

In GitLab by @fbastian on Feb 20, 2018, 14:41

• Files are stored in a different directory per version, so I don't think it is necessary to add the version in the hash. Plus it makes URL links portable between releases. Why would you like to add it? From what @vrechdelaval tells me, it's to be able to link to a specific release? It's not managed in the hash, but in the URL directly.

• If we store only zip files, then we would need to modify the code to unzip it for displaying the results. But it's true that it would save lots of space.

I think there is no rush for now, as we don't have any problem yet.