Ticket #11537 (inprogress)
ExportSampleLogsToCSVFile performance
| Reported by: | Owen Arnold | Owned by: | Wenduo Zhou |
|---|---|---|---|
| Priority: | critical | Milestone: | Release 3.5 |
| Component: | Framework | Keywords: | |
| Cc: | Blocked By: | ||
| Blocking: | Tester: |
Description (last modified by Owen Arnold) (diff)
This algorithms really struggles for exporting time series logs that contain a large number of entries. Conversely if I try to export the log table as a table in MantidPlot and save it to disk it's almost instantaneous so there must be a way to get this operation faster.
I was trying this with a workspace that contained a time series log with something of the order of 1E6 entries.
The following need to be fixed.
- There is no progress reporting
- The algorithm execution locks-up the whole of MantidPlot
- The execution time is far too long. I force quit MantidPlot after about 5 minutes.
Would be nice if this was fixed for 3.4 because we have users who want to export large time series logs as part of their experiment.
Change History
comment:2 Changed 5 years ago by Wenduo Zhou
The algorithm is written in python now and was not targeted for time series log with huge size. In order to improve the performance, this algorithm should be re-written in c++.
comment:3 Changed 5 years ago by Wenduo Zhou
- Status changed from new to inprogress
Refs #11537. Created new files in c++.
Changeset: 4287a67508bbaade1584fc52cf1573068e34d097
comment:5 Changed 5 years ago by Wenduo Zhou
Checkpointing the start of implementation. Refs #11537.
Changeset: 2daa000a1babfbfbedd3a81f239e5d7ab8da4ee3
comment:6 Changed 5 years ago by Wenduo Zhou
Checkpointing progress of translation work. Refs #11537.
Changeset: 18d873d2253b5e2bf146ebc1777e1a37b75a276e
