Ticket #11537 (inprogress)

Opened 5 years ago

Last modified 5 years ago

ExportSampleLogsToCSVFile performance

Reported by: Owen Arnold Owned by: Wenduo Zhou
Priority: critical Milestone: Release 3.5
Component: Framework Keywords:
Cc: Blocked By:
Blocking: Tester:

Description (last modified by Owen Arnold) (diff)

This algorithms really struggles for exporting time series logs that contain a large number of entries. Conversely if I try to export the log table as a table in MantidPlot and save it to disk it's almost instantaneous so there must be a way to get this operation faster.

I was trying this with a workspace that contained a time series log with something of the order of 1E6 entries.

The following need to be fixed.

  • There is no progress reporting
  • The algorithm execution locks-up the whole of MantidPlot
  • The execution time is far too long. I force quit MantidPlot after about 5 minutes.

Would be nice if this was fixed for 3.4 because we have users who want to export large time series logs as part of their experiment.

Change History

comment:1 Changed 5 years ago by Owen Arnold

  • Description modified (diff)

comment:2 Changed 5 years ago by Wenduo Zhou

The algorithm is written in python now and was not targeted for time series log with huge size. In order to improve the performance, this algorithm should be re-written in c++.

comment:3 Changed 5 years ago by Wenduo Zhou

  • Status changed from new to inprogress

Refs #11537. Created new files in c++.

Changeset: 4287a67508bbaade1584fc52cf1573068e34d097

comment:4 Changed 5 years ago by Wenduo Zhou

  • Milestone changed from Release 3.4 to Release 3.5

comment:5 Changed 5 years ago by Wenduo Zhou

Checkpointing the start of implementation. Refs #11537.

Changeset: 2daa000a1babfbfbedd3a81f239e5d7ab8da4ee3

comment:6 Changed 5 years ago by Wenduo Zhou

Checkpointing progress of translation work. Refs #11537.

Changeset: 18d873d2253b5e2bf146ebc1777e1a37b75a276e

comment:7 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue 12375

Note: See TracTickets for help on using tickets.