Ticket #5139 (closed: fixed)

Opened 8 years ago

Last modified 5 years ago

Speed up LoadEventNexus

Reported by: Peter Peterson Owned by: Peter Peterson
Priority: major Milestone: Release 2.1
Component: Mantid Keywords:
Cc: Blocked By:
Blocking: Tester: Vickie Lynch

Description

The bottleneck for all reduction is file loading.

Change History

comment:1 Changed 8 years ago by Peter Peterson

  • Owner set to Peter Peterson
  • Status changed from new to accepted

comment:2 Changed 8 years ago by Peter Peterson

Refs #5139. Changed how thread cost is calculated.

Changeset: dd329deffe4e69a6e58a058fcf7c2dc62ae78ae4

comment:3 Changed 8 years ago by Peter Peterson

Refs #5139. Changed how thread cost is calculated.

Changeset: dd329deffe4e69a6e58a058fcf7c2dc62ae78ae4

comment:4 Changed 8 years ago by Janik Zikovsky

Refs #5139 debugging algorithm for testing nexus saving/loading speed

Changeset: 91d53d1a94e240ad706b82ec7597309d96ce678e

comment:5 Changed 8 years ago by Janik Zikovsky

Refs #5139 documentation fixes

Changeset: 08c23256134ab3af792ee1043b3192317dbf6aa7

comment:6 Changed 8 years ago by Janik Zikovsky

Refs #5139 fix incorrect rate calculation in NexusTester

Changeset: 3061f8d1e30a50cf7619c1ed91f0e74223a91c71

comment:7 Changed 8 years ago by Janik Zikovsky

Refs #5139 fix incorrect rate calculation in NexusTester

Changeset: 166493d84e1c85d7a24d749acfe1bce18c447534

comment:8 Changed 8 years ago by Janik Zikovsky

Refs #5139 report compression factor, and clear disk cache

if you run MantidPlot with sudo

Changeset: c376ee6ef68cf30d0143a0b27a6146d48bd33fde

comment:9 Changed 8 years ago by Janik Zikovsky

Refs #5139 measure disk speed too

Changeset: abd3031310d9d6d83c683a4b9e77bd852f1df4f2

comment:10 Changed 8 years ago by Peter Peterson

Refs #5139. Modified logic for choosing which thread to run.

Changeset: 28695c14ae592d5d7c99a295c18e29dc2abca8a8

comment:11 Changed 8 years ago by Peter Peterson

Refs #5139. Changed which scheduler is used in LoadEventNexus.

Changeset: a096c888571d4acb83b32325c620cd7a0dd82e4d

comment:12 Changed 8 years ago by Janik Zikovsky

Refs #5139 another NexusTester option

Changeset: 7f09ce1979b2630250f7516212221f50c11e4b12

comment:13 Changed 8 years ago by Peter Peterson

Refs #5139. Small improvements led by the profiler.

Changeset: 192bb186ad23ce6ceb59e32d2196df7b21f45e17

comment:14 Changed 8 years ago by Peter Peterson

Revert "Refs #5139. Small improvements led by the profiler."

This reverts commit 192bb186ad23ce6ceb59e32d2196df7b21f45e17.

Changeset: e60ba6a2b984b1d5a7a0d2f0fa30d685e073e0c7

comment:15 Changed 8 years ago by Peter Peterson

Refs #5139. Added explicit assignment operator to DateAndTime.

Changeset: 1a7774023a3abda53808d0f51cdb195722ef8ae9

comment:16 Changed 8 years ago by Peter Peterson

Refs #5139. Removing commented out debug prints.

Changeset: aa86d40426a43d5975b18764da71a137741a9f99

comment:17 Changed 8 years ago by Peter Peterson

  • Status changed from accepted to verify
  • Resolution set to fixed

comment:18 Changed 8 years ago by Janik Zikovsky

Refs #5139 debugging algorithm for testing nexus saving/loading speed

Changeset: 91d53d1a94e240ad706b82ec7597309d96ce678e

comment:19 Changed 8 years ago by Janik Zikovsky

Refs #5139 documentation fixes

Changeset: 08c23256134ab3af792ee1043b3192317dbf6aa7

comment:20 Changed 8 years ago by Janik Zikovsky

Refs #5139 fix incorrect rate calculation in NexusTester

Changeset: 3061f8d1e30a50cf7619c1ed91f0e74223a91c71

comment:21 Changed 8 years ago by Janik Zikovsky

Refs #5139 fix incorrect rate calculation in NexusTester

Changeset: 166493d84e1c85d7a24d749acfe1bce18c447534

comment:22 Changed 8 years ago by Janik Zikovsky

Refs #5139 report compression factor, and clear disk cache

if you run MantidPlot with sudo

Changeset: c376ee6ef68cf30d0143a0b27a6146d48bd33fde

comment:23 Changed 8 years ago by Janik Zikovsky

Refs #5139 measure disk speed too

Changeset: abd3031310d9d6d83c683a4b9e77bd852f1df4f2

comment:24 Changed 8 years ago by Peter Peterson

Refs #5139. Modified logic for choosing which thread to run.

Changeset: 28695c14ae592d5d7c99a295c18e29dc2abca8a8

comment:25 Changed 8 years ago by Peter Peterson

Refs #5139. Changed which scheduler is used in LoadEventNexus.

Changeset: a096c888571d4acb83b32325c620cd7a0dd82e4d

comment:26 Changed 8 years ago by Janik Zikovsky

Refs #5139 another NexusTester option

Changeset: 7f09ce1979b2630250f7516212221f50c11e4b12

comment:27 Changed 8 years ago by Peter Peterson

Refs #5139. Small improvements led by the profiler.

Changeset: 192bb186ad23ce6ceb59e32d2196df7b21f45e17

comment:28 Changed 8 years ago by Peter Peterson

Revert "Refs #5139. Small improvements led by the profiler."

This reverts commit 192bb186ad23ce6ceb59e32d2196df7b21f45e17.

Changeset: e60ba6a2b984b1d5a7a0d2f0fa30d685e073e0c7

comment:29 Changed 8 years ago by Peter Peterson

Refs #5139. Added explicit assignment operator to DateAndTime.

Changeset: 1a7774023a3abda53808d0f51cdb195722ef8ae9

comment:30 Changed 8 years ago by Peter Peterson

Refs #5139. Removing commented out debug prints.

Changeset: aa86d40426a43d5975b18764da71a137741a9f99

comment:31 Changed 8 years ago by Vickie Lynch

  • Status changed from verify to verifying
  • Tester set to Vickie Lynch

comment:32 Changed 8 years ago by Vickie Lynch

  • Status changed from verifying to closed

Loading NOM files is faster with these changes

comment:33 Changed 8 years ago by Russell Taylor

Revert "Refs #5139. Added explicit assignment operator to DateAndTime."

This reverts commit 1a7774023a3abda53808d0f51cdb195722ef8ae9.

The addition of these special methods had a negative impact on a number of performance tests. Presumably they put a stop to some optimisation that the compiler was able to do with the implicitly generated versions.

Changeset: 1894bf932ce7398b58ecaa7e987daa83869d8d79

comment:34 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue 5985

Note: See TracTickets for help on using tickets.