Ticket #3522 (closed: fixed)

Opened 9 years ago

Last modified 5 years ago

Investigate possible windows speed issue with large hdf5 files

Reported by: Nick Draper Owned by: Alex Buts
Priority: critical Milestone: Release 2.1
Component: Mantid Keywords:
Cc: zikovskyjl@… Blocked By:
Blocking: Tester: Peter Peterson

Description

Check if the issue you noticed actually affects us in the implementation we are using for the event MD workspace file store and file back end implementation.

Change History

comment:1 Changed 9 years ago by Alex Buts

  • Status changed from new to accepted

comment:2 Changed 9 years ago by Alex Buts

In [13918]:

refs #3522
Three types of data access strategies evaluated together on machine with disabled prefetching and data write buffer.

comment:3 Changed 9 years ago by Alex Buts

In [13921]:

refs #3522
minor variations in output data format to allow simple import and difference between random and non-random data access

comment:4 Changed 9 years ago by Nick Draper

  • Milestone changed from Iteration 30 to Iteration 31

Bulk move of tickets to iteration 31 at the iteration 30 code freeze

comment:5 Changed 9 years ago by Nick Draper

  • Milestone changed from Iteration 32 to Iteration 33

Moved to iteration 33 at iteration 32 code freeze

comment:6 Changed 9 years ago by Alex Buts

refs #3522 different possible file modes description

Do not think, this solves the problem why the performance degradation occurs, but it shows how to avoid this degradation.

Changeset: b244588ae0f388fddacd09f5f6fc6f4abe9040ff

comment:7 Changed 9 years ago by Alex Buts

The documents describes experiment on data access speed using three different method. It does not show why the degradation occurs, but finds out how to avoid it (and the price of not-avoidance can be evaluated)

comment:8 Changed 9 years ago by Alex Buts

  • Cc zikovskyjl@… added
  • Status changed from accepted to verify
  • Resolution set to fixed

comment:9 Changed 9 years ago by Alex Buts

refs #3522 Access time comparison

Reference table

Changeset: 2a799669ac05976282727602d3d267c36fbf19b3

comment:10 Changed 8 years ago by Alex Buts

Note to testers.

The tests were implemented for raw hdf, while current Mantid works with nexus in a way, which does not allow easily separate load operations from everything else.

This makes the test largely irrelevant and left here for historical reasons.

comment:11 Changed 8 years ago by Peter Peterson

  • Status changed from verify to verifying
  • Tester set to Peter Peterson

comment:12 Changed 8 years ago by Peter Peterson

  • Status changed from verifying to closed

For the reasons mentioned by Alex and the fact that the code is in the last release...I'm going to say this "works".

comment:13 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue 4369

Note: See TracTickets for help on using tickets.