Ticket #9137 (closed: fixed)

Opened 7 years ago

Last modified 5 years ago

Handle realistic size generate mcstas event files

Reported by: Anders Markvardsen Owned by: Anders Markvardsen
Priority: major Milestone: Release 3.2
Component: Tools Keywords:
Cc: torben.nielsen@… Blocked By:
Blocking: #8957 Tester: Martyn Gigg

Description

When loading mcstas files containing more than about 200 MB event data block Mantid comes to a halt because of Nexus getData struggle.

Allow LoadMcStas to handle larger than 200 MB event data blocks

Change History

comment:1 Changed 7 years ago by Nick Draper

  • Status changed from new to assigned

comment:2 Changed 7 years ago by Anders Markvardsen

  • Status changed from assigned to inprogress

Can now load large mcstas nexus files. re #9137

Updated test do check that can the same results before and after.

Reading in blocks of about 50MB. This seems to work quite well on my windows system, but perhaps another value will could give a better performance

Note now that reading in part progress reporting could be improved. Not done here

Changeset: 1f5d0eb79f3445c4a9cc9d787ab171a05ef56fef

comment:3 Changed 7 years ago by Russell Taylor

comment:4 Changed 7 years ago by Anders Markvardsen

Remove compiler warning. re #9137

Changeset: a2ec33d1f25ab9de182b782c69d79fbc825f82a9

comment:5 Changed 7 years ago by Anders Markvardsen

  • Status changed from inprogress to verify
  • Resolution set to fixed

To test:

  1. Download: mccode_very_large.h5 from ftp://ftp.nd.rl.ac.uk/scratch/Anders/
  1. check that it loads into MantidPlot using the Load button (on my developing machine this takes something like 3 minutes)

comment:6 Changed 7 years ago by Martyn Gigg

  • Status changed from verify to verifying
  • Tester set to Martyn Gigg

comment:7 Changed 7 years ago by Martyn Gigg

  • Status changed from verifying to closed

I've checked that the file does indeed now load. I have created #9211 to deal with this.

comment:8 Changed 7 years ago by Martyn Gigg

Merge remote-tracking branch 'origin/feature/9137_large_files'

Full changeset: 9aab2dee4bf1e004e46d3f2ea6581b5d10dd1e7d

comment:9 Changed 6 years ago by Anders Markvardsen

  • Blocking 8957 added

comment:10 Changed 6 years ago by Anders Markvardsen

  • Milestone changed from Release 3.2 to Backlog

note in connection with this ticket the tread https://github.com/mantidproject/documents/blob/master/Design/EmbeddedInstrumentInfoNexus.md has been created

comment:11 Changed 6 years ago by Anders Markvardsen

  • Milestone changed from Backlog to Release 3.2

Ignore comment 10 made it to the wrong ticket

comment:12 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue 9980

Note: See TracTickets for help on using tickets.