Ticket #3514 (closed: fixed)

Opened 9 years ago

Last modified 5 years ago

LoadEventNexus: speed up (if possible)

Reported by: Janik Zikovsky Owned by: Janik Zikovsky
Priority: critical Milestone: Iteration 30
Component: Mantid Keywords:
Cc: Blocked By:
Blocking: Tester: Wenduo Zhou

Description


Change History

comment:1 Changed 9 years ago by Janik Zikovsky

  • Priority changed from major to critical
  • Status changed from new to accepted

comment:2 Changed 9 years ago by Janik Zikovsky

21.6 sec for PG3_3390_event.nxs is my starting point. I don't see many cores being utilized for some reason, is it running single core?

comment:3 Changed 9 years ago by Janik Zikovsky

4.75 seconds. That's more like it. Martyn accidentally de-parallelized the algorithm.

comment:4 Changed 9 years ago by Janik Zikovsky

  • PG3_3390_event.nxs (183 MB) : takes 4.75 seconds
  • NOM_547_event.nxs (1.9 GB file) : takes 45.04 seconds
  • SEQ_4533_event.nxs (533 MB) : takes 15.83 seconds
  • SNAP_4111_event.nxs (616 MB) : takes 43.97 seconds including loading the SNAP instrument. 35 seconds without instrument loading.

These are in debug build, no compress, no precount. 8 core machine.

Last edited 9 years ago by Janik Zikovsky (previous) (diff)

comment:5 Changed 9 years ago by Janik Zikovsky

In [13767]:

Refs #3514: Used similar tricks in LoadEventNexus that were used before in LoadEventPreNexus. 10-20% speed up that way.
Also, re-enabled the parallel loading, which makes a much bigger difference!

  • PG3_3390_event.nxs (183 MB) : takes 4.10 seconds
  • NOM_547_event.nxs (1.9 GB file) : takes 37.94 seconds
  • SEQ_4533_event.nxs (533 MB) : takes 11.24 seconds
  • SNAP_4111_event.nxs (616 MB) : takes 37.7 seconds including loading the SNAP instrument. 33.97 seconds without instrument loading.

comment:6 Changed 9 years ago by Janik Zikovsky

  • Status changed from accepted to verify
  • Resolution set to fixed

Good enough!

comment:7 Changed 9 years ago by Wenduo Zhou

  • Status changed from verify to verifying
  • Tester set to Wenduo Zhou

comment:8 Changed 9 years ago by Wenduo Zhou

  • Status changed from verifying to closed

comment:9 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue ​4361

Note: See TracTickets for help on using tickets.