Ticket #3901 (closed: fixed)

Opened 9 years ago

Last modified 5 years ago

Speed up CompressEvents

Reported by: Peter Peterson Owned by: Janik Zikovsky
Priority: major Milestone: Release 2.0
Component: Mantid Keywords:
Cc: Blocked By:
Blocking: Tester: Wenduo Zhou

Description

In the degenerative case that occurs using SNSPowderDiffraction with POWGEN, all of the spectra get put into a single spectra that is partially sorted then needs to be compressed. In this case there is one thread doing all of the compression.

Do something along the lines of what SortEvents has where if there are more processors then spectra, subdivide the spectra and work on it.

Change History

comment:1 Changed 9 years ago by Peter Peterson

Currently 1/4 of powder reduction (16s of 64s) is running CompressEvents on the focussed data (12 cores with hyperthreading). I was using PG3_4832 for my benchmark.

comment:2 Changed 9 years ago by Janik Zikovsky

  • Status changed from new to accepted

comment:3 Changed 9 years ago by Janik Zikovsky

In [15069]:

Refs #3901: Option for parallel event compression. On a sorted list of 150 M events, takes about 1 second.

comment:4 Changed 9 years ago by Janik Zikovsky

  • Status changed from accepted to verify
  • Resolution set to fixed

comment:5 Changed 9 years ago by Janik Zikovsky

In [15074]:

Refs #3901: No parallelizing on Mac for CompressEvents

comment:6 Changed 9 years ago by Janik Zikovsky

In [15076]:

Refs #3901: Is this the test that fails on Mac?

comment:7 Changed 9 years ago by Wenduo Zhou

  • Status changed from verify to verifying
  • Tester set to Wenduo Zhou

comment:8 Changed 9 years ago by Wenduo Zhou

  • Status changed from verifying to closed

comment:9 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue ​4748

Note: See TracTickets for help on using tickets.