Ticket #5740 (closed: fixed)

Opened 8 years ago

Last modified 5 years ago

Better load balancing for MPI Algorithms

Reported by: Vickie Lynch Owned by: Vickie Lynch
Priority: major Milestone: Release 2.3
Component: Mantid Keywords:
Cc: Blocked By:
Blocking: Tester: Wenduo Zhou

Description

MPI tasks need to be more scalable on clusters. LoadEventNexus should create chunks by fractions of banks as well as by bank.

Change History

comment:1 Changed 8 years ago by Vickie Lynch

Refs #5740 better load balancing of banks

Changeset: 3147d97968ed43260a3bcd9f9456ff11a74fc341

comment:2 Changed 8 years ago by Vickie Lynch

Refs #5740 2 chunks per bank

Changeset: cd59c3b8aaac019c67461e3c3759e81bacb461c7

comment:3 Changed 8 years ago by Vickie Lynch

Refs #5740 both bank and event chunks

Changeset: f102af037b5ad842c019c82166184d7d69db27b4

comment:4 Changed 8 years ago by Vickie Lynch

Refs #5740 eliminate chunks with no events

Changeset: 981dbfa62d700098b02dab1428d481d8262e544d

comment:5 Changed 8 years ago by Vickie Lynch

  • Status changed from new to accepted

comment:6 Changed 8 years ago by Vickie Lynch

Refs #5740 better load balancing of banks

Changeset: 3147d97968ed43260a3bcd9f9456ff11a74fc341

comment:7 Changed 8 years ago by Vickie Lynch

Refs #5740 2 chunks per bank

Changeset: cd59c3b8aaac019c67461e3c3759e81bacb461c7

comment:8 Changed 8 years ago by Vickie Lynch

Refs #5740 both bank and event chunks

Changeset: f102af037b5ad842c019c82166184d7d69db27b4

comment:9 Changed 8 years ago by Vickie Lynch

Refs #5740 eliminate chunks with no events

Changeset: 981dbfa62d700098b02dab1428d481d8262e544d

comment:10 Changed 8 years ago by Vickie Lynch

Refs #5740 correct stop_events for many chunks

Changeset: b0dfa201176cc048d5687e785cb2bea596d7af77

comment:11 Changed 8 years ago by Vickie Lynch

Refs #5740 rank=0 has chunk=1

Changeset: 88cba78b37af19d263c8b333874b2a204dd36b28

comment:12 Changed 8 years ago by Vickie Lynch

Refs #5740 set minimum events for chunks

Changeset: 68ff3c4d59c68ee449ec2eee61651e1b5e2be5f5

comment:13 Changed 8 years ago by Vickie Lynch

Refs #5740 backgound and vanadium files for MPI

Changeset: a6c38d82b558d2c13e678d95070f9df6362b8048

comment:14 Changed 8 years ago by Vickie Lynch

Refs #5740 only can or vanadium option for MPI

Changeset: e91e9c522ffba70a692c0d3f17f2dba2ec0d5768

comment:15 Changed 8 years ago by Vickie Lynch

Refs #5740 reduced memory requirements for more cores

Changeset: a2670ed138e3e9cbdf9aa8f37631893dc19ce45c

comment:16 Changed 8 years ago by Vickie Lynch

Refs #5740 ensemble MPI run changes

Changeset: 28c96cf5a083c3d1e5cd25201885b1b7c5f6541b

comment:17 Changed 8 years ago by Vickie Lynch

Refs #5740 property value

Changeset: 7057af2e396d969683746da2dd65a43444cd4672

comment:18 Changed 8 years ago by Vickie Lynch

Refs #5740 ensemble script and vnoiseRun change

Changeset: 243b882529e00b3fdcc16bb7daf15f7fea0097d4

comment:19 Changed 8 years ago by Vickie Lynch

Refs #5740 fix Redux system test

Changeset: 146eb89a2dc24feb595f1b7e1ece306f10abebd0

comment:20 Changed 8 years ago by Vickie Lynch

Refs #5740 ensemble script changes

Changeset: 3791004b7bc58aca950fd934785d566ecacc0fbd

comment:21 Changed 8 years ago by Vickie Lynch

Refs #5740 binning in wrong units for final Rebin

Changeset: c23ac20817b099addd33895f98eb56f6f4256f5f

comment:22 Changed 8 years ago by Vickie Lynch

Refs #5740 removed barriers

Changeset: 1855419f5443192ca01082843368c47f19d2264e

comment:23 Changed 8 years ago by Vickie Lynch

Refs #5740 correct stop_events for many chunks

Changeset: b0dfa201176cc048d5687e785cb2bea596d7af77

comment:24 Changed 8 years ago by Vickie Lynch

Refs #5740 rank=0 has chunk=1

Changeset: 88cba78b37af19d263c8b333874b2a204dd36b28

comment:25 Changed 8 years ago by Vickie Lynch

Refs #5740 set minimum events for chunks

Changeset: 68ff3c4d59c68ee449ec2eee61651e1b5e2be5f5

comment:26 Changed 8 years ago by Vickie Lynch

Refs #5740 backgound and vanadium files for MPI

Changeset: a6c38d82b558d2c13e678d95070f9df6362b8048

comment:27 Changed 8 years ago by Vickie Lynch

Refs #5740 only can or vanadium option for MPI

Changeset: e91e9c522ffba70a692c0d3f17f2dba2ec0d5768

comment:28 Changed 8 years ago by Vickie Lynch

Refs #5740 ensemble MPI run changes

Changeset: 28c96cf5a083c3d1e5cd25201885b1b7c5f6541b

comment:29 Changed 8 years ago by Vickie Lynch

Refs #5740 property value

Changeset: 7057af2e396d969683746da2dd65a43444cd4672

comment:30 Changed 8 years ago by Vickie Lynch

Refs #5740 ensemble script and vnoiseRun change

Changeset: 243b882529e00b3fdcc16bb7daf15f7fea0097d4

comment:31 Changed 8 years ago by Vickie Lynch

Refs #5740 fix Redux system test

Changeset: 146eb89a2dc24feb595f1b7e1ece306f10abebd0

comment:32 Changed 8 years ago by Vickie Lynch

Refs #5740 ensemble script changes

Changeset: 3791004b7bc58aca950fd934785d566ecacc0fbd

comment:33 Changed 8 years ago by Vickie Lynch

Refs #5740 binning in wrong units for final Rebin

Changeset: c23ac20817b099addd33895f98eb56f6f4256f5f

comment:34 Changed 8 years ago by Vickie Lynch

  • Status changed from accepted to verify
  • Resolution set to fixed

To Test (one chunk vs 5 chunks): 

SNSPowderReduction(Instrument='PG3', RunNumber='2538', Extension='_event.nxs', PreserveEvents=True,CharacterizationRunsFile='/SNS/PG3/2012_2_11A_CAL/PG3_characterization_2012_08_27-HR.txt',CalibrationFile='/SNS/PG3/2012_2_11A_CAL/PG3_SS_d10729_2012_08_27.cal', Binning='0.2,-0.0004,10.',BinInDspace=True, StripVanadiumPeaks=True, FilterBadPulses=True, NormalizeByCurrent=False, SaveAs='gsas', OutputDirectory='.', FinalDataUnits='dSpacing')
RenameWorkspace(InputWorkspace="PG3_2538",OutputWorkspace="PG3_2538_event")
SNSPowderReduction(Instrument='PG3', RunNumber='2538', Extension='_event.nxs', PreserveEvents=True, CharacterizationRunsFile='/SNS/PG3/2012_2_11A_CAL/PG3_characterization_2012_08_27-HR.txt',CalibrationFile='/SNS/PG3/2012_2_11A_CAL/PG3_SS_d10729_2012_08_27.cal', MaxChunkSize='1', Binning='0.2,-0.0004,10.',BinInDspace=True, StripVanadiumPeaks=True, FilterBadPulses=True, NormalizeByCurrent=False, SaveAs='gsas', OutputDirectory='.', FinalDataUnits='dSpacing')
RenameWorkspace(InputWorkspace="PG3_2538",OutputWorkspace="PG3_2538_event_chunk")
Last edited 8 years ago by Russell Taylor (previous) (diff)

comment:35 Changed 8 years ago by Wenduo Zhou

  • Status changed from verify to verifying
  • Tester set to Wenduo Zhou

comment:36 Changed 8 years ago by Wenduo Zhou

  • Status changed from verifying to closed

comment:37 Changed 8 years ago by Vickie Lynch

Refs #5740 removed barriers

Changeset: 1855419f5443192ca01082843368c47f19d2264e

comment:38 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue ​6586

Note: See TracTickets for help on using tickets.