Ticket #7405 (closed: fixed)

Opened 7 years ago

Last modified 5 years ago

Fix remote submission of multiple files

Reported by: Mathieu Doucet Owned by: Mathieu Doucet
Priority: major Milestone: Release 2.6
Component: Framework Keywords:
Cc: Blocked By:
Blocking: Tester: Vickie Lynch

Description

For some reason submitting multiple files (N) on Fermi for EQSANS sends N jobs with the N files being reduced in each job... This needs to be fixed.

Change History

comment:1 Changed 7 years ago by Mathieu Doucet

Re #7405 Fix submission

Changeset: f94516a2a6b952a7b452b8b5c65db40b20296d25

comment:2 Changed 7 years ago by Mathieu Doucet

Re #7405 make sure process info makes it to file

Changeset: ec591ee5838d2e18bae014058a333be294c58c69

comment:3 Changed 7 years ago by Mathieu Doucet

Re #7405 Save separate-job to output file

Changeset: da149976dc1e328aac476dfc6753f1aeb274a6cd

comment:4 Changed 7 years ago by Mathieu Doucet

Re #7405 Save separate-job to output file

Changeset: a69a931ccf40a7b69740b50f074e2377e9d36964

comment:5 Changed 7 years ago by Mathieu Doucet

Re #7405 Save log for each job

Changeset: fb2f9f59773af6d72c1bfcc1d7daece0492e7df2

comment:6 Changed 7 years ago by Mathieu Doucet

Re #7405 Save log for each job

Changeset: 49a0cdae1e490d27c01040645d73d0d8fe9bf4df

comment:7 Changed 7 years ago by Mathieu Doucet

Re #7405 Save log for each job

Changeset: 7bf35856a3ae114e3b818fc4c2f51b162a8c8921

comment:8 Changed 7 years ago by Mathieu Doucet

  • Status changed from new to accepted

To test:

  • Compile with -DMAKE_REMOTE_JOBS=TRUE
  • Run Mantidplot on an analysis machine (but not on biganalysis06)
  • Load an EQSANS job from a previously saved XML file, but add a second file in the "scattering data file" field on the Data tab.
  • Check the "treat commat-separated files as separate reduction jobs" box.
  • Hit "Send cluster"
  • Go in your home directory and check that each of the files job_submission_N.py have only one entry of the form AppendDataFile(...) and that it is different for each file. There should be one job for each data file, and the job should only reduce that particular data file.

comment:9 Changed 7 years ago by Mathieu Doucet

  • Status changed from accepted to verify
  • Resolution set to fixed
  • type changed from enhancement to defect

comment:10 Changed 7 years ago by Mathieu Doucet

Re #7405 Fix submission

Changeset: 8b3d9c18ebb811375d4be36e326e3c5935dab767

comment:11 Changed 7 years ago by Mathieu Doucet

Re #7405 make sure process info makes it to file

Changeset: 8ff6db1ffdff7cd2d3bd25d1c9455ddac2e515a0

comment:12 Changed 7 years ago by Mathieu Doucet

Re #7405 Save separate-job to output file

Changeset: 801ef8f880e33fe10aea8d46a10bcbf604b87623

comment:13 Changed 7 years ago by Mathieu Doucet

Re #7405 Save separate-job to output file

Changeset: 6b25b87515a6c4aed843126432e5e9d3bb8b3355

comment:14 Changed 7 years ago by Mathieu Doucet

Re #7405 Save log for each job

Changeset: 2117891fd9b14a73b686248182cce0d179f302b1

comment:15 Changed 7 years ago by Mathieu Doucet

Re #7405 Save log for each job

Changeset: ad5dc70a87920479795dcb2ba22edbcec583c7a3

comment:16 Changed 7 years ago by Mathieu Doucet

Re #7405 Save log for each job

Changeset: c554b0e44921c280f553fe16027d66be2d66b79f

comment:17 Changed 7 years ago by Vickie Lynch

  • Status changed from verify to verifying
  • Tester set to Vickie Lynch

comment:18 Changed 7 years ago by Vickie Lynch

  • Status changed from verifying to closed

One file reduced in each remote job

comment:19 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue ​8251

Note: See TracTickets for help on using tickets.