Ticket #10413 (closed: fixed)

Opened 6 years ago

Last modified 5 years ago

Update script that runs the reduction

Reported by: MarcusNoble Owned by: Lottie Greenwood
Priority: critical Milestone: Release 3.4
Component: Tools Keywords: AUTOREDUCTION
Cc: doucetm@…, tom.griffin@…, nick.draper@…, anders.markvardsen@… Blocked By:
Blocking: #10147 Tester: Anders Markvardsen

Description (last modified by MarcusNoble) (diff)

Need to update the script that receives and processes the reduction jobs to listen for it from the webapp.

Required changes:

  • /etc/autoreduce/post_process_consumer.conf
    • Add credentials
    • Change ActiveMQ queues
    • Remove SNS specific
    • Change error to correct queue
  • /usr/bin/queueProcessor.py
    • Remove heartbeat? If not, make sure it's sending to a topic?
    • Update subprocess call
    • NOTE: 'data' is the JSON
  • /usr/bin/PostProcess.py
    • Check for correct values
    • correct instrument directory
    • Script missing -> Error queue
    • Script path in JSON
    • Output directory
    • Call to reduce.py passing in args
    • Include output directory in response

Also make sure ActiveMQ is called with credentials over SSL. This may require changes to other files. If so, open a new ticket to address.

  • Needs testing with a full workflow script

Change History

comment:1 Changed 6 years ago by MarcusNoble

  • Status changed from new to assigned

comment:2 Changed 6 years ago by MarcusNoble

  • Description modified (diff)

comment:3 Changed 6 years ago by MarcusNoble

  • Status changed from assigned to inprogress

comment:4 Changed 6 years ago by MarcusNoble

  • Description modified (diff)

comment:5 Changed 6 years ago by MarcusNoble

  • Description modified (diff)

comment:6 Changed 6 years ago by MarcusNoble

  • Description modified (diff)

comment:7 Changed 6 years ago by MarcusNoble

  • Description modified (diff)

comment:8 Changed 6 years ago by MarcusNoble

  • Status changed from inprogress to assigned
  • Description modified (diff)

Moving back to assigned for now until servers are set up and ready for testing.

comment:9 Changed 6 years ago by MarcusNoble

  • Description modified (diff)

comment:10 Changed 6 years ago by Nick Draper

  • Milestone changed from Release 3.3 to Release 3.4

comment:11 Changed 5 years ago by Lottie Greenwood

  • Owner changed from MarcusNoble to Lottie Greenwood

comment:12 Changed 5 years ago by Lottie Greenwood

  • Status changed from assigned to verify
  • Resolution set to fixed

full workflow script requirement set as ticket here: ​http://trac.mantidproject.org/mantid/ticket/10460

All other requirements complete.

comment:13 Changed 5 years ago by Anders Markvardsen

  • Status changed from verify to verifying
  • Tester set to Anders Markvardsen

comment:14 Changed 5 years ago by Anders Markvardsen

  • Status changed from verifying to closed
Note: See TracTickets for help on using tickets.