Ticket #10118 (closed: fixed)

Opened 6 years ago

Last modified 5 years ago

Generate squish tests for ReflGui

Reported by: Owen Arnold Owned by: Owen Arnold
Priority: major Milestone: Release 3.3
Component: Reflectometry Keywords:
Cc: Blocked By:
Blocking: #10202, #10207 Tester: Harry Jeffery

Description

A better level of automated gui testing has been demanded by the end-users. We can't delay the need for this any futher. The users have already provided us with a very limited number of test cases that they want to see verified on a regular basis.

Possibly as a separate ticket, we can look at running these on the build servers, if not then I'll create the suite to run locally anyway.

Change History

comment:1 Changed 6 years ago by Nick Draper

  • Status changed from new to assigned

comment:2 Changed 6 years ago by Owen Arnold

  • Status changed from assigned to inprogress

refs #10118. Add refl gui squish test.

Changeset: 2a8412696527af7fd3908afcc5dff6387a1c1ea4

comment:3 Changed 6 years ago by Owen Arnold

Tester:

These are working on ubuntu 14.04 as well as OSX10.8. You will need a squish licence, but I have one already, so it may be best for me to run through these tests with you.

  • Install squish
  • Checkout the branch and merge into master
  • Install MantidPlot
  • Open up the squishide, and under AUTs, add the path to the installed version of Mantid
  • In the squish IDE open up the new tests suite in the mantid repository
  • Hit play to run the whole test suite.

As an alternative to the last two steps, you could run something like the following, which will generate junit style xml as an output.

./squishserver&

./squishrunner --testsuite ~/mantid/mantid/Code/Mantid/MantidPlot/test/squish_test_suites/refl_gui_tests/ --reportgen=xmljunit,/home/spu92482/Desktop/repgen.xml&


comment:4 Changed 6 years ago by Owen Arnold

Only once these tests are part of master, can I set up a squish job.

comment:5 Changed 6 years ago by Owen Arnold

  • Status changed from inprogress to verify
  • Resolution set to fixed

comment:6 Changed 6 years ago by Owen Arnold

  • Status changed from verify to reopened
  • Resolution fixed deleted

I'm reopening this, because we could actually base the whole thing off develop, that way we don't have to get things into master first.

comment:7 Changed 6 years ago by Owen Arnold

  • Status changed from reopened to inprogress

refs #10118. Fix button names.

Changeset: f556d110262a47cf901c778fa9098f549acd5354

comment:8 Changed 6 years ago by Owen Arnold

refs #10118. Fix wierdness in qmessagebox.

Changeset: 4b6fc15b1d0648c871cb6c739d94644f979006b6

comment:9 Changed 6 years ago by Owen Arnold

refs #10118. Fix wierdness in qmessagebox 2.

Changeset: 805ebe0f2dfbff168bb3ff535b0819c79cac1010

comment:10 Changed 6 years ago by Owen Arnold

Tester: You can short cut the previous instructions, and just check that the squish test is running.

http://builds.mantidproject.org/view/All/job/develop_squishtest/

comment:11 Changed 6 years ago by Owen Arnold

  • Status changed from inprogress to verify
  • Resolution set to fixed

comment:12 Changed 6 years ago by Harry Jeffery

  • Status changed from verify to verifying
  • Tester set to Harry Jeffery

comment:13 Changed 6 years ago by Owen Arnold

  • Blocking 10202 added

comment:14 Changed 6 years ago by Harry Jeffery

  • Status changed from verifying to closed

Merge remote-tracking branch 'origin/feature/10118_squish_refl'

Full changeset: 57c50e6f9ec0d0d7647ff161c5938adc780f09f7

comment:15 Changed 6 years ago by Owen Arnold

  • Blocking 10207 added

comment:16 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue 10960

Note: See TracTickets for help on using tickets.