Ticket #3997 (closed: fixed)

Opened 9 years ago

Last modified 5 years ago

Upgrades to system tests

Reported by: Peter Peterson Owned by: Peter Peterson
Priority: major Milestone: Release 2.0
Component: Mantid Keywords:
Cc: Blocked By:
Blocking: Tester: Janik Zikovsky

Description

Two features:

  • Ability to verify a file exists and can be loaded
  • Ability to skip tests

Change History

comment:1 Changed 9 years ago by Peter Peterson

  • Owner set to Peter Peterson
  • Status changed from new to accepted

comment:2 Changed 9 years ago by Peter Peterson

Getting what I think is the right syntax for skipping tests. Refs #3997.

Changeset: 58a19918e826594b5e48011f32b69a4e136859d7

comment:3 Changed 9 years ago by Peter Peterson

Making creating the properties file optional so InstallerTesting.py can do its thing. Refs #3997.

Changeset: 1eaeb3a99ceee303a376e85dee2f56c28ba02b69

comment:4 Changed 9 years ago by Peter Peterson

Fixing the check for the mantidplot executable. Refs #3997.

Changeset: 5acd5359804046b8e24eb1c436dca3a67de794b9

comment:5 Changed 9 years ago by Peter Peterson

Checked for the wrong string in the suite. Refs #3997.

Changeset: 968b90e932030f221e8a080eec222ede829e065b

comment:6 Changed 9 years ago by Peter Peterson

Adding more information for skipping tests. Refs #3997.

Changeset: afb9b411c9a8482e4a8d8656063443c1f4f8f363

comment:7 Changed 9 years ago by Peter Peterson

Added selecting which tests to run. Refs #3997.

Changeset: 926f96b9589697feabb4cc2e4ab31c17b333ae33

comment:8 Changed 9 years ago by Peter Peterson

Actually do a quick check for the required files. Refs #3997.

Changeset: 4abb8858a495a16d30be7ca17f9cd68493972845

comment:9 Changed 9 years ago by Peter Peterson

Messing with the command line output of the xmlreporter and an intentionally skipped test to see how it looks in jenkins. Refs #3997.

Changeset: e1ff8d88e0639fffc4d0eba867d4ba4e26d62373

comment:10 Changed 9 years ago by Peter Peterson

Changing name of test. Refs #3997.

Changeset: 2cb46f5a2957f0f4a8c8c40602ff362e1e82f8e4

comment:11 Changed 9 years ago by Peter Peterson

Improved cli printing and messing with skipped test reason in the xml. Refs #3997.

Changeset: 7a98df44bfa55918cbd909c6987f1b6550cfd95d

comment:12 Changed 9 years ago by Peter Peterson

Fixing check for whether all tests passed/failed. Refs #3997.

Changeset: 82f7298437788c8b6189036e27ac324adc46858c

comment:13 Changed 9 years ago by Peter Peterson

Removing old technology. Refs #3997.

Changeset: 2245aeb5631573e3f2c19b9d38c8fa5602937468

comment:14 Changed 9 years ago by Peter Peterson

Added real checks for file existence. Refs #3997.

Changeset: c766f769c1a161cf412f32536204678b3d4b7a33

comment:15 Changed 9 years ago by Peter Peterson

Add list of required files. Refs #3997.

Changeset: 9062330a5f10da381c344b2c059ce1c92b141656

comment:16 Changed 9 years ago by Peter Peterson

Added more information to the online help. Refs #3997.

Changeset: f71439213f6788efc417d3ac7607017798aeccda

comment:17 Changed 9 years ago by Peter Peterson

  • Status changed from accepted to verify
  • Resolution set to fixed

The last commit finished this off.

comment:18 Changed 9 years ago by Peter Peterson

  • Status changed from verify to reopened
  • Resolution fixed deleted

None of the tests seem to run on windows.

comment:19 Changed 9 years ago by Peter Peterson

  • Status changed from reopened to accepted

comment:20 Changed 9 years ago by Peter Peterson

Poking about the build server to see if I can get the tests to actually run. Refs #3997.

Changeset: 7dd3bedf27bdac049f336ae6a840d037c11f6c45

comment:21 Changed 9 years ago by Peter Peterson

Poking about the build server to see if I can get the tests to actually run. Refs #3997.

Changeset: 92a72d05b9b098c678d9ac4fef218ae32389add2

comment:22 Changed 9 years ago by Peter Peterson

Poking about the build server to see if I can get the tests to actually run. Refs #3997.

Changeset: fc02c02725a449f4cb76f392dde04ba21025ba3e

comment:23 Changed 9 years ago by Russell Taylor

Get system tests to actually run on Windows.

Result of pair debugging with Pete. Re #3997.

Changeset: fac80688f123c4056bc98c073347889db6915620

comment:24 Changed 9 years ago by Russell Taylor

Change name of AzizAnalysis system test...

...to be more meaningful to those who don't know who Aziz is! Re #3997.

Changeset: 0ff17fb9efe3968b0c8e41faa51f875b159d4e3f

comment:25 Changed 9 years ago by Peter Peterson

  • Status changed from accepted to verify
  • Resolution set to fixed

Russell fixed it.

comment:26 Changed 9 years ago by Janik Zikovsky

  • Status changed from verify to verifying
  • Tester set to Janik Zikovsky

comment:27 Changed 9 years ago by Janik Zikovsky

  • Status changed from verifying to closed

System tests are running, missing files allow files to be skipped.

comment:28 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue 4844

Note: See TracTickets for help on using tickets.