Ticket #10231 (closed)

Opened 6 years ago

Last modified 5 years ago

FITS loader - Changing handling of header keys

Reported by: John Hill Owned by: Federico M Pouzols
Priority: major Milestone: Release 3.4
Component: Diffraction Keywords:
Cc: Blocked By:
Blocking: #11041 Tester: Karl Palmen

Description (last modified by John Hill) (diff)

The FITS loader uses fixed header values which will change as the usage requirements for the IMAT instruments becomes more defined. Some of the keys can currently be overridden from the load dialogue, or from a selected map file.

When header keys are finalised it may be desirable to remove the load dialogue properties for overriding them, specifically in the case of BITPIX and NAXIS which should be universal (defined in the FITS standard and are in theory not subject to change).

Information required for use in tomography are: ImageKey (key being the type of image it is open/dark field or sample) Rotation (current sample rotation when image was taken) Intensity (beam intensity at the time the image was taken)

Ideally this information will be available from the FITS header, but actual key names to look for are unknown at this time. And the defaults currently specified may need changing.

Change History

comment:1 Changed 6 years ago by John Hill

  • Description modified (diff)

comment:2 Changed 6 years ago by John Hill

  • Description modified (diff)

comment:3 Changed 6 years ago by John Hill

  • Description modified (diff)

comment:4 Changed 6 years ago by John Hill

  • Description modified (diff)

comment:5 Changed 6 years ago by John Hill

  • Description modified (diff)
  • Summary changed from FITS loader - Improvements to FITS loader - Changing handling of header keys

comment:6 Changed 6 years ago by John Hill

  • Owner changed from John Hill to Federico M Pouzols
  • Status changed from new to assigned

comment:7 Changed 6 years ago by Federico M Pouzols

  • Milestone changed from Backlog to Release 3.4

comment:8 Changed 6 years ago by Federico M Pouzols

  • Blocking 10965 added

comment:9 Changed 6 years ago by Federico Montesino Pouzols

  • Status changed from assigned to inprogress

mark some required changes/additions, re #10231

Changeset: 112cdd71f4eab23d51c86c64abf2898ef3d02d0e

comment:10 Changed 6 years ago by Federico Montesino Pouzols

use '_FITS:' prefix for log entries from the FITS header, re #10231

Changeset: 111b7fb4726cf99d0c7a0f7d9daf3398d8cef6a4

comment:11 Changed 6 years ago by Federico Montesino Pouzols

make sure FITS entries are not added twice, re #10231

Changeset: 32bfecd7f354a35c59991fcf110effcf88b15ac0

comment:12 Changed 6 years ago by Federico M Pouzols

  • Blocking 11041 added

comment:13 Changed 6 years ago by Federico Montesino Pouzols

slight speed up, change header process closer to IMAP FITS, re #10231

Changeset: c51776eaf7634221ae13969b32d2e9e281f494d7

comment:14 Changed 6 years ago by Federico M Pouzols

  • Blocking 10965 removed

comment:15 Changed 6 years ago by Federico Montesino Pouzols

old input properties finally gone, re #10231

Changeset: 95870913ac6ab241ee6e05ef4f32e9e1f1ea84f5

comment:16 Changed 6 years ago by Federico Montesino Pouzols

Drop _ prefix for logs, better property help, re #10231

Changeset: 0b79383b4ee2e85e285f13e3edcadb12bd9d4c4b

comment:17 Changed 6 years ago by Federico Montesino Pouzols

develop test, check basics and FITS headers, re #10231

Changeset: 7cbf9cf30b5611d12f8119bd30b307bcc5dde229

comment:18 Changed 6 years ago by Federico Montesino Pouzols

revamp, better error checks/msgs, new headers, re #10231

Changeset: 1731035b8430f4088740a7fff478c439e447d9d8

comment:19 Changed 6 years ago by Federico Montesino Pouzols

  • Status changed from inprogress to verify
  • Resolution set to fixed

This is being verified as pull request #482.

comment:20 Changed 6 years ago by Federico Montesino Pouzols

use fstream rather than FILE - so avoid leaks, re #10231

Changeset: 1b268b546f97047569904079cf890ef9812a0b8a

comment:21 Changed 6 years ago by Federico Montesino Pouzols

It seems that the system test MERLINReduction is failing on auriga because of a missing/broken file MER11060.raw. Jenkins, retest this please

comment:22 Changed 6 years ago by Federico Montesino Pouzols

Jenkins, retest this please

comment:23 Changed 6 years ago by Federico Montesino Pouzols

Jenkins, retest this please

comment:24 Changed 6 years ago by Federico Montesino Pouzols

Jenkins, retest this please

comment:25 Changed 6 years ago by Federico Montesino Pouzols

Jenkins, retest this please

comment:26 Changed 6 years ago by Federico Montesino Pouzols

Jenkins, retest this please

comment:27 Changed 6 years ago by Federico Montesino Pouzols

Jenkins, I'm begging you... retest this please

comment:28 Changed 6 years ago by Federico Montesino Pouzols

Jenkins retest this please

comment:29 Changed 6 years ago by Federico Montesino Pouzols

Jenkins retest this please

comment:30 Changed 6 years ago by Karl Palmen

Only Filename & OutputWorkspace should remain on the LoadFITS dialog box, when I test. Please let me know if I'm wrong.

comment:31 Changed 6 years ago by Federico Montesino Pouzols

There is one more (optional) field with the name of a "headers map" file. This is still there, as we will need to play with non-standard and changeable headers for a while. Not sure at this point if it will stay there or die when the tomography code stabilizes. It doesn't hurt anyway, and most users will never need to care about it.

comment:32 Changed 6 years ago by Federico Montesino Pouzols

Oh, and also note that there is another PR with documentation for this algorithm: #471.

comment:33 Changed 6 years ago by Federico Montesino Pouzols

Both are open at the moment, and there could be merge conflicts (they shouldn't be really important). Let me know if something happens.

comment:34 Changed 6 years ago by Karl Palmen

When I test it, the LoadFITS algorithm is not available for selection and so I can't access the dialog box.

comment:35 Changed 6 years ago by Karl Palmen

  • Status changed from verify to reopened
  • Resolution fixed deleted

comment:36 Changed 6 years ago by Federico Montesino Pouzols

There's a merge conflict after another PR was merged. So probably in your test branch you didn't get the new code or an inconsistent version. I'll sort it out and let you know.

comment:37 Changed 6 years ago by Federico Montesino Pouzols

  • Status changed from reopened to inprogress

Merge remote-tracking branch 'origin/master' into feature/10231_FITS_loader_change_and_add_header_keys

Conflicts:

Code/Mantid/Framework/DataHandling/src/LoadFITS.cpp

Sort out merge conflict with another PR related to LoadFITS, re #10231

Changeset: 310a48a0c150deedbcaeea1a2a768a065cda7553

comment:38 Changed 6 years ago by Federico Montesino Pouzols

I just fixed the merge conflict. Unless there's any unexpected issue this should be ready for testing again when the CI builds finish (crossing all fingers and toes).

comment:39 Changed 6 years ago by Federico Montesino Pouzols

Jenkins, retest this please

comment:40 Changed 6 years ago by Federico Montesino Pouzols

_ prefix not used any longer for FITS headers, re #10231

Changeset: 941b74f3bbc4e1d5342c8ffe8410290f056cc1bf

comment:41 Changed 6 years ago by Federico Montesino Pouzols

Oops, the builds failed on osx and rhel6 for unrelated random CI issues, but there's actually an issue in the LoadFITS doc test where I forgot to update after the merger of another branch. It's now or never...

comment:42 Changed 6 years ago by Karl Palmen

  • Status changed from inprogress to verifying
  • Tester set to Karl Palmen

comment:43 Changed 6 years ago by Karl Palmen

  • Status changed from verifying to closed

Merge pull request #482 from mantidproject/feature/10231_FITS_loader_change_and_add_header_keys

LoadFITS: change and add header keys, and other improvements

Full changeset: 2217b576871ce96f4f465f371b97f690fd94f2fc

comment:44 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue 11073

Note: See TracTickets for help on using tickets.