Ticket #9855 (closed: invalid)
Severe memory issue with Rebin and ConvertUnit on Corelli data
| Reported by: | Wenduo Zhou | Owned by: | Wenduo Zhou |
|---|---|---|---|
| Priority: | critical | Milestone: | Release 3.2 |
| Component: | Framework | Keywords: | |
| Cc: | nick.draper@… | Blocked By: | |
| Blocking: | Tester: | Nick Draper |
Description
Run the attached script problem.py, you will see that if SHOWPROBLEM is set to True, the final output event workspace can be 46GB, while the original input event workspace is only 2GB.
If SHOWPROBLEM is set to False:
After Rebin in d-spacing, Memory size of workspace COR_687_d is 2017.16980 MB
After ConvertUnits to TOF, Memory size of workspace COR_687_d is 6351.03317 MB
If SHOWPROBLEM is se to True:
After Rebin in d-spacing, Memory size of workspace COR_687_d is 2017.27435 MB
After ConvertUnits to TOF, Memory size of workspace COR_687_d is 45321.78317 MB
Attachments
Change History
comment:1 Changed 6 years ago by Nick Draper
- Cc nick.draper@… added
- Status changed from new to assigned
Wenduo, you have until the end of Thursday for this to be fixed, tested and merged to master.
Please make sure if committing late that the builds on Thursday night will pass.
Ps. Is this a problem that the users will actually see in normal use, or something we have just managed to make happen?
comment:2 Changed 6 years ago by Nick Draper
- Owner set to Wenduo Zhou
If you need some help on this let Pete/Me know
comment:3 Changed 6 years ago by Wenduo Zhou
- Status changed from assigned to verify
- Resolution set to invalid
There is no solution for this issue according to Pete's explanation. This is how Mantid is designed. Ticket is thus claimed to invalid.
comment:4 Changed 6 years ago by Nick Draper
- Status changed from verify to verifying
- Tester set to Nick Draper
comment:5 Changed 6 years ago by Nick Draper
- Status changed from verifying to closed
Yes, looking at it now you are rebinning to a very fine grid in histogram mode. That will vastly increase the size of the data. Also convert units will break the sharing of the X arrays, Rebinning again to a common grid would fix this.
