Ticket #2383 (closed: invalid)

Opened 10 years ago

Last modified 5 years ago

Create swap file for MDData points rebinned and not fitting to memory

Reported by: Alex Buts Owned by: Nick Draper
Priority: major Milestone: Iteration 20
Component: VATES Keywords:
Cc: Blocked By:
Blocking: Tester: Nick Draper

Description

The format of the swap file should be probablky the part of MDWorkspace file format

Change History

comment:1 Changed 10 years ago by Nick Draper

  • Milestone changed from Iteration 27 to Iteration 28

Bulk move of tickets at the end of iteration 27

comment:2 Changed 9 years ago by Nick Draper

  • Milestone changed from Iteration 28 to Iteration 29

Bulk move of tickets at the end of iteration 28

comment:3 Changed 9 years ago by Nick Draper

  • Milestone changed from Iteration 29 to Iteration 30

"New" tickets moved at the code freeze of iteration 29

comment:4 Changed 9 years ago by Alex Buts

(In [13010]) refs #2383 initial tests which allow to estimate and compare different strategies of writing and reading binary data

comment:5 Changed 9 years ago by Alex Buts

  • Status changed from new to accepted

comment:6 Changed 9 years ago by Alex Buts

(In [13011]) refs #2383 deleted unnecessary commit. minor stylistic modifications

comment:7 Changed 9 years ago by Alex Buts

(In [13015]) refs #2383 bug fixes to binary writer/reader test

comment:8 Changed 9 years ago by Alex Buts

(In [13041]) refs #2383 different options for binary file write

comment:9 Changed 9 years ago by Alex Buts

(In [13042]) refs #2383 deleted unnecessary commit, one more test class started

comment:10 Changed 9 years ago by Alex Buts

(In [13044]) refs #2383 unix modifications

comment:11 Changed 9 years ago by Alex Buts

(In [13045]) refs #2383 missing commit

comment:12 Changed 9 years ago by Alex Buts

(In [13046]) refs #2383 correct hdf5 configuration for 64-bit mode

comment:13 Changed 9 years ago by Nick Draper

  • Owner changed from Alex Buts to Nick Draper
  • Status changed from accepted to assigned

comment:14 Changed 9 years ago by Alex Buts

In [13086]:

refs #2383 minor working modifications to test
refs #3316 committed against this thicket to be updated on progress on it.

comment:14 Changed 9 years ago by Alex Buts

In [13088]:

refs #2383 working hdf5 test implementation;

comment:15 Changed 9 years ago by Alex Buts

In [13114]:

refs #2383 thorough check of different design speeds

comment:16 Changed 9 years ago by Alex Buts

In [13124]:

refs #2383 tests improvements

comment:17 Changed 9 years ago by Alex Buts

In [13125]:

refs #2383 unix modifications

comment:18 Changed 9 years ago by Alex Buts

In [13160]:

refs #2383 chunked dataset hdf tests

comment:19 Changed 9 years ago by Alex Buts

In [13198]:

refs #2383 modifications done to test on another machine

comment:20 Changed 9 years ago by Alex Buts

In [13199]:

refs #2383 missing files

comment:21 Changed 9 years ago by Alex Buts

In [13228]:

refs #2383 correct binary access

comment:22 Changed 9 years ago by Alex Buts

In [13229]:

refs #2383 working hdf implementation

comment:23 Changed 9 years ago by Alex Buts

In [13230]:

refs #2383 some results for the future

comment:24 Changed 9 years ago by Alex Buts

In [13235]:

refs #2383 some results

comment:25 Changed 9 years ago by Alex Buts

In [13278]:

refs #2383 some changes to datasets to simplify thing and to verify on other machines

comment:26 Changed 9 years ago by Alex Buts

In [13279]:

refs #2383 minor error fixed

comment:27 Changed 9 years ago by Alex Buts

In [13293]:

refs #2383 correct binary access, converging with hdf

comment:28 Changed 9 years ago by Alex Buts

In [13313]:

refs #2383 some sanity checks on data access speed, hdf_array started;

comment:29 Changed 9 years ago by Alex Buts

In [13321]:

refs #2383 fixed the issue with the tellg reporting wrong file size. Used public function of streampos;
Unclear how portable the solution is as all Internet documentations suggests casting

comment:30 Changed 9 years ago by Alex Buts

In [13392]:

refs #2383 hdf array working. more checks are needed to verify how optimal it is

comment:31 Changed 9 years ago by Alex Buts

In [13409]:

refs #2383 intermediate commit. Attempts to disable prefetching in windows.

comment:32 Changed 9 years ago by Alex Buts

In [13419]:

refs #2383 modifications to run tests on rhel5

comment:33 Changed 9 years ago by Alex Buts

In [13429]:

refs #2383 modifications to work on RHEL5

comment:34 Changed 9 years ago by Alex Buts

In [13436]:

refs #2383 some bla-bla-bla before leaving for vacation

comment:35 Changed 9 years ago by Alex Buts

In [13443]:

refs #2383 some results on binary access for unix

comment:36 Changed 9 years ago by Alex Buts

In [14361]:

refs #2383 working test program to check dataset access speed

comment:37 Changed 9 years ago by Nick Draper

  • Milestone changed from Iteration 30 to Iteration 31

Bulk move of tickets to iteration 31 at the iteration 30 code freeze

comment:38 Changed 9 years ago by Nick Draper

  • Milestone changed from Iteration 32 to Iteration 33

Moved to iteration 33 at iteration 32 code freeze

comment:39 Changed 8 years ago by Nick Draper

  • Milestone changed from Release 2.1 to Release 2.2

Moved at end of release 2.1

comment:40 Changed 8 years ago by Nick Draper

  • Status changed from assigned to closed
  • Resolution set to invalid
  • Tester set to Nick Draper

abandoned as a different approach to MDWorkspaces has been taken

comment:41 Changed 8 years ago by Nick Draper

  • Milestone changed from Release 2.2 to Unassigned

comment:41 Changed 8 years ago by Nick Draper

  • Milestone changed from Release 2.2 to Unassigned

comment:42 Changed 7 years ago by Nick Draper

  • Milestone changed from Unassigned to Iteration 20

comment:43 Changed 5 years ago by Stuart Campbell

This ticket has been transferred to github issue 3230

Note: See TracTickets for help on using tickets.