Opened 8 years ago

Closed 8 years ago

Last modified 8 years ago

#969 closed enhancement (fixed)

Changes to Frozen tissue date import wizard

Reported by: Nicklas Nordborg Owned by: Nicklas Nordborg
Priority: major Milestone: Reggie v4.10
Component: net.sf.basedb.reggie Keywords:
Cc:

Description (last modified by Nicklas Nordborg)

  • The import should work with the complete TAB-separated file. The first line is a header line with column names. The SCAN-B ID is found in the "ProvID" column. When converting the XLS file to text it should be saved with TAB as separator, UTF-8 as character encoding, and no text delimiter.
  • SCAN-B ID can appear in different forms that should be supported:
    • 1234567
    • 12-34567
    • 1234567C
    • 12-34567C
    • PAD value (=any other format)
  • The importer should check that consent is acceptable (=Yes or missing). It should not import anything to items with "No" or "Not asked". Entries with non-acceptable consent should be reported when the wizard has finished.
  • Duplicates should be reported when the wizard has finished.
  • Entries with no match in BASE should be reported when the wizard has finished.

Attachments (1)

xls2tsv.png (6.0 KB ) - added by Nicklas Nordborg 8 years ago.

Download all attachments as: .zip

Change History (8)

by Nicklas Nordborg, 8 years ago

Attachment: xls2tsv.png added

comment:1 by Nicklas Nordborg, 8 years ago

Description: modified (diff)

comment:2 by Nicklas Nordborg, 8 years ago

Milestone: Reggie v4.10Reggie v4.9.5
Status: newassigned

comment:3 by Nicklas Nordborg, 8 years ago

(In [4510]) References #969: Changes to Frozen tissue date import wizard

The importer has now been updated and should support the requested features. The final report is presented as a table with warnings.

One particular issue was that it is not possible (due to limitations in BASE) to read annotations on items that are used with the AnnotationBatcher. Since we need to check the Consent annotation and set the FrozenTissueDate there is a clash. Using the regular API for updating the annotations turned out to be very slow. The final solution was to make a single query to load the id of all cases that has a consent annotation that is not 'Yes' and then check all cases against this list.

comment:4 by Nicklas Nordborg, 8 years ago

(In [4511]) References #969: Changes to Frozen tissue date import wizard

Added /home/SCANB/FrozenTissueFiles directory for storing the frozen tissue files.

comment:5 by Nicklas Nordborg, 8 years ago

Milestone: Reggie v4.9.5Reggie v4.10

Moving to Reggie 4.10 since it will be released soon.

comment:6 by Nicklas Nordborg, 8 years ago

Resolution: fixed
Status: assignedclosed

comment:7 by Nicklas Nordborg, 8 years ago

(In [4523]) References #969: Changes to Frozen tissue date import wizard

Removed reference to non-existing script file.

Note: See TracTickets for help on using tickets.