Opened 5 months ago

Closed 5 months ago

Last modified 5 months ago

#1555 closed enhancement (fixed)

Implement support for INCA data files that are in CSV format

Reported by: Nicklas Nordborg Owned by: Nicklas Nordborg
Priority: critical Milestone: INCA XML to CSV converter 1.5
Component: net.sf.basedb.reggie Keywords:
Cc:

Description (last modified by Nicklas Nordborg)

The current converter implementation only works with INCA source data in XML format. The XML format is being replace with a CSV format, so the converter need to support CSV source files as well. From the test data we have got it seems like the CSV files are formatted as:

  • Comma is used as a separator
  • Text values are quoted.
  • Date values can be both quoted and unquoted.
  • Numeric vales can be both quoted and unquoted (but some may be id-values)
  • NA is used instead of empty values (without quotes)
  • The column header is empty but the values seem to be the PAT_ID values.

Change History (6)

comment:1 by Nicklas Nordborg, 5 months ago

Description: modified (diff)

comment:2 by Nicklas Nordborg, 5 months ago

In 7497:

References #1555: Implement support for INCA data files that are in CSV format

A new parser IncaCsvParser has been implemented. The converter will automatically select this or the XML parser depending on the file extension.

The implementation now also generates a log file which can be used to report problems. It will help with debugging in the future.

comment:3 by Nicklas Nordborg, 5 months ago

In 7498:

References #1555: Implement support for INCA data files that are in CSV format

NA values are replaced with empty strings.

comment:4 by Nicklas Nordborg, 5 months ago

In 7499:

References #1555: Implement support for INCA data files that are in CSV format

The SCAN-B file header is PersonalNr not PersonalNo.

comment:5 by Nicklas Nordborg, 5 months ago

Resolution: fixed
Status: newclosed

comment:6 by Nicklas Nordborg, 5 months ago

Milestone: INCA XML to CSV converter 1.4INCA XML to CSV converter 1.5
Note: See TracTickets for help on using tickets.