Opened 8 months ago

Closed 6 months ago

Last modified 5 months ago

#1581 closed task (fixed)

Convert all raw bioassay items to derived bioassays

Reported by: Nicklas Nordborg Owned by: Nicklas Nordborg
Priority: critical Milestone: Reggie v5.0
Component: net.sf.basedb.reggie Keywords:
Cc:

Description (last modified by Nicklas Nordborg)

The raw bioassay level is problematic since it doesn't allow us to create child items. Since we no longer use any raw bioassay specific features it would be a lot nicer to have everything at the derived bioassay level. Downstream analysis can then be added as child items instead of just adding more files and annotations to existing items.

This is a huge work that require a lot of changes to existing wizards.

We also need a way to convert existing raw bioassays to derived bioassays without losing any information. We might need some help of low-level BASE functionality here. See https://base.thep.lu.se/ticket/2321

Data releases and the Relax server is also affected.

Change History (25)

comment:1 by Nicklas Nordborg, 7 months ago

In 7682:

References #1581: Convert all raw bioassay items to derived bioassays

Marking RawBioAssay-related things in Reggie (and also in the BASE code) as deprecated. We get 1136 compilation warnings.

comment:2 by Nicklas Nordborg, 6 months ago

Description: modified (diff)

comment:3 by Nicklas Nordborg, 6 months ago

In 7706:

References #1581: Convert all raw bioassay items to derived bioassays

Added 3 new subtypes that are replacement for raw data types:

  • GeneExpression: Used for Cufflinks and StringTie raw bioassays
  • VariantCall: Used for Variant call raw bioassays
  • OncoArray: Used for the OncoArray500K raw bioassays


Item list and file type definitions have been updated to use derived bioassays instead of raw bioassays.

Note that the changes here will cause the installation wizard to display a lot of errors since normally the item type used by an item list or file type can't be modified. Before updating to this version the BASE tool for converting raw bioassays to derived bioassays should be used. The following mapping must be used:

  • cufflinks raw data type must be mapped to GeneExpression.
  • variant.sequencing.stringtie raw data type must be mapped to GeneExpression, and the gene.tsv files that use the Generic raw data file type must be changed to FPKM file type.
  • variant.sequencing.variant-call must be mapped to VariantCall.
  • variant.genotyping.oncoarray500K must be mapped to OncoArray.

comment:4 by Nicklas Nordborg, 6 months ago

In 7707:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed the "Case summary" so that it load the new derived bioassay items. This also includes a slightly different fix for #1590.

comment:5 by Nicklas Nordborg, 6 months ago

In 7708:

References #1581: Convert all raw bioassay items to derived bioassays

The SSP plugin and related wizard has been updated. Auto-confirmation integration remains since StringTie and reports have not yet been updated.

comment:6 by Nicklas Nordborg, 6 months ago

In 7709:

References #1581: Convert all raw bioassay items to derived bioassays

The StringTie pipeline has been updated.

comment:7 by Nicklas Nordborg, 6 months ago

In 7710:

References #1581: Convert all raw bioassay items to derived bioassays

The Legacy pipeline has been updated.

comment:8 by Nicklas Nordborg, 6 months ago

In 7711:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed all reports.

comment:9 by Nicklas Nordborg, 6 months ago

In 7712:

References #1581: Convert all raw bioassay items to derived bioassays

Counters for reports.

comment:10 by Nicklas Nordborg, 6 months ago

In 7713:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for the StringTie/2023 pipeline.

comment:11 by Nicklas Nordborg, 6 months ago

In 7714:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for the Yellow label wizard.

comment:12 by Nicklas Nordborg, 6 months ago

In 7715:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for Flagged RNA wizard.

comment:13 by Nicklas Nordborg, 6 months ago

In 7716:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for the variant calling and targeted genotyping pipelines.

comment:14 by Nicklas Nordborg, 6 months ago

In 7717:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for the WGS variant calling pipeline.

comment:15 by Nicklas Nordborg, 6 months ago

In 7718:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for stray folder and secondary analysis cleanup wizards.

comment:16 by Nicklas Nordborg, 6 months ago

In 7719:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for the thumbnails and VCF file links that can appear in table listings and other places.

comment:17 by Nicklas Nordborg, 6 months ago

In 7720:

References #1581: Convert all raw bioassay items to derived bioassays

Found some more things related to thumbnails.

comment:18 by Nicklas Nordborg, 6 months ago

In 7721:

References #1581: Convert all raw bioassay items to derived bioassays

Removed RAWBIOASSAY from all annotation types.

comment:19 by Nicklas Nordborg, 6 months ago

In 7722:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for imputation and PRS wizards.

comment:20 by Nicklas Nordborg, 6 months ago

In 7723:

References #1581: Convert all raw bioassay items to derived bioassays

Fond some more places that used raw bioassays.

comment:21 by Nicklas Nordborg, 6 months ago

In 7724:

References #1581: Convert all raw bioassay items to derived bioassays

Fixed for the release exporter.

comment:22 by Nicklas Nordborg, 6 months ago

In 7725:

References #1581: Convert all raw bioassay items to derived bioassays

Cleaning up comments, documentation and fixing some other minor things. Removed rawbioassay-related code that is no longer used.

comment:23 by Nicklas Nordborg, 6 months ago

In 7730:

References #1581: Convert all raw bioassay items to derived bioassays

More cleaning up.

comment:24 by Nicklas Nordborg, 6 months ago

Resolution: fixed
Status: newclosed

comment:25 by Nicklas Nordborg, 5 months ago

Milestone: Reggie v5Reggie v5.0

Milestone renamed

Note: See TracTickets for help on using tickets.