Edit this page | Blame

Wrong CSV in ITP_10001 longevity dataset


  • assigned: bonfacem
  • type: bug
  • status: closed
  • priority: critical
  • keywords: critical bug, in progress, metadata, phenotypes


[From Suheeta]:

"I downloaded the sample csv file for ITP_10001 to add a couple of attributes to it. What I see is that the csv file is somewhat messed up. The values for Sex, Site, Tx, and Year have shifted down to next row for each sample (see screenshot below). Not sure if this is the case for everyone or did something malfunction for me?"

The screenshot:


- [X] Reproduce the issue

- [X] Check if database is affected in any way

- [X] Send a patch to fix

- [X] Notify every relevant user

- [X] Update case-attr page with links


Mon 11 Apr 2022 13:19:14 EAT:

The CSV file is technically fine. In that database, some characters are inserted with control sequences that need to be stripped out. Here's a current snip of how that looks like:


Notice the "^M" represents a carriage return. See:

When storing case attributes, values with control sequences are also stored, and when you download that data for use, they were not being stripped out. As a consequence, opening the csv file in Excel (or similar) software resulted in data that seems jumbled up.

Tue 12 Apr 2022 13:33:31 EAT

(made with skribilo)