User Tools

Site Tools


biac:pipeline

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
biac:pipeline [2019/05/07 14:54]
cmp12
biac:pipeline [2023/10/23 14:24] (current)
cmp12
Line 12: Line 12:
  
  
 +===== Backup Workflow =====
  
-===== Backup Daemon Flowchart & Backup Admin Workflow ===== +A nightly cron job copies locally processed and raw data from the AIMS computers to a network attached storage location This includes all k-space data, pfile headers, nii.gz data, physio files, etc.
- +
-{{:biac:backup.png|:biac:backup.png}}+
  
 +On a monthly basis the archives are moved to a cloud based S3 cold storage location hosted by Duke.
  
 ===== User Frequently Asked Questions ===== ===== User Frequently Asked Questions =====
  
 === How does the pipeline assign a dataset to an Experiment? === === How does the pipeline assign a dataset to an Experiment? ===
-For functional data, the Patient ID that is entered on the scanner console is primarily used for identification. Our software takes what is entered in on the console, strips out the punctuation, and lowercases all text before before comparing against a list of valid Experiments. +For imaging data, the PatientID and ExperimentID that is entered on the scanner console is primarily used for identification. Our software takes what is entered in on the console, strips out the punctuation, and lowercases all text before before comparing against a list of valid Experiments.
- +
-===The tech entered the correct Experiment ID on the 4.0T console, but the dataset was not properly assigned to an Experiment. What happened? === +
-If you entered a period in the Patient ID field, GE's software seems to have a bug in which the characters following the period are truncated before being inserted into the raw data header. As a result, the truncated Patient ID is unrecognized and the image results gets transferred to the Salvage directories. This only applies to functional data from the 4.0T.  +
- +
-===How do I check the status of my data?=== +
-Under the 'Services' page on the BIAC website, click on 'Exam Tracker' and enter your 5 digit exam number. If the processing daemon has picked up and processed the files, you'll see the relevant log information.  +
- +
-===I see errors on the Exam Tracker page and my data did not show up. What do I need to do?=== +
-If the error you see is 'Experiment Not Found', please submit a trouble ticket so our data administrators can know where the data was supposed to be sent. Our data admins will respond as soon as possible to the trouble ticket. +
- +
-Looking for the [[biac:pipeline:adminfaq|Pipeline/Data Administration FAQ]]? Restricted. Request access by sending an email to Josh or Jimmy. +
- +
  
 +===The tech entered the correct Experiment ID on the scanner console, but the dataset was not properly assigned to an Experiment. What happened? ===
 +If the ExperimentID entered on the scanner does not match a list of valid Experiments, or that Experiment's storage location is full, then our processing daemon will temporarily transfer data to our Salvage.01 experiment location.  
  
 +Looking for the [[biac:pipeline:adminfaq|Pipeline/Data Administration FAQ]]? Restricted. Request access by sending an email to Josh or Chris.
  
  
biac/pipeline.1557240854.txt.gz · Last modified: 2019/05/07 14:54 by cmp12