Torrent SuiteSoftwareData ManagementGuide
Torrent Suite Software space on Ion Community
Data Management File Categories Details
This section describes which files are grouped into the Data Management File Categories.
Overview
The Data Management feature performs automatic or on-demand file management (deletion, archive, export) of your analyses based on four file categories of files for each analysis:
- Signal Processing Input Files that are required to reanalyze the run from Signal Processing.
- Basecalling Input Files that are required to reanalyze the run from Basecalling.
- Intermediate Files Files that are required to debug the run.
- Output Files Files that are required to view the run report in the Torrent Browser, including report-rendering and customer deliverable files.
Signal Processing Input
Files that are required to reanalyze the run from Signal Processing include the following:
| acq_????.dat |
| beadfind_pre_????.dat |
| beadfind_post_????.dat |
Basecalling Input
Files that are required to reanalyze the run from Basecalling include the following:
| sigproc_results/analysis.bfmask.bin |
| sigproc_results/[BLOCK]/1.wells |
| sigproc_results/[BLOCK]/analysis.bfmask.bin |
| sigproc_results/[BLOCK]/bfmask.bin |
Intermediate Files
This group includes files for debugging, log files, and other intermediate files.
Debugging files
| sigproc_results/[BLOCK]/BkgModelBeadData.nnnn.txt |
| sigproc_results/[BLOCK]/BkgModelBeadDcData.nnnn.txt |
| sigproc_results/[BLOCK]/BkgModelDarkMatterData.nnnn.txt |
| sigproc_results/[BLOCK]/BkgModelEmphasisData.nnnn.txt |
| sigproc_results/[BLOCK]/BkgModelEmptyTraceData.nnnn.txt |
| sigproc_results/[BLOCK]/BkgModelFilterData.h5 |
| sigproc_results/[BLOCK]/BkgModelFilterData.txt |
| sigproc_results/[BLOCK]/BkgModelInitVals.nnnn.txt |
| sigproc_results/[BLOCK]/BkgModelRegionData.nnnn.txt |
| sigproc_results/[BLOCK]/pinsPerFlow.txt |
| sigproc_results/[BLOCK]/separator.avg-traces.txt |
| sigproc_results/[BLOCK]/separator.bftraces.txt |
| sigproc_results/[BLOCK]/separator.region-avg-traces.txt |
| sigproc_results/[BLOCK]/separator.trace.txt |
| sigproc_results/[BLOCK]/dcOffset/dcOffset.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_frametime.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_inlet_bead.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_inlet_empty_sd.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_inlet_empty.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_inlet_step.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_middle_bead.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_middle_empty_sd.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_middle_empty.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_middle_step.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_outlet_bead.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_outlet_empty_sd.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_outlet_empty.txt |
| sigproc_results/[BLOCK]/NucStep/NucStep_outlet_step.txt |
Log files
| status.txt |
| sysinfo.txt |
| uploadS tatus.txt |
| explog.txt |
| explog_final.txt |
| basecaller_results/[BLOCK]/barcodeFilter.txt |
Intermediate files
| alignment_nomatch.summary |
| alignStats_err.json |
| alignTable.txt |
| DefaultTFs.conf |
| job_list.json |
| job_list.txt |
| rawlib.alignmentQC_out.txt |
| rawlib.alignment.summary |
| rawlib.alignTable.txt |
| rawlib.ionstats_alignment.json |
| ReportConfiguration.txt |
| report_layout.json |
| sigproc_results/analysis_return_code.txt |
| sigproc_results/timing.txt |
| sigproc_results/[BLOCK]/analysis.bfmask.stats |
| sigproc_results/[BLOCK]/analysis_return_code.txt |
| sigproc_results/[BLOCK]/analysisState.json |
| sigproc_results/[BLOCK]/avgNukeTrace_*.txt |
| sigproc_results/[BLOCK]/beadfind.h5 |
| sigproc_results/[BLOCK]/bfmask.stats |
| sigproc_results/[BLOCK]/gauss_exp_sigma_tmid.txt |
| sigproc_results/[BLOCK]/imageState.h5 |
| sigproc_results/[BLOCK]/MD5SUMS |
| sigproc_results/[BLOCK]/processParameters.txt |
| sigproc_results/[BLOCK]/sigproc.log |
| basecaller_results/composite_return_code.txt |
| basecaller_results/TFStats.json |
| basecaller_results/[BLOCK]/barcodeMask.bin |
| basecaller_results/[BLOCK]/BaseCaller.json |
| basecaller_results/[BLOCK]/basecaller.log |
| basecaller_results/[BLOCK]/bfmask.bin |
| basecaller_results/[BLOCK]/datasets_basecaller.json |
| basecaller_results/[BLOCK]/datasets_pipeline.json |
| basecaller_results/[BLOCK]/datasets_tf.json |
| basecaller_results/[BLOCK]/DefaultTFs.fasta |
| basecaller_results/[BLOCK]/DefaultTFs.fasta.fai |
| basecaller_results/[BLOCK]/ionstats_basecaller.json |
| basecaller_results/[BLOCK]/ionstats_tf.json |
| basecaller_results/[BLOCK]/progress_basecaller.json |
| basecaller_results/[BLOCK]/quality.summary |
| basecaller_results/[BLOCK]/rawlib.ionstats_basecaller.json |
| basecaller_results/[BLOCK]/TFStats.json |
| basecaller_results/[BLOCK]/recalibration/ |
| basecaller_results/[BLOCK]/unfiltered.trimmed/ |
| basecaller_results/[BLOCK]/unfiltered.untrimmed/ |
| onboard_results/sigproc_results/* |
Output Files
Files that are required to view the run report in the Torrent Browser, including report-rendering and customer-deliverable files.
Files required for report-rendering
| alignment_rate_plot.png |
| alignment.summary |
| base_error_plot.png |
| Bead_density_*.png |
| Default_Report.php |
| drmaa_stderr_block.txt |
| drmaa_stdout_block.txt |
| drmaa_stdout.txt |
| expMeta.dat |
| Filtered_Alignments_Q*.png |
| ion_analysis_00.py |
| ion_params_00.json |
| ionstats_alignment.json |
| parsefiles.php |
| pgm_logs.zip |
| primary.key |
| Q*.histo.dat |
| raw_peak_signal |
| version.txt |
| sigproc_results/analysis.bfmask.stats |
| sigproc_results/Bead_density_*.png |
| sigproc_results/[BLOCK]/Bead_density_*.png |
| basecaller_results/BaseCaller.json |
| basecaller_results/datasets_basecaller.json |
| basecaller_results/ionstats_basecaller.json |
| basecaller_results/ionstats_tf.json |
| basecaller_results/quality_histogram.png |
| basecaller_results/quality.summary |
| basecaller_results/rawlib.ionstats_basecaller.json |
| basecaller_results/rawlib.sparkline.png |
| basecaller_results/readLenHisto2.png |
| basecaller_results/readLenHisto.png |
| basecaller_results/wells_beadogram.png |
| basecaller_results/[BLOCK]/quality_histogram.png |
| basecaller_results/[BLOCK]/rawlib.sparkline.png |
| basecaller_results/[BLOCK]/readLenHisto2.png |
| basecaller_results/[BLOCK]/readLenHisto.png |
| basecaller_results/[BLOCK]/wells_beadogram.png |
| basecaller_results/[BLOCK]/bc_files/ |
| basecaller_results/[BLOCK]/bc_filtered/ |
Customer deliverables
| rawlib.bam |
| rawlib.bam.bai |
| basecaller_results/rawlib.basecaller.bam |
| basecaller_results/rawlib.basecaller.bam.bai |
| basecaller_results/rawlib.basecaller.bam.header.sam |
| basecaller_results/[BLOCK]/rawlib.basecaller.bam |
| basecaller_results/[BLOCK]/rawtf.bam |
| basecaller_results/[BLOCK]/rawtf.basecaller.bam |
Torrent Suite™ Software Data Management Guide
Data Management Overview
Data Management Configuration
Data Management Email Notifications
(recommended)
Examples of Configured File Categories Rules
Protect Analysis Files From Being Deleted or Archived
Settings After an Upgrade from 3.4 or Earlier Version
Data Management File Categories Details
Delete Analysis Files
Archive or Export Analysis Files
Import Analysis Files
How Do Automatic File Deletion and Archiving Work?
Differences Between Archive and Export
Check Data Management Settings for an Analysis
Reanalyze Archived Data