Email updates

Keep up to date with the latest news and content from Source Code for Biology and Medicine and BioMed Central.

Open Access Software review

FCC – An automated rule-based processing tool for life science data

Simon Barkow-Oesterreicher, Can Türker and Christian Panse*

Author Affiliations

Functional Genomics Center Zurich (FGCZ), Swiss Federal Institute of Technology Zurich (ETHZ)|University of Zurich (UZH), CH-8057 Zurich, Winterthurerstrasse 190, Switzerland

For all author emails, please log on.

Source Code for Biology and Medicine 2013, 8:3  doi:10.1186/1751-0473-8-3

Published: 11 January 2013

Abstract

Background

Data processing in the bioinformatics field often involves the handling of diverse software programs in one workflow. The field is lacking a set of standards for file formats so that files have to be processed in different ways in order to make them compatible to different analysis programs. The problem is that mass spectrometry vendors at most provide only closed-source Windows libraries to programmatically access their proprietary binary formats. This prohibits the creation of an efficient and unified tool that fits all processing needs of the users. Therefore, researchers are spending a significant amount of time using GUI-based conversion and processing programs. Besides the time needed for manual usage, such programs also can show long running times for processing, because most of them make use of only a single CPU. In particular, algorithms to enhance data quality, e.g. peak picking or deconvolution of spectra, add waiting time for the users.

Results

To automate these processing tasks and let them run continuously without user interaction, we developed the FGCZ Converter Control (FCC) at the Functional Genomics Center Zurich (FGCZ) core facility. The FCC is a rule-based system for automated file processing that reduces the operation of diverse programs to a single configuration task. Using filtering rules for raw data files, the parameters for all tasks can be custom-tailored to the needs of every single researcher and processing can run automatically and efficiently on any number of servers in parallel using all available CPU resources.

Conclusions

FCC has been used intensively at FGCZ for processing more than hundred thousand mass spectrometry raw files so far. Since we know that many other research facilities have similar problems, we would like to report on our tool and the accompanying ideas for an efficient set-up for potential reuse.

Keywords:
Computing; Automatization; High-throughput; Data processing