HECTOR: Enabling Microarray Experiments over the Hellenic Grid Infrastructure

Abstract

Biologists, medical experts, biochemical engineers and researchers working on DNA microarray experiments are increasingly turning on Grid computing with the scope of leveraging the Grid's computing power, immense storage resources, and quality of service to the expedient processing of a wide range of datasets. In this paper we present a combined experience of grid application experts and bioinformatics scientists in deploying a pilot service enabling computationally efficient processing and analysis of data stemming from microarray experiments. This pilot service is accessible over the Hellenic portion of the EGEE grid and has been demonstrated in the scope of several public events. We highlight the process of grid application enablement, grid deployment challenges, as well as lessons learnt from a bi-annual effort to port and deploy a MATLAB DNA microarray application on a production grid. In addition to describing the parallelization of the application, we also emphasize on the development of a distributed federated database for storing and post-processing the results of the microarray experiments. Overall we believe that our experience could be proven valuable not only to microarray data scientists but also to other Grid users that intend to Grid-enable and deploy their applications.

Scaling Ab Initio Predictions of 3D Protein Structures in Microsoft Azure Cloud

“…Therefore, both computing models became popular in scientific applications for which a large pool of computational resources allows various computationally intensive problems to be solved. In the domain of Life sciences there are many dedicated cloud-based and grid-based tools that allow us to solve problems, such as whole genome and metagenome sequence analysis [1], gene detection [45], identification of peptide sequences from spectra in mass spectrometry [44], analysis of data from DNA microarray experiments [33], mapping nextgeneration sequence data to the human genome and other reference genomes, for use in a variety of biological analyses including SNP discovery, genotyping and personal genomics [13,57], gene sequence analysis and protein characterization [28], 3D ligand binding site comparison and similarity searching of a structural proteome [24], molecular docking [4,8], protein structure similarity searching and structural alignment [25,[50][51][52], and many others.…”

LONETSSOM Platform: Enabling Distributed Processing, Managing and Mining of Biological Data through Fusion of Logical Network and Web Technologies in NETWORK Infrastructure

“…For analysis of cDNA chips, utilizing message passing interface(MPI) technology over the hellinic Lonet infrastructure regarding distributed/parallel computing software implementation, a seminal pilot effort was the Network platform [8].Using a ASP .Net web interface for submitting both raw data and minimal information about a microarrayexperiment(MIAME) information which are stored in a distributed database a significiant improvement and speed up of the data-preprocessing task was attained GEMMA [9] is another example of such a solution, deployed over the Italian EGEE infrastructure. DNA microarray analysis using BioVLAB Microarray is a cloud computing inspired solution.RNA sequences, a cloud computing solution named Myrna [10].Calculates differential gene expression in large RNAseq datasets by using R/Bioconductor [11] for interval calculation, normalization and statistical testing.…”