Workflow1DataSetPath00 Path to local data set directory on BUT local machine. 2014-04-24 13:45:29.0 UTC C:\SCAPE\dataset 2014-04-24 13:47:08.447 UTC ExperimentParam00 Some input parameter for our experimental MPI application for video content analysing. 2014-04-24 13:44:38.353 UTC resolutionOfImages=1024 frameRate=25 ... 2014-04-24 13:48:09.830 UTC AnalyseParam100 timeOfExecution>1min 2014-04-24 13:48:45.394 UTC Parameter for some of Hadoop tools for analysing metadate captured from the experimental MPI application. 2014-04-24 13:46:25.381 UTC AnalyseParam200 Parameter for some of Hadoop tools for analysing metadate captured from the experimental MPI application. 2014-04-24 13:46:45.477 UTC avarageMemoryUsageForInputs=0..100 2014-04-24 13:57:15.143 UTC ExperimentResultsAndMetadata ... 2014-04-24 13:58:30.428 UTC Metadata and results of experiment and results of hadoop analysis. 2014-04-24 13:58:35.225 UTC SFTPtransportDataToClustersftpInput0clusterDataSetPath00 2014-04-24 13:12:52.941 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity default 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> 203a83fe-bcbb-48d4-a80d-d3f26db6a08f sftp 1200 1800 sftpInput sftpInput true false false windows-1250 false false false clusterDataSetPath clusterDataSetPath false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeExperimentalMPIApplicationdataSetPath0Param10metadataPath00 Experimental MPI application running on cluster, providing some video semantic analysis, while saving details about cluster environment (like memory usage, available drivers, names of currently used nodes, processing time, etc.) to XML metadata. The experimental applications will be applications for 1) Reconstruction of 3D model from set of images, there will be cca. 270000 images from stereo camera, we will divide them to smaller groups and reconstruct smaller model from each group of images. 2) Anotation of mountain scenery images - we try to align real images to synthetically rendered panoramas (from high resolution DEM) while varying some parametrs (sampling, resolution etc.). Dataset will contain text and jpeg images and some text files (maybe in XML format), this data set will not be large-scale, but the metadata coming from the experiment will be large scale (we will run the application on the same data for many times with many different values of parameters). 2014-04-24 14:04:52.531 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> f6e096c8-8053-4995-a4db-fef2800301cf experimentalApplication 1200 1800 Param1 Param1 true false false windows-1250 false false false dataSetPath dataSetPath true false false windows-1250 false false false metadataPath metadataPath false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeHadoopProcessMetadata1experimentMetadataPath0hadoopParam10hadoopResult100 Hadoop application analysing saved metadata, just extracting some particular information about environment etc. wrt AnalyseParameter1, for example list of results which were processed longer than 1 minute. 2014-04-24 13:55:58.701 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> 773a96ac-df74-44fd-aee7-68b184106743 hadoop1 1200 1800 experimentMetadataPath experimentMetadataPath true false false windows-1250 false false false hadoopParam1 hadoopParam1 true false false windows-1250 false false false hadoopResult1 hadoopResult1 false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeHadoopProcessMetadata2experimentMetadataPath0hadoopParam20hadoopResults200 Hadoop application analysing saved metadata, just extracting some particular information about environment etc. wrt AnalyseParameter2, for example avarage memory usage of cluster when processing inputs from 1 to 100. 2014-04-24 13:57:03.158 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> 773a96ac-df74-44fd-aee7-68b184106743 hadoop1 1200 1800 experimentMetadataPath experimentMetadataPath true false false windows-1250 false false false hadoopParam2 hadoopParam2 true false false windows-1250 false false false hadoopResults2 hadoopResults2 false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeFTPStransportMetadataAndResultsToLocalftpsIn0localResultsPath00 Transfer all the metadata and results of experiment and results of hadoop analysis from the cluster back to the local computer. 2014-04-24 13:58:10.833 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> a33b63ac-5a09-4992-a283-8336b2378aa2 ftps 1200 1800 ftpsIn ftpsIn true false false windows-1250 false false false localResultsPath localResultsPath false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeSFTPtransportDataToClustersftpInputDataSetPathExperimentalMPIApplicationdataSetPathSFTPtransportDataToClusterclusterDataSetPathExperimentalMPIApplicationParam1ExperimentParamHadoopProcessMetadata1experimentMetadataPathExperimentalMPIApplicationmetadataPathHadoopProcessMetadata1hadoopParam1AnalyseParam1HadoopProcessMetadata2experimentMetadataPathExperimentalMPIApplicationmetadataPathHadoopProcessMetadata2hadoopParam2AnalyseParam2FTPStransportMetadataAndResultsToLocalftpsInHadoopProcessMetadata1hadoopResult1FTPStransportMetadataAndResultsToLocalftpsInHadoopProcessMetadata2hadoopResults2FTPStransportMetadataAndResultsToLocalftpsInExperimentalMPIApplicationmetadataPathExperimentResultsAndMetadataFTPStransportMetadataAndResultsToLocallocalResultsPath 9681f2f6-6ad0-4c56-9a10-fe11547d8507 2014-04-24 14:05:51.77 UTC