Workflow1DataSetPath00 C:\SCAPE\dataset 2014-04-24 13:47:08.447 UTC Path to local data set directory on BUT local machine. 2014-04-24 13:45:29.0 UTC Nodes00 Some input parameter for our experimental MPI application for video content analysing. 2014-04-24 13:44:38.353 UTC resolutionOfImages=1024 frameRate=25 ... 2014-04-24 13:48:09.830 UTC CoresPerNode00ExperimentResultsAndMetadata ... 2014-04-24 13:58:30.428 UTC Metadata and results of experiment and results of hadoop analysis. 2014-04-24 13:58:35.225 UTC SFTPtransportDataToClustersftpInput0clusterDataSetPath00 2014-04-24 13:12:52.941 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity default 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> 203a83fe-bcbb-48d4-a80d-d3f26db6a08f sftp 1200 1800 sftpInput sftpInput true false false windows-1250 false false false clusterDataSetPath clusterDataSetPath false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Invoke3DReconstructionApplicationdataSetPath0Nodes0CoresPerNode0metadataPath00STDOUT00 Experimental MPI application running on cluster, providing some video semantic analysis, while saving details about cluster environment (like memory usage, available drivers, names of currently used nodes, processing time, etc.) to XML metadata. The experimental applications will be applications for 1) Reconstruction of 3D model from set of images, there will be cca. 270000 images from stereo camera, we will divide them to smaller groups and reconstruct smaller model from each group of images. 2) Anotation of mountain scenery images - we try to align real images to synthetically rendered panoramas (from high resolution DEM) while varying some parametrs (sampling, resolution etc.). Dataset will contain text and jpeg images and some text files (maybe in XML format), this data set will not be large-scale, but the metadata coming from the experiment will be large scale (we will run the application on the same data for many times with many different values of parameters). 2014-04-24 14:04:52.531 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> f6e096c8-8053-4995-a4db-fef2800301cf experimentalApplication 1200 1800 Nodes Nodes true false false windows-1250 false false false CoresPerNode CoresPerNode true false false windows-1250 false false false dataSetPath dataSetPath true false false windows-1250 false false false metadataPath metadataPath false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeAvarageTimeSIFTexperimentMetadataPath0hadoopResult100 Hadoop application analysing saved metadata, just extracting some particular information about environment etc. wrt AnalyseParameter1, for example list of results which were processed longer than 1 minute. 2014-04-24 13:55:58.701 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> 773a96ac-df74-44fd-aee7-68b184106743 hadoop1 1200 1800 experimentMetadataPath experimentMetadataPath true false false windows-1250 false false false hadoopParam1 hadoopParam1 true false false windows-1250 false false false hadoopResult1 hadoopResult1 false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeAvarageTimeMatcherexperimentMetadataPath0hadoopResults200 Hadoop application analysing saved metadata, just extracting some particular information about environment etc. wrt AnalyseParameter2, for example avarage memory usage of cluster when processing inputs from 1 to 100. 2014-04-24 13:57:03.158 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> 773a96ac-df74-44fd-aee7-68b184106743 hadoop1 1200 1800 experimentMetadataPath experimentMetadataPath true false false windows-1250 false false false hadoopParam2 hadoopParam2 true false false windows-1250 false false false hadoopResults2 hadoopResults2 false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeFTPStransportMetadataAndResultsToLocalftpsIn0localResultsPath00 Transfer all the metadata and results of experiment and results of hadoop analysis from the cluster back to the local computer. 2014-04-24 13:58:10.833 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> a33b63ac-5a09-4992-a283-8336b2378aa2 ftps 1200 1800 ftpsIn ftpsIn true false false windows-1250 false false false localResultsPath localResultsPath false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeAvarageTimeTrackerexperimentMetadataPath0hadoopResults200 Hadoop application analysing saved metadata, just extracting some particular information about environment etc. wrt AnalyseParameter2, for example avarage memory usage of cluster when processing inputs from 1 to 100. 2014-04-24 13:57:03.158 UTC net.sf.taverna.t2.activitiesexternal-tool-activity1.4net.sf.taverna.t2.activities.externaltool.ExternalToolActivity 789663B8-DA91-428A-9F7D-B3F3DA185FD4 default local <?xml version="1.0" encoding="UTF-8"?> <localInvocation /> 773a96ac-df74-44fd-aee7-68b184106743 hadoop1 1200 1800 experimentMetadataPath experimentMetadataPath true false false windows-1250 false false false hadoopParam2 hadoopParam2 true false false windows-1250 false false false hadoopResults2 hadoopResults2 false false true true 0 false net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Parallelize 1 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.ErrorBouncenet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Failovernet.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.Retry 1.0 1000 5000 0 net.sf.taverna.t2.coreworkflowmodel-impl1.4net.sf.taverna.t2.workflowmodel.processor.dispatch.layers.InvokeSFTPtransportDataToClustersftpInputDataSetPath3DReconstructionApplicationdataSetPathSFTPtransportDataToClusterclusterDataSetPath3DReconstructionApplicationNodesNodes3DReconstructionApplicationCoresPerNodeCoresPerNodeAvarageTimeSIFTexperimentMetadataPath3DReconstructionApplicationmetadataPathAvarageTimeMatcherexperimentMetadataPath3DReconstructionApplicationmetadataPathAvarageTimeTrackerexperimentMetadataPath3DReconstructionApplicationSTDOUTFTPStransportMetadataAndResultsToLocalftpsInAvarageTimeSIFThadoopResult1FTPStransportMetadataAndResultsToLocalftpsInAvarageTimeMatcherhadoopResults2FTPStransportMetadataAndResultsToLocalftpsIn3DReconstructionApplicationmetadataPathFTPStransportMetadataAndResultsToLocalftpsInAvarageTimeTrackerhadoopResults2ExperimentResultsAndMetadataFTPStransportMetadataAndResultsToLocallocalResultsPath 9f12f157-cca0-4cd5-8a12-400d8db19c6d 2014-05-07 21:08:56.863 UTC 9681f2f6-6ad0-4c56-9a10-fe11547d8507 2014-04-24 14:05:51.77 UTC