BUT_UVT_preservationWorkflow_template
Created: 2014-04-24 14:39:36
No description has been set
Preview
Run
Run this Workflow in the Taverna Workbench...
Workflow Components
Authors (0)
Titles (0)
Descriptions (0)
Dependencies (0)
Inputs (4)
| Name |
Description |
| DataSetPath |
Path to local data set directory on BUT local machine.
|
| ExperimentParam |
Some input parameter for our experimental MPI application for video content analysing.
|
| AnalyseParam1 |
Parameter for some of Hadoop tools for analysing metadate captured from the experimental MPI application.
|
| AnalyseParam2 |
Parameter for some of Hadoop tools for analysing metadate captured from the experimental MPI application.
|
Processors (5)
| Name |
Type |
Description |
| SFTPtransportDataToCluster |
externaltool |
|
| ExperimentalMPIApplication |
externaltool |
Experimental MPI application running on cluster, providing some video semantic analysis, while saving details about cluster environment (like memory usage, available drivers, names of currently used nodes, processing time, etc.) to XML metadata.
The experimental applications will be applications for
1) Reconstruction of 3D model from set of images, there will be cca. 270000 images from stereo camera, we will divide them to smaller groups and reconstruct smaller model from each group of images.
2) Anotation of mountain scenery images - we try to align real images to synthetically rendered panoramas (from high resolution DEM) while varying some parametrs (sampling, resolution etc.). Dataset will contain text and jpeg images and some text files (maybe in XML format), this data set will not be large-scale, but the metadata coming from the experiment will be large scale (we will run the application on the same data for many times with many different values of parameters). |
| HadoopProcessMetadata1 |
externaltool |
Hadoop application analysing saved metadata, just extracting some particular information about environment etc. wrt AnalyseParameter1, for example list of results which were processed longer than 1 minute. |
| HadoopProcessMetadata2 |
externaltool |
Hadoop application analysing saved metadata, just extracting some particular information about environment etc. wrt AnalyseParameter2, for example avarage memory usage of cluster when processing inputs from 1 to 100. |
| FTPStransportMetadataAndResultsToLocal |
externaltool |
Transfer all the metadata and results of experiment and results of hadoop analysis from the cluster back to the local computer. |
Outputs (1)
| Name |
Description |
| ExperimentResultsAndMetadata |
Metadata and results of experiment and results of hadoop analysis.
|
Datalinks (11)
| Source |
Sink |
| DataSetPath |
SFTPtransportDataToCluster:sftpInput |
| SFTPtransportDataToCluster:clusterDataSetPath |
ExperimentalMPIApplication:dataSetPath |
| ExperimentParam |
ExperimentalMPIApplication:Param1 |
| ExperimentalMPIApplication:metadataPath |
HadoopProcessMetadata1:experimentMetadataPath |
| AnalyseParam1 |
HadoopProcessMetadata1:hadoopParam1 |
| ExperimentalMPIApplication:metadataPath |
HadoopProcessMetadata2:experimentMetadataPath |
| AnalyseParam2 |
HadoopProcessMetadata2:hadoopParam2 |
| HadoopProcessMetadata1:hadoopResult1 |
FTPStransportMetadataAndResultsToLocal:ftpsIn |
| HadoopProcessMetadata2:hadoopResults2 |
FTPStransportMetadataAndResultsToLocal:ftpsIn |
| ExperimentalMPIApplication:metadataPath |
FTPStransportMetadataAndResultsToLocal:ftpsIn |
| FTPStransportMetadataAndResultsToLocal:localResultsPath |
ExperimentResultsAndMetadata |
Uploader
License
All versions of this Workflow are
licensed under:
Version 1
(of 1)
Credits (1)
(People/Groups)
Attributions (0)
(Workflows/Files)
None
Shared with Groups (0)
None
Featured In Packs (0)
None
Log in to add to one of your Packs
Attributed By (0)
(Workflows/Files)
None
Favourited By (0)
No one
Statistics
Other workflows that use similar services
(0)
There are no workflows in myExperiment that use similar services to this Workflow.
Download Workflow
]
Reviews
(0)
No comments yet
Log in to make a comment