ONB Web Archive Fits Characterisation usin...
(2)
Hadoop based workflow for applying FITS on the files contained in ARC web archive container files and ingest the FITS output in a MongoDB using C3PO.
Dependencies:
- Spacip (https://github.com/shsdev/spacip)
- Tomar (https://github.com/openplanets/tomar)
- C3PO (https://github.com/peshkira/c3po)
Parameters:
- hdfs_input_path: Path to a directory which contains textfile(s) with absolute HDFS paths to ARC files
- num_files_per_invokation: Number of items to be processed per invokation
- fits...
Created: 2013-12-09
| Last updated: 2013-12-10
Credits:
Sven