DOI Record Generator

Created: 2009-04-29 16:39:57

Download Workflow

This workflow generates DOI record files for deposit, using data set metadata for the FLOSSmole project. It reads in an input file generated from a SQL query from an eprints database, and transforms the parts of the source file as necessary to create a comprehensive DOI deposit record. It also generates DOIs for the data sets. These metadata are inserted into an XML record template (based on the std-doi.xsd schema) and the individual resources are aggregated into a single file.

Preview

Download as scalable diagram (SVG)

Run

Run this Workflow in the Taverna Workbench...

Option 1:

Copy and paste this link into File > 'Open workflow location...'
http://myexperiment.org/workflows/749/download?version=1
[ More Info Expand ]

Workflow Components

Inputs (1)

Name	Description
seed

Processors (18)

Name	Type	Description
file_location	stringconstant	Location of the source CSV with data for creating records.
split_rows	local	Takes a flat CSV input file and splits it into a list.
split_numbers_to_list	local	Takes a single string output and converts it to a list.
split_more	local	Takes the list input and creates a 2-deep list.
read_input	local	Shim to read in the file, location provided by a string constant.
split_formatted_filesize	local	Takes a single string input and splits it into a list of string inputs.
split_filesize_further	local	Splits the filesize string into two pieces, for size and units, so that the units can be replaced and appended to the size.
make_number_sequence	beanshell	Creates a sequential integer series for assignment to DOIs.
parse_url_for_source	beanshell	Extracts the name of the dataset file host from the download location URL.
aggregate_doi_records	beanshell	Aggregates the individual records into a single XML file.
build_URL_from_eprintid	beanshell	Constructs the metadata URL for FLOSSmole data sets, given the name of the eprintid.
split_fields	beanshell	Reads the 2-deep input list and splits out the values into separate variables.
generate_doi	beanshell	Creates a unique DOI string following the format <DOI.base>/<source>.<year>-<month>.<sequential number>.
generate_description	beanshell	Creates a general description of the data set contents to include additional metadata.
format_filesize	beanshell	Formats the filesize into Byte units by appending the metric unit prefix to the size value.
generate_xml_record	beanshell	Generates an XML DOI record according to the std-doi.xsd metadata standard schema.
construct_date	beanshell	Aggregates the individual date fields into a single date unit according to the standard for deposit.
format_months	beanshell	Ensures two-digit month values.

Beanshells (11)

Name	Description	Inputs	Outputs
make_number_sequence	Creates a sequential integer series for assignment to DOIs.	seed trigger	number_sequence
parse_url_for_source	Extracts the name of the dataset file host from the download location URL.	url	publicationPlace
aggregate_doi_records	Aggregates the individual records into a single XML file.	doi	import_file
build_URL_from_eprintid	Constructs the metadata URL for FLOSSmole data sets, given the name of the eprintid.	eprintid	url
split_fields	Reads the 2-deep input list and splits out the values into separate variables.	file	title eprintid year month day url media data_type file_type file_size source abstracts
generate_doi	Creates a unique DOI string following the format <DOI.base>/<source>.<year>-<month>.<sequential number>.	source year month seed	doi
generate_description	Creates a general description of the data set contents to include additional metadata.	media data_type file_type source metadata_url url abstracts	description
format_filesize	Formats the filesize into Byte units by appending the metric unit prefix to the size value.	filesize	formatted_filesize
generate_xml_record	Generates an XML DOI record according to the std-doi.xsd metadata standard schema.	filesize description publicationPlace publicationDate title doi	doi_records
construct_date	Aggregates the individual date fields into a single date unit according to the standard for deposit.	year month day	publicationDate
format_months	Ensures two-digit month values.	month	formatted_month

Outputs (1)

Name	Description
XMLoutput	Text output of XML input file for ePrints metadata records.

Links (35)

Source	Sink
build_URL_from_eprintid:url	generate_description:metadata_url
construct_date:publicationDate	generate_xml_record:publicationDate
file_location:value	read_input:fileurl
format_filesize:formatted_filesize	split_formatted_filesize:string
format_months:formatted_month	construct_date:month
format_months:formatted_month	generate_doi:month
generate_description:description	generate_xml_record:description
generate_xml_record:doi_records	aggregate_doi_records:doi
parse_url_for_source:publicationPlace	generate_xml_record:publicationPlace
read_input:filecontents	split_rows:string
seed	make_number_sequence:seed
generate_doi:doi	generate_xml_record:doi
make_number_sequence:number_sequence	split_numbers_to_list:string
split_fields:abstracts	generate_description:abstracts
split_fields:data_type	generate_description:data_type
split_fields:day	construct_date:day
split_fields:eprintid	build_URL_from_eprintid:eprintid
split_fields:eprintid	make_number_sequence:trigger
split_fields:file_size	split_filesize_further:string
split_fields:file_type	generate_description:file_type
split_fields:media	generate_description:media
split_fields:month	format_months:month
split_fields:source	generate_description:source
split_fields:source	generate_doi:source
aggregate_doi_records:import_file	XMLoutput
split_fields:title	generate_xml_record:title
split_fields:url	generate_description:url
split_fields:url	parse_url_for_source:url
split_fields:year	construct_date:year
split_fields:year	generate_doi:year
split_filesize_further:split	format_filesize:filesize
split_formatted_filesize:split	generate_xml_record:filesize
split_more:split	split_fields:file
split_numbers_to_list:split	generate_doi:seed
split_rows:split	split_more:string