PRM (People Reconstruction Model) service

Created: 2010-04-21 18:10:58 Last updated: 2010-09-15 18:43:08

Download Workflow

No description has been set

Preview

Run

Run this Workflow in the Taverna Workbench...

Option 1:

Copy and paste this link into File > 'Open workflow location...'
http://www.myexperiment.org/workflows/1225/download?version=2
[ More Info Expand ]

Workflow Components

Authors (0)

Titles (0)

Descriptions (0)

Dependencies (0)

Inputs (5)

Name	Description
data_url	PRM (Population Reconstruction Model) - takes a csv file with census data and generates another csv file that contains URL to the census data PRM (Population Reconstruction Model) - takes a csv file with census data and generates another csv file that contains PRM
iterationPerArea	Number of iterations the service will try to make realistic population in each area.
numTestRecords	The number of unique individuals to include in the final population.
sarRecords	The number of unique individuals to include in the final population.
fieldToAggregate	Field from csv file to aggregate

Processors (23)

Name	Type	Description
runPRMWithData	wsdl	Wsdl http://geo-s12.leeds.ac.uk:8080/NeissModel_WS/ModelService?wsdl Wsdl Operation runPRMWithData
runPRMWithData_input	xmlsplitter
runBHPSLinker	wsdl	Wsdl http://geo-s12.leeds.ac.uk:8080/NeissModel_WS/ModelService?wsdl Wsdl Operation runBHPSLinker
runBHPSLinker_input	xmlsplitter
runPRMWithData_output	xmlsplitter
year	stringconstant	Value 2001
runBHPSLinker_output	xmlsplitter
XPath_From_Text	localworker	Script import org.dom4j.Document; import org.dom4j.Node; import org.dom4j.io.SAXReader; SAXReader reader = new SAXReader(false); reader.setIncludeInternalDTDDeclarations(false); reader.setIncludeExternalDTDDeclarations(false); Document document = reader.read(new StringReader(xmltext)); List nodelist = document.selectNodes(xpath); // Process the elements in the nodelist ArrayList outputList = new ArrayList(); ArrayList outputXmlList = new ArrayList(); String val = null; String xmlVal = null; for (Iterator iter = nodelist.iterator(); iter.hasNext();) { Node element = (Node) iter.next(); xmlVal = element.asXML(); val = element.getStringValue(); if (val != null && !val.equals("")) { outputList.add(val); outputXmlList.add(xmlVal); } } List nodelist=outputList; List nodelistAsXML=outputXmlList;
xpath_to_extract_region_name	stringconstant	Value /neiss_xml/results_data/data_element/result_url
xpath_to_extract_csv_url	stringconstant	Value /neiss_xml/results_data/data_element/result_url
XPath_From_Text_2	localworker	Script import org.dom4j.Document; import org.dom4j.Node; import org.dom4j.io.SAXReader; SAXReader reader = new SAXReader(false); reader.setIncludeInternalDTDDeclarations(false); reader.setIncludeExternalDTDDeclarations(false); Document document = reader.read(new StringReader(xmltext)); List nodelist = document.selectNodes(xpath); // Process the elements in the nodelist ArrayList outputList = new ArrayList(); ArrayList outputXmlList = new ArrayList(); String val = null; String xmlVal = null; for (Iterator iter = nodelist.iterator(); iter.hasNext();) { Node element = (Node) iter.next(); xmlVal = element.asXML(); val = element.getStringValue(); if (val != null && !val.equals("")) { outputList.add(val); outputXmlList.add(xmlVal); } } List nodelist=outputList; List nodelistAsXML=outputXmlList;
Get_Web_Page_from_URL	localworker	Script URL inputURL = null; if (base != void) { inputURL = new URL(new URL(base), url); } else { inputURL = new URL(url); } URLConnection con = inputURL.openConnection(); InputStream in = con.getInputStream(); InputStreamReader isr = new InputStreamReader(in); Reader inReader = new BufferedReader(isr); StringBuffer buf = new StringBuffer(); int ch; while ((ch = inReader.read()) > -1) { buf.append((char)ch); } inReader.close(); contents = buf.toString(); //String NEWLINE = System.getProperty("line.separator"); // //URL inputURL = null; //if (base != void) { // inputURL = new URL(new URL(base), url); //} else { // inputURL = new URL(url); //} //StringBuffer result = new StringBuffer(); //BufferedReader reader = new BufferedReader(new InputStreamReader(inputURL.openStream())); //String line = null; //while ((line = reader.readLine()) != null) { // result.append(line); // result.append(NEWLINE); //} // //contents = result.toString();
Extract_First_Item_From_List	localworker	Script if (!stringList.isEmpty()){ firstItem = stringList.get(0); } else{ firstItem = null; }
Extract_First_Item_From_List_2	localworker	Script if (!stringList.isEmpty()){ firstItem = stringList.get(0); } else{ firstItem = null; }
runMapper	wsdl	Wsdl http://geo-s12.leeds.ac.uk:8080/NeissModel_WS/ModelService?wsdl Wsdl Operation runMapper
runMapper_input	xmlsplitter
runMapper_output	xmlsplitter
geometry_value	stringconstant	Value OA
areaKey_value	stringconstant	Value OA_Code
dataValues_value	stringconstant	Value Gender_1
XPath_From_Text_3	localworker	Script import org.dom4j.Document; import org.dom4j.Node; import org.dom4j.io.SAXReader; SAXReader reader = new SAXReader(false); reader.setIncludeInternalDTDDeclarations(false); reader.setIncludeExternalDTDDeclarations(false); Document document = reader.read(new StringReader(xmltext)); List nodelist = document.selectNodes(xpath); // Process the elements in the nodelist ArrayList outputList = new ArrayList(); ArrayList outputXmlList = new ArrayList(); String val = null; String xmlVal = null; for (Iterator iter = nodelist.iterator(); iter.hasNext();) { Node element = (Node) iter.next(); xmlVal = element.asXML(); val = element.getStringValue(); if (val != null && !val.equals("")) { outputList.add(val); outputXmlList.add(xmlVal); } } List nodelist=outputList; List nodelistAsXML=outputXmlList;
xpath_to_extract_map_url	stringconstant	Value /neiss_xml/results_data/data_element/result_url
Extract_First_Item_From_List_3	localworker	Script if (!stringList.isEmpty()){ firstItem = stringList.get(0); } else{ firstItem = null; }

Beanshells (0)

Outputs (7)

Name	Description
output
PRM_xml
csv_url
region_name
csv_file
mapper_xml
map_url

Datalinks (34)

Source	Sink
runPRMWithData_input:output	runPRMWithData:parameters
data_url	runPRMWithData_input:dataURL
iterationPerArea	runPRMWithData_input:iterPerArea
numTestRecords	runPRMWithData_input:numTestRecords
sarRecords	runPRMWithData_input:sarRecords
runBHPSLinker_input:output	runBHPSLinker:parameters
fieldToAggregate	runBHPSLinker_input:fieldToAggregate
year:value	runBHPSLinker_input:year
Extract_First_Item_From_List:firstItem	runBHPSLinker_input:region
runPRMWithData:parameters	runPRMWithData_output:input
runBHPSLinker:parameters	runBHPSLinker_output:input
runPRMWithData_output:return	XPath_From_Text:xml-text
xpath_to_extract_region_name:value	XPath_From_Text:xpath
xpath_to_extract_csv_url:value	XPath_From_Text_2:xpath
runBHPSLinker_output:return	XPath_From_Text_2:xml-text
Extract_First_Item_From_List_2:firstItem	Get_Web_Page_from_URL:url
XPath_From_Text:nodelist	Extract_First_Item_From_List:stringList
XPath_From_Text_2:nodelist	Extract_First_Item_From_List_2:stringList
runMapper_input:output	runMapper:parameters
Extract_First_Item_From_List_2:firstItem	runMapper_input:csvURL
geometry_value:value	runMapper_input:geometry
areaKey_value:value	runMapper_input:areaKey
dataValues_value:value	runMapper_input:dataValues
runMapper:parameters	runMapper_output:input
xpath_to_extract_map_url:value	XPath_From_Text_3:xpath
runMapper_output:return	XPath_From_Text_3:xml-text
XPath_From_Text_3:nodelist	Extract_First_Item_From_List_3:stringList
runBHPSLinker_output:return	output
runPRMWithData_output:return	PRM_xml
Extract_First_Item_From_List_2:firstItem	csv_url
Extract_First_Item_From_List:firstItem	region_name
Get_Web_Page_from_URL:contents	csv_file
runMapper_output:return	mapper_xml
Extract_First_Item_From_List_3:firstItem	map_url

Coordinations (1)

Controller	Target
runPRMWithData	runBHPSLinker

Information Workflow Type

Taverna 2

Information Uploader

Alex Nenadic

Information License

All versions of this Workflow are licensed under:

Information Version 2 (latest) (of 2)

Information Credits (1)

(People/Groups)

Alex Nenadic

Information Attributions (0)

(Workflows/Files)

None

Information Tags (0)

None

Log in to add Tags

Information Shared with Groups (1)

NeISS

Information Featured In Packs (0)

None

Log in to add to one of your Packs

Information Attributed By (0)

(Workflows/Files)

None

Information Favourited By (0)

No one

Information Statistics

1283 viewings

1173 downloads

[ see breakdown ]

Citations (0)

None

Version History

In chronological order:

PRM (Population Reconstruction Model) service

Created by Alex Nenadic on Wednesday 21 April 2010 18:10:58 (UTC)

Last edited by Alex Nenadic on Wednesday 21 April 2010 18:18:34 (UTC)
PRM (People Reconstruction Model) service

Created by Alex Nenadic on Wednesday 15 September 2010 18:31:31 (UTC)

Last edited by Alex Nenadic on Wednesday 15 September 2010 18:43:08 (UTC)

Reviews (0)

No reviews yet

Be the first to review!

Comments (1)

View Timeline

Log in to make a comment

Alex Nenadic	Thursday 09 December 2010 12:01:32 (UTC)
	This is an older version of workflow at http://www.myexperiment.org/workflows/1353.html?version=3 whic uses simpler versions of the services which are not as custmizable as services in this workflow.

Other workflows that use similar services (3)

Only the first 2 workflows that use similar services are shown. View all workflows that use these services.

Taverna 2

Uploader

Alex Nenadic

Census data and PRM services integration (1)

Download

This workflow combines services that provide census data with PRM (Population Reconstruction Model) services.

Created: 2010-04-21 | Last updated: 2010-04-21

Credits: Alex Nenadic

Taverna 2

Uploader

Alex Nenadic

Syntetic population mapper (3)

Download

This workflow creates individual-level population from census data and then joins with the BHPS (British Household Panel Survey) and reaggregates. In the last stage it maps the chosen BHPS field.

Created: 2010-06-23 | Last updated: 2010-12-09

Credits: Alex Nenadic

PRM (People Reconstruction Model) service

Preview

Run

Run this Workflow in the Taverna Workbench...

Workflow Components

Wsdl

Wsdl Operation

Wsdl

Wsdl Operation

Value

Script

Value

Value

Script

Script

Script

Script

Wsdl

Wsdl Operation

Value

Value

Value

Script

Value

Script

Reviews (0)

Comments (1)

Other workflows that use similar services (3)