Pack: Core text mining workflows

Description:

This workflow will remove any XML-invalid characters (these characters often appear in the output of PDF to text software) from any text supplied to the input port.

This is a workflow component, designed to be used as a nested workflow inside a larger text mining or text processing workflow.

Description:

This workflow will remove any XML-invalid and non-ASCII characters (e.g. for sending to the ASCII-only Termine service) from any text supplied to the input port.

This is a workflow component, designed to be used as a nested workflow inside a larger text mining or text processing workflow.

Description:

This workflow will automate the reading of a set of PDF files stored in a single directory (the path to which should be supplied as a single input value).

This is a workflow component, designed to be used as a nested workflow inside a larger text mining or text processing workflow.

Description:

This workflow will automate the reading of a set of text files stored in a single directory (the path to which should be supplied as a single input value).  It will assume that the text files are saved using the default character encoding for the system that Taverna is running on. 

This is a workflow component, designed to be used as a nested workflow inside a larger text mining or text processing workflow.

Description:

This workflow will extract the plain text content of PDF files supplied to the input port.  You can connect the Load PDF from directory workflow to this workflows input. We recommend you send the output from this workflow to the Clean plain text workflow, because the PDF to text process can add characters into the text that are XML-invalid and therefore can not be sent to most services as plain text.  Another way round this problem is to encode the text as Base64 using the handy local service ("Encode Byte Array to Base 64") included with Taverna, although this requires a service that knows to decode the Base 64 back to text, which is not common. The PDF to text service makes use of the "pdftotext" executable from Xpdf.

This is a workflow component, designed to be used as a nested workflow inside a larger text mining or text processing workflow.

Description:

This workflow will attempt to split up text into sentences, returning a list of sentences to the output port.  The sentence splitting service makes use of the OpenNLP sentence detector and has been trained to work on english text. This workflow can be used to provide input to the Termine with c-value threshold workflow.

This is a workflow component, designed to be used as a nested workflow inside a larger text mining or text processing workflow.

Description:

This workflow accepts a list of sentences from a single document and returns the terms found by the TerMine web service. It also allows you to set a threshold c-value score so that only terms with a user-controlled probability (of being a real term) are returned as an output.

To get sentences to supply to this workflow you can use the sentence splitting workflow.  The TerMine service (used in this workflow) only accepts text in ASCII encoding, so you should also use the Clean plain text (ASCII) workflow before splitting sentences.

This is a workflow component, designed to be used as a nested workflow inside a larger text mining or text processing workflow.

Unfortunately there are some restrictions on IP access to the TerMine web service at the NaCTeM. These can be viewed here. If you are at a UK higher eductation institution then there should be no problems, others have to request access through this page.