Extract SDSS field information and PSF

Created: 2012-07-26 17:59:02 Last updated: 2012-09-07 10:21:26

Download Workflow

This workflow gathers information needed by the execution of Sextractor, Galfit and Ellipse, from the SDSS VO service. It receives as input a ascii table with 10 columns:

- Coordinates: Right Ascension, Declination - Data of the field: run, rerun, camcol and field - Path of the fits image. - A value to indicate if the galaxy is barred or not. A 0 if it is not barred and 1 if it is barred. - Path where the psfield file will be downloaded. - Path where the psf file wil be generated.

The workflow generates paths of some files that should be provided to Sextractor, Galfit or Ellipse. This paths are generated using the path of the image as suffix, and creating this structure:

+Eliipse: which will contain the files needed to execute Ellipse +Galfit: which will contain the files needed to execute Galfit +Plots: which will contain the plots that will be generates +psf: which will contain the psf files +Sex: which will contain the files needed to execute Sextractor +votables: which will contain the votables with the information obtained from the execution of the applications.

This workflow extract the band from the image header, and the information about the field (kk, saturation, aa, airmass, gain) from the SDSS DR7 drfield VO service. The psfield file is downloaded in the path provided in the input ascii table, and the program "read_psf" is executed to extract the psf field corresponding with the specific band of the image.

The output of this workflow is made up of 14 lists:

- Filenames: Paths where store files that are going to be generated (i.e. the output file of Sextractor) - psf: Paths where the psf files have been stored. - Band: List of bands correspondig to the image - image: List of paths of images - nx and ny: NAXIS1 and NAXIS2 - kk : List of extinction coefficient values - saturation: List of saturation level values - aa: List of zero-point values - airmass: List of airmass values - gain: List of Gain Averaged over Amplifiers values - ra,dec: List of coordinates - Bar: list of 1/0 indicating if the image of the corresponding row is barred or not

Preview

Download as scalable diagram (SVG)

Run

Run this Workflow in the Taverna Workbench...

Option 1:

Copy and paste this link into File > 'Open workflow location...'
http://www.myexperiment.org/workflows/3054/download?version=4
[ More Info Expand ]

Workflow Components

Authors (1)

Titles (1)

Descriptions (1)

This workflow gathers information needed by the execution of Sextractor, Galfit and Ellipse, from the SDSS VO service. It receives as input a ascii table with 10 columns: - Coordinates: Right Ascension, Declination - Data of the field: run, rerun, camcol and field - Path of the fits image. - A value to indicate if the galaxy is barred or not. A 0 if it is not barred and 1 if it is barred. - Path where the psfield file will be downloaded. - Path where the psf file wil be generated. The workflow generates paths of some files that should be provided to Sextractor, Galfit or Ellipse. This paths are generated using the path of the image as suffix, and creating this structure: +Eliipse: which will contain the files needed to execute Ellipse +Galfit: which will contain the files needed to execute Galfit +Plots: which will contain the plots that will be generates +psf: which will contain the psf files +Sex: which will contain the files needed to execute Sextractor +votables: which will contain the votables with the information obtained from the execution of the applications. This workflow extract the band from the image header, and the information about the field (kk, saturation, aa, airmass, gain) from the SDSS DR7 drfield VO service. The psfield file is downloaded in the path provided in the input ascii table, and the program "read_psf" is executed to extract the psf field corresponding with the specific band of the image. The output of this workflow is made up of 14 lists: - Filenames: Paths where store files that are going to be generated (i.e. the output file of Sextractor) - psf: Paths where the psf files have been stored. - Band: List of bands correspondig to the image - image: List of paths of images - nx and ny: NAXIS1 and NAXIS2 - kk : List of extinction coefficient values - saturation: List of saturation level values - aa: List of zero-point values - airmass: List of airmass values - gain: List of Gain Averaged over Amplifiers values - ra,dec: List of coordinates - Bar: list of 1/0 indicating if the image of the corresponding row is barred or not

Dependencies (0)

Inputs (1)

Name	Description
input_table	ASCII table with following 10 columns - RA, DEC: Coordinates of the image. - RUN, RERUN CAMCOL, FIELD: Info about the field of the image - PATH_IMAGE: Absolute path file to the fits image file - BARRED: This column will contain a 0 if the galaxy has no contain a bar and a 1 otherwise - PATH_PSFIELD: Absolute path where the psfield file will be downloaded - PATH_PSF: Absolute path where the psf file will be generated

Processors (44)

Name	Type	Description
extract_info	beanshell	Script RA_COLUMN = 0; DEC_COLUMN = 1; RUN_COLUMN = 2; RERUN_COLUMN = 3; CAMCOL_COLUMN = 4; FIELD_COLUMN = 5; FILE_COLUMN = 6; BARRED_COLUMN = 7; PSFIELD_COLUMN = 8; PSF_COLUMN = 9; DECs = new ArrayList(); RAs = new ArrayList(); RUNs = new ArrayList(); RERUNs = new ArrayList(); CAMCOLs = new ArrayList(); FIELDs = new ArrayList(); FILEs = new ArrayList(); BARREDs = new ArrayList(); PSFIELDs = new ArrayList(); PSFs = new ArrayList(); for (line : lines.split("\n")) { split = line.split("\\s"); DECs.add(split[DEC_COLUMN]); RAs.add(split[RA_COLUMN]); RUNs.add(split[RUN_COLUMN]); RERUNs.add(split[RERUN_COLUMN]); CAMCOLs.add(split[CAMCOL_COLUMN]); FIELDs.add(split[FIELD_COLUMN]); FILEs.add(split[FILE_COLUMN]); BARREDs.add(split[BARRED_COLUMN]); PSFIELDs.add(split[PSFIELD_COLUMN]); PSFs.add(split[PSF_COLUMN]); }
SDSS_DR7	rest
SR_value	stringconstant	Value 1
extract_header_band	externaltool
extract_filters_for_rows	externaltool
extract_filters_for_columns	externaltool
Select_Rows	tpipe
Select_saturation	tpipe
download_psfield	externaltool
read_psfield	externaltool
Select_kk	tpipe
Select_gain	tpipe
Select_airmass	tpipe
Select_aa	tpipe
change_columnName	beanshell	Script votable=lines.replaceAll("aa_[grizu]", "aa");
Cat_n-tables	tcat
change_columnName2	beanshell	Script votable=lines.replaceAll("airmass_[grizu]", "airmass");
change_columnName3	beanshell	Script votable=lines.replaceAll("gain_[grizu]", "gain");
change_columnName4	beanshell	Script votable=lines.replaceAll("kk_[grizu]", "kk");
change_columnName4_2	beanshell	Script votable=lines.replaceAll("saturationlevel_[grizu]", "satur_level");
image	stringconstant	Value #image
VOcolumn_IMAGE	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
VOcolumn_BAND	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
band	stringconstant	Value #band
create_filenames	externaltool
VOcolumn_PATHFILES	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
pathfiles	stringconstant	Value #cat sex sexparam checkimage_name galfit galfit_exp galfit2nd galfitgal model ellip_tab ellip_resultheader ellip_resultdata ellip_tab2 ellip_resultheader2 ellip_resultdata2 ellip_script1 ellip_script2 ellip_plot
VOcolumn_PSF	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
psf	stringconstant	Value #psf
Cat_n-tables_2	tcat
Cat_n-tables_3	tcat
Cat_n-tables_4	tcat
Cat_n-tables_5	tcat
VOcolumn_RA	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
ra	stringconstant	Value #ra
VOcolumn_DEC	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
dec	stringconstant	Value #dec
VOcolumn_NX	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
nx	stringconstant	Value #nx
VOcolumn_NY	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
headerName_value	stringconstant	Value #ny
VOcolumn_BAR	workflow	This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build.
bar	stringconstant	Value #bar
paramfile_value	stringconstant	Value CIG0000.param

Beanshells (6)

Name	Inputs	Outputs
extract_info	lines	DECs RAs RERUNs RUNs CAMCOLs FIELDs FILEs BARREDs PSFIELDs PSFs
change_columnName	lines	votable
change_columnName2	lines	votable
change_columnName3	lines	votable
change_columnName4	lines	votable
change_columnName4_2	lines	votable

Outputs (14)

Name	Description
aa	VOtable with the value list of aa (Zero-point extracted from SDSS).
image	VOtable with the list of image paths
band	VOtable with the list of characters (g,r,i,u,z) indicating the band of imaga of this specific row
filenames	VOTable with the list of paths needed to execute Sextractor, Galfit and Ellipse
psf	VOTable with the list of psf file paths
airmass	VOtable with the value list of airmass (from SDSS).
gain	VOTable with the value list of Gain Averaged over Amplifiers (from SDSS)
kk	VOtable with the value list of kk (Extinction coefficient extracted from SDSS).
saturation	VOTable with the value list of saturation level (from SDSS)
ra	VOTable with the list of Right Ascension coordinates
dec	VOTable with the list of Declination coordinate.
nx	VOtable with the value list of NAXIS1
ny	VOTable with the value list of NAXIS2
bar	VOTable with a list of 1s or 0s, indicanting if the galaxy of the corresponding row is barred or not

Datalinks (74)

Source	Sink
input_table	extract_info:lines
extract_info:RAs	SDSS_DR7:RA
extract_info:DECs	SDSS_DR7:DEC
SR_value:value	SDSS_DR7:SR
extract_info:FILEs	extract_header_band:path
extract_info:CAMCOLs	extract_filters_for_rows:camcol
extract_info:FIELDs	extract_filters_for_rows:field
extract_info:RERUNs	extract_filters_for_rows:rerun
extract_info:RUNs	extract_filters_for_rows:run
extract_header_band:band	extract_filters_for_columns:band
SDSS_DR7:responseBody	Select_Rows:voTable
extract_filters_for_rows:filter_rows	Select_Rows:filter
Select_Rows:outputTable	Select_saturation:voTable
extract_filters_for_columns:saturation_filter	Select_saturation:filter
extract_info:CAMCOLs	download_psfield:camcol
extract_info:FIELDs	download_psfield:field
extract_info:PSFIELDs	download_psfield:path_psfield
extract_info:RERUNs	download_psfield:rerun
extract_info:RUNs	download_psfield:run
extract_info:PSFs	read_psfield:path_psf_fits
download_psfield:path_psfield_file	read_psfield:path_psf
extract_header_band:band	read_psfield:band
extract_filters_for_columns:kk_filter	Select_kk:filter
Select_Rows:outputTable	Select_kk:voTable
extract_filters_for_columns:gain_filter	Select_gain:filter
Select_Rows:outputTable	Select_gain:voTable
extract_filters_for_columns:airmass_filter	Select_airmass:filter
Select_Rows:outputTable	Select_airmass:voTable
extract_filters_for_columns:aa_filter	Select_aa:filter
Select_Rows:outputTable	Select_aa:voTable
Select_aa:outputTable	change_columnName:lines
change_columnName:votable	Cat_n-tables:votableList
Select_airmass:outputTable	change_columnName2:lines
Select_gain:outputTable	change_columnName3:lines
Select_kk:outputTable	change_columnName4:lines
Select_saturation:outputTable	change_columnName4_2:lines
image:value	VOcolumn_IMAGE:headerName
extract_info:FILEs	VOcolumn_IMAGE:stringList
extract_header_band:band	VOcolumn_BAND:stringList
band:value	VOcolumn_BAND:headerName
extract_info:FILEs	create_filenames:path_image
paramfile_value:value	create_filenames:paramfile
pathfiles:value	VOcolumn_PATHFILES:headerName
create_filenames:filenames	VOcolumn_PATHFILES:stringList
read_psfield:path_psf_file	VOcolumn_PSF:stringList
psf:value	VOcolumn_PSF:headerName
change_columnName2:votable	Cat_n-tables_2:votableList
change_columnName3:votable	Cat_n-tables_3:votableList
change_columnName4:votable	Cat_n-tables_4:votableList
change_columnName4_2:votable	Cat_n-tables_5:votableList
ra:value	VOcolumn_RA:headerName
extract_info:RAs	VOcolumn_RA:stringList
dec:value	VOcolumn_DEC:headerName
extract_info:DECs	VOcolumn_DEC:stringList
nx:value	VOcolumn_NX:headerName
extract_header_band:nx	VOcolumn_NX:stringList
headerName_value:value	VOcolumn_NY:headerName
extract_header_band:ny	VOcolumn_NY:stringList
extract_info:BARREDs	VOcolumn_BAR:stringList
bar:value	VOcolumn_BAR:headerName
Cat_n-tables:outputFileOut	aa
VOcolumn_IMAGE:votable	image
VOcolumn_BAND:votable	band
VOcolumn_PATHFILES:votable	filenames
VOcolumn_PSF:votable	psf
Cat_n-tables_2:outputFileOut	airmass
Cat_n-tables_3:outputFileOut	gain
Cat_n-tables_4:outputFileOut	kk
Cat_n-tables_5:outputFileOut	saturation
VOcolumn_RA:votable	ra
VOcolumn_DEC:votable	dec
VOcolumn_NX:votable	nx
VOcolumn_NY:votable	ny
VOcolumn_BAR:votable	bar

Coordinations (0)

Information Workflow Type

Taverna 2

Information Uploader

Susana

Information License

All versions of this Workflow are licensed under:

Information Version 4 (of 5)

Information Credits (1)

(People/Groups)

Susana

Information Attributions (0)

(Workflows/Files)

None

Information Tags (0)

None

Log in to add Tags

Information Shared with Groups (0)

None

Information Featured In Packs (0)

None

Log in to add to one of your Packs

Information Attributed By (0)

(Workflows/Files)

None

Information Favourited By (0)

No one

Information Statistics

2804 viewings

1170 downloads

[ see breakdown ]

Citations (0)

None

Version History

In chronological order:

Extract SDSS field information and PSF

Created by Susana on Thursday 26 July 2012 17:59:02 (UTC)

Last edited by Susana on Thursday 26 July 2012 18:04:51 (UTC)
Extract SDSS field information and PSF

Created by Susana on Monday 30 July 2012 18:19:42 (UTC)

Last edited by Susana on Monday 13 August 2012 07:42:50 (UTC)

Revision comment:

In this revision the workflow returns a votable with the columns needed by sextractor and it modify the headers of the image fits file, adding the header items needed (GAIN and NCOMBINE)
Extract SDSS field information and PSF

Created by Susana on Monday 13 August 2012 10:13:05 (UTC)

Last edited by Susana on Monday 13 August 2012 10:14:17 (UTC)
Extract SDSS field information and PSF

Created by Susana on Tuesday 14 August 2012 12:48:54 (UTC)
Extract SDSS field information and PSF

Created by Susana on Friday 07 September 2012 10:21:26 (UTC)