Extract SDSS field information and PSF
This workflow gathers information needed by the execution of Sextractor, Galfit and Ellipse, from the SDSS VO service. It receives as input a ascii table with 10 columns:
- Coordinates: Right Ascension, Declination - Data of the field: run, rerun, camcol and field - Path of the fits image. - A value to indicate if the galaxy is barred or not. A 0 if it is not barred and 1 if it is barred. - Path where the psfield file will be downloaded. - Path where the psf file wil be generated.
The workflow generates paths of some files that should be provided to Sextractor, Galfit or Ellipse. This paths are generated using the path of the image as suffix, and creating this structure:
+Eliipse: which will contain the files needed to execute Ellipse +Galfit: which will contain the files needed to execute Galfit +Plots: which will contain the plots that will be generates +psf: which will contain the psf files +Sex: which will contain the files needed to execute Sextractor +votables: which will contain the votables with the information obtained from the execution of the applications.
This workflow extract the band from the image header, and the information about the field (kk, saturation, aa, airmass, gain) from the SDSS DR7 drfield VO service. The psfield file is downloaded in the path provided in the input ascii table, and the program "read_psf" is executed to extract the psf field corresponding with the specific band of the image.
The output of this workflow is made up of 14 lists:
- Filenames: Paths where store files that are going to be generated (i.e. the output file of Sextractor) - psf: Paths where the psf files have been stored. - Band: List of bands correspondig to the image - image: List of paths of images - nx and ny: NAXIS1 and NAXIS2 - kk : List of extinction coefficient values - saturation: List of saturation level values - aa: List of zero-point values - airmass: List of airmass values - gain: List of Gain Averaged over Amplifiers values - ra,dec: List of coordinates - Bar: list of 1/0 indicating if the image of the corresponding row is barred or not
Preview
Run
Run this Workflow in the Taverna Workbench...
Option 1:
Copy and paste this link into File > 'Open workflow location...'
http://myexperiment.org/workflows/3054/download?version=4
[ More Info ]
Taverna is available from http://taverna.sourceforge.net/
If you are having problems downloading it in Taverna, you may need to provide your username and password in the URL so that Taverna can access the Workflow:
Replace http:// in the link above with http://yourusername:yourpassword@
Workflow Components
![]() | ![]() |
Susana Sánchez |
![]() | ![]() |
Extract SDSS field information and PSF |
![]() | ![]() |
This workflow gathers information needed by the execution of Sextractor, Galfit and Ellipse, from the SDSS VO service. It receives as input a ascii table with 10 columns: - Coordinates: Right Ascension, Declination - Data of the field: run, rerun, camcol and field - Path of the fits image. - A value to indicate if the galaxy is barred or not. A 0 if it is not barred and 1 if it is barred. - Path where the psfield file will be downloaded. - Path where the psf file wil be generated. The workflow generates paths of some files that should be provided to Sextractor, Galfit or Ellipse. This paths are generated using the path of the image as suffix, and creating this structure: +Eliipse: which will contain the files needed to execute Ellipse +Galfit: which will contain the files needed to execute Galfit +Plots: which will contain the plots that will be generates +psf: which will contain the psf files +Sex: which will contain the files needed to execute Sextractor +votables: which will contain the votables with the information obtained from the execution of the applications. This workflow extract the band from the image header, and the information about the field (kk, saturation, aa, airmass, gain) from the SDSS DR7 drfield VO service. The psfield file is downloaded in the path provided in the input ascii table, and the program "read_psf" is executed to extract the psf field corresponding with the specific band of the image. The output of this workflow is made up of 14 lists: - Filenames: Paths where store files that are going to be generated (i.e. the output file of Sextractor) - psf: Paths where the psf files have been stored. - Band: List of bands correspondig to the image - image: List of paths of images - nx and ny: NAXIS1 and NAXIS2 - kk : List of extinction coefficient values - saturation: List of saturation level values - aa: List of zero-point values - airmass: List of airmass values - gain: List of Gain Averaged over Amplifiers values - ra,dec: List of coordinates - Bar: list of 1/0 indicating if the image of the corresponding row is barred or not |
![]() | ![]() |
None
Inputs (1) | ![]() |
Name | Description |
---|---|
input_table | ASCII table with following 10 columns - RA, DEC: Coordinates of the image. - RUN, RERUN CAMCOL, FIELD: Info about the field of the image - PATH_IMAGE: Absolute path file to the fits image file - BARRED: This column will contain a 0 if the galaxy has no contain a bar and a 1 otherwise - PATH_PSFIELD: Absolute path where the psfield file will be downloaded - PATH_PSF: Absolute path where the psf file will be generated |
Processors (44) | ![]() |
Name | Type | Description |
---|---|---|
extract_info | beanshell |
ScriptRA_COLUMN = 0; DEC_COLUMN = 1; RUN_COLUMN = 2; RERUN_COLUMN = 3; CAMCOL_COLUMN = 4; FIELD_COLUMN = 5; FILE_COLUMN = 6; BARRED_COLUMN = 7; PSFIELD_COLUMN = 8; PSF_COLUMN = 9; DECs = new ArrayList(); RAs = new ArrayList(); RUNs = new ArrayList(); RERUNs = new ArrayList(); CAMCOLs = new ArrayList(); FIELDs = new ArrayList(); FILEs = new ArrayList(); BARREDs = new ArrayList(); PSFIELDs = new ArrayList(); PSFs = new ArrayList(); for (line : lines.split("\n")) { split = line.split("\\s"); DECs.add(split[DEC_COLUMN]); RAs.add(split[RA_COLUMN]); RUNs.add(split[RUN_COLUMN]); RERUNs.add(split[RERUN_COLUMN]); CAMCOLs.add(split[CAMCOL_COLUMN]); FIELDs.add(split[FIELD_COLUMN]); FILEs.add(split[FILE_COLUMN]); BARREDs.add(split[BARRED_COLUMN]); PSFIELDs.add(split[PSFIELD_COLUMN]); PSFs.add(split[PSF_COLUMN]); } |
SDSS_DR7 | rest | |
SR_value | stringconstant |
Value1 |
extract_header_band | externaltool | |
extract_filters_for_rows | externaltool | |
extract_filters_for_columns | externaltool | |
Select_Rows | tpipe | |
Select_saturation | tpipe | |
download_psfield | externaltool | |
read_psfield | externaltool | |
Select_kk | tpipe | |
Select_gain | tpipe | |
Select_airmass | tpipe | |
Select_aa | tpipe | |
change_columnName | beanshell |
Scriptvotable=lines.replaceAll("aa_[grizu]", "aa"); |
Cat_n-tables | tcat | |
change_columnName2 | beanshell |
Scriptvotable=lines.replaceAll("airmass_[grizu]", "airmass"); |
change_columnName3 | beanshell |
Scriptvotable=lines.replaceAll("gain_[grizu]", "gain"); |
change_columnName4 | beanshell |
Scriptvotable=lines.replaceAll("kk_[grizu]", "kk"); |
change_columnName4_2 | beanshell |
Scriptvotable=lines.replaceAll("saturationlevel_[grizu]", "satur_level"); |
image | stringconstant |
Value#image |
VOcolumn_IMAGE | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
VOcolumn_BAND | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
band | stringconstant |
Value#band |
create_filenames | externaltool | |
VOcolumn_PATHFILES | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
pathfiles | stringconstant |
Value#cat sex sexparam checkimage_name galfit galfit_exp galfit2nd galfitgal model ellip_tab ellip_resultheader ellip_resultdata ellip_tab2 ellip_resultheader2 ellip_resultdata2 ellip_script1 ellip_script2 ellip_plot |
VOcolumn_PSF | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
psf | stringconstant |
Value#psf |
Cat_n-tables_2 | tcat | |
Cat_n-tables_3 | tcat | |
Cat_n-tables_4 | tcat | |
Cat_n-tables_5 | tcat | |
VOcolumn_RA | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
ra | stringconstant |
Value#ra |
VOcolumn_DEC | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
dec | stringconstant |
Value#dec |
VOcolumn_NX | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
nx | stringconstant |
Value#nx |
VOcolumn_NY | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
headerName_value | stringconstant |
Value#ny |
VOcolumn_BAR | workflow | This workflow converts a list of values into a VO table with only one column. It receives two inputs: the list of values and the header name of the column to be build. |
bar | stringconstant |
Value#bar |
paramfile_value | stringconstant |
ValueCIG0000.param |
Beanshells (6) | ![]() |
Name | Description | Inputs | Outputs |
---|---|---|---|
extract_info | lines |
DECs RAs RERUNs RUNs CAMCOLs FIELDs FILEs BARREDs PSFIELDs PSFs |
|
change_columnName | lines | votable | |
change_columnName2 | lines | votable | |
change_columnName3 | lines | votable | |
change_columnName4 | lines | votable | |
change_columnName4_2 | lines | votable |
Outputs (14) | ![]() |
Name | Description |
---|---|
aa | VOtable with the value list of aa (Zero-point extracted from SDSS). |
image | VOtable with the list of image paths |
band | VOtable with the list of characters (g,r,i,u,z) indicating the band of imaga of this specific row |
filenames | VOTable with the list of paths needed to execute Sextractor, Galfit and Ellipse |
psf | VOTable with the list of psf file paths |
airmass | VOtable with the value list of airmass (from SDSS). |
gain | VOTable with the value list of Gain Averaged over Amplifiers (from SDSS) |
kk | VOtable with the value list of kk (Extinction coefficient extracted from SDSS). |
saturation | VOTable with the value list of saturation level (from SDSS) |
ra | VOTable with the list of Right Ascension coordinates |
dec | VOTable with the list of Declination coordinate. |
nx | VOtable with the value list of NAXIS1 |
ny | VOTable with the value list of NAXIS2 |
bar | VOTable with a list of 1s or 0s, indicanting if the galaxy of the corresponding row is barred or not |
Datalinks (74) | ![]() |
Source | Sink |
---|---|
input_table | extract_info:lines |
extract_info:RAs | SDSS_DR7:RA |
extract_info:DECs | SDSS_DR7:DEC |
SR_value:value | SDSS_DR7:SR |
extract_info:FILEs | extract_header_band:path |
extract_info:CAMCOLs | extract_filters_for_rows:camcol |
extract_info:FIELDs | extract_filters_for_rows:field |
extract_info:RERUNs | extract_filters_for_rows:rerun |
extract_info:RUNs | extract_filters_for_rows:run |
extract_header_band:band | extract_filters_for_columns:band |
SDSS_DR7:responseBody | Select_Rows:voTable |
extract_filters_for_rows:filter_rows | Select_Rows:filter |
Select_Rows:outputTable | Select_saturation:voTable |
extract_filters_for_columns:saturation_filter | Select_saturation:filter |
extract_info:CAMCOLs | download_psfield:camcol |
extract_info:FIELDs | download_psfield:field |
extract_info:PSFIELDs | download_psfield:path_psfield |
extract_info:RERUNs | download_psfield:rerun |
extract_info:RUNs | download_psfield:run |
extract_info:PSFs | read_psfield:path_psf_fits |
download_psfield:path_psfield_file | read_psfield:path_psf |
extract_header_band:band | read_psfield:band |
extract_filters_for_columns:kk_filter | Select_kk:filter |
Select_Rows:outputTable | Select_kk:voTable |
extract_filters_for_columns:gain_filter | Select_gain:filter |
Select_Rows:outputTable | Select_gain:voTable |
extract_filters_for_columns:airmass_filter | Select_airmass:filter |
Select_Rows:outputTable | Select_airmass:voTable |
extract_filters_for_columns:aa_filter | Select_aa:filter |
Select_Rows:outputTable | Select_aa:voTable |
Select_aa:outputTable | change_columnName:lines |
change_columnName:votable | Cat_n-tables:votableList |
Select_airmass:outputTable | change_columnName2:lines |
Select_gain:outputTable | change_columnName3:lines |
Select_kk:outputTable | change_columnName4:lines |
Select_saturation:outputTable | change_columnName4_2:lines |
image:value | VOcolumn_IMAGE:headerName |
extract_info:FILEs | VOcolumn_IMAGE:stringList |
extract_header_band:band | VOcolumn_BAND:stringList |
band:value | VOcolumn_BAND:headerName |
extract_info:FILEs | create_filenames:path_image |
paramfile_value:value | create_filenames:paramfile |
pathfiles:value | VOcolumn_PATHFILES:headerName |
create_filenames:filenames | VOcolumn_PATHFILES:stringList |
read_psfield:path_psf_file | VOcolumn_PSF:stringList |
psf:value | VOcolumn_PSF:headerName |
change_columnName2:votable | Cat_n-tables_2:votableList |
change_columnName3:votable | Cat_n-tables_3:votableList |
change_columnName4:votable | Cat_n-tables_4:votableList |
change_columnName4_2:votable | Cat_n-tables_5:votableList |
ra:value | VOcolumn_RA:headerName |
extract_info:RAs | VOcolumn_RA:stringList |
dec:value | VOcolumn_DEC:headerName |
extract_info:DECs | VOcolumn_DEC:stringList |
nx:value | VOcolumn_NX:headerName |
extract_header_band:nx | VOcolumn_NX:stringList |
headerName_value:value | VOcolumn_NY:headerName |
extract_header_band:ny | VOcolumn_NY:stringList |
extract_info:BARREDs | VOcolumn_BAR:stringList |
bar:value | VOcolumn_BAR:headerName |
Cat_n-tables:outputFileOut | aa |
VOcolumn_IMAGE:votable | image |
VOcolumn_BAND:votable | band |
VOcolumn_PATHFILES:votable | filenames |
VOcolumn_PSF:votable | psf |
Cat_n-tables_2:outputFileOut | airmass |
Cat_n-tables_3:outputFileOut | gain |
Cat_n-tables_4:outputFileOut | kk |
Cat_n-tables_5:outputFileOut | saturation |
VOcolumn_RA:votable | ra |
VOcolumn_DEC:votable | dec |
VOcolumn_NX:votable | nx |
VOcolumn_NY:votable | ny |
VOcolumn_BAR:votable | bar |
Coordinations (0) | ![]() |
None
Workflow Type
Version 4
(of 5)
Shared with Groups (0)
None
Statistics
In chronological order:
-
Created by Susana on Monday 30 July 2012 18:19:42 (UTC)
Last edited by Susana on Monday 13 August 2012 07:42:50 (UTC)
Revision comment:In this revision the workflow returns a votable with the columns needed by sextractor and it modify the headers of the image fits file, adding the header items needed (GAIN and NCOMBINE)
-
Created by Susana on Tuesday 14 August 2012 12:48:54 (UTC)
-
Created by Susana on Friday 07 September 2012 10:21:26 (UTC)
Reviews
(0)
Other workflows that use similar services
(0)
There are no workflows in myExperiment that use similar services to this Workflow.
No comments yet
Log in to make a comment