Status of SX Requirements

The science archive shall consist of:

1. A science database that shall:

a. Retain calibrated object catalogs (photometric CCD output) Yes

b. Retain parameters from spectroscopic pipeline Yes

c. Enhanced goal: provide ability to recalibrate object catalogs No

d. Retain references to atlas images and extracted spectra Yes

e. Provide ability to carry out manual target selection for certain target categories Yes

f. Provide ability to carry out offline QA activities Yes

g. Provide ability for SDSS scientists to extract subsets of retained data Yes

h. Enhanced goal: Provide ability to retain scientist-derived data sets No

i. Enhanced goal: Provide smooth transition to public distribution system No

2. A set of files tracked by the science database Yes (tsObjc, tsField, fpAtlas, fpBin, psSpec, fpMask)
3. A set of files not tracked by the science database Yes (all other files)

Summary:

I. Input to Science Archive

1. Survey Definition

a. A description of the North Imaging survey area  Yes

b. Survey progress: A description of sky inserted into database to date  Yes

2. Final Astrometric Calibration

a. List of r' band calibration coefficients on a frame-by-frame basis Yes


[TBD: Are position errors stored on an object-by-object basis?]

3. Final Photometric Calibraton

a. List of photometric calibration coefficients on a frame-by-frame basis Yes

4. Merged Object Lists

a. A list of calibrated objects and parameters from the Frames pipeline of photo Yes

b. A list of object masks from the Frames pipeline of photo No (photo not providing masks, only bit flags), needs to be extracted (who, when?)


[TBD: Do a and b provide all information about masked areas of sky?]

c. Run and Field information. Might be needed for recalibrations Yes

d. Star/Galaxy/QSO classifications Yes

e. Enhanced goal: Cross-identifications to other catalogs No (wait till real mandate for this; FIRST, USNO, ROSAT incl.)

5. Target Selection

a. A list of all targetable objects with target selection categories No (target does not store this - to be changed)

b. A list of all objects from a selected as targets with selection category Yes

c. Tiling flags for all objects in b Yes (coming with schema for spectra)

d. Reports for all targets selected manually No (target does not store this - to be changed)

6. Spectroscopic Pipeline

a. Redshifts and parameters of all targeted objects Yes

b. Enhanced goal: Tile and plate information Yes


[TBD: If a target has multiple spectra obtained, is there a need to assign one as a primary measurement?] NA

7. Enhanced goal: Scientist derived catalogs No
8. Enhanced goal: Other input catalogs No
9. Separate files tracked from Science Database

a. Atlas Images Yes (under construction)

b. 1-D spectra Yes (under construction)

10. Separate files not tracked or accessible from Science Archive

a. Compressed pixel map

b. Full corrected pixel map

c. Corrected spectroscopic frames

d. Unused data

11. TBD: Southern Survey Yes (same as Northern)

Summary:

II. Functional Goals

1. User will be able to carry out efficient queries to locate objects over one or more ranges of following attributes:

a. Longitude or latitude in several spherical coordinates

i) J2000 Ra and Dec Yes

ii) J1950 Ra and Dec Yes

iii) Enhanced goal: Ra and Dec of arbitrary epoch No

iv) Galactic coordinates Yes

v) Survey Coordinates Yes

vi) Any linear combination of the two coordinates Yes

b. Radius within a give point of the sky Yes

c. u' g' r' i' z' (One set of magnitudes per object) Yes

d. Any linear combination of c. Yes

e. Object radius (one per object) Yes

f. Surface brightess formed by c and d Yes

g. Star/Galaxy/QSO Classification flag Yes

h. Object class (small/medium/big/mask) Yes

i. Target Selection Category Yes (target flags)

j. Spectrum available flag Yes (link exists?)

2. User will be able to carry out queries on any retained object parameter (subject to implementation constraints) Yes
3. Enhanced Goal: All calibrated quantities can be recomputed using improved astrometric and photometric calibrations. Queries can be performed on the recalibrated quantities Yes (in principle, with methods defined on objects)
4. For all efficient queries, return an esimated number of objects to be located Yes
5. For all located objects, users shall be able to specify an arbitrary subset of stored parameters to be returned (subject to implementation constraints) plus the following derived quantities: Yes

a. Number of located objects Yes

b. TBD: Extra parameters Yes (e.g. AVERAGE, MIN, MAX, STDDEV etc.)

6. Users shall be able to perform the following functions:

a. Efficient repeated queries [e.g, get all objects within each of 10,000 QSOs in my favorite catalog).] No

b. Make simple plots, etc. of returned parameters (e.g., SMONGO) No, but can do with AEs

c. Formulate new queries based on results of previous queries NA

d. TBD: What else?

Summary:

III. Technical Goals

1. User interface

a. User interface shall be developed in a TCL/Tk/TclDp environment Yes

b. User interface shall communicate with a query support layer via ASCII interface protocol Yes

c. Data shall be returnable to files, sockets, or pipes. Returned data shall use binary machine independent format (FITS binary, ASCII if appropriate, TBD: FITS ASCII, other?) Yes

2. Enhanced goal: Data shall be stored in a system providing industry-standard OSQL-like interface to enable use of commercial products to provide alternative view of the database Yes (Objy has SQL++)
3. Distributability

a. A master copy of all data shall be maintained (the Master Science Archive) Yes

b. Capability shall be present to replicate all or part of the Master Science Archive as local databases at SDSS institutions. Replication may consist of:

i) Science Database in its entirety Yes

ii) All or part of separate files tracked by Science Database Yes

iii) No capability shall be present to replicate an arbitrarily selected subset of the science database beyond that described by section 1.c of USER INTERFACE Yes

iv) Replication of databases shall be possible on all SDSS supported platforms Yes

d. No capability is required be present to replicate all or part of separate files not tracked by Science Database Yes

4. Security

a. Master Science Archive shall be protected against corruption by SDSS participant user Yes

b. Master Science Archive shall be protected against unauthorized access Yes

Summary:

Peter Z. Kunszt, Ani R. Thakar,
Last Modified: Jul 11, 2000.