CATALOG UPDATING COOKBOOK

version 10 JUL 2007 by Jen Winters

                                                     
********************************************************************************************
Updating the CTIOPI Astrometry Catalog
********************************************************************************************

A. MAKE SURE YOU HAVE ALL THE 'LONG' HEADERS FOR THE NIGHTS IN QUESTION IN A DIRECTORY.
   Look at the count for each of the nights of interest. 
   Nomenclature example:  20070602.headers

B. If you do not have the long headers, you can generate them by using
   the following command in IRAF: imhead 2007*.fits l+ > 'date'.headers

C. If you obtained the headers via email, each one will have things
   added on top that you must get rid of at this point. Delete those
   rows all the way down to where the data begins.  Example: if you
   export the email to a directory, it will look like this:

     From v12@ctioa4.ctio.noao.edu Sat Jul 15 03:59:19 2006
     Date: Sat, 15 Jul 2006 03:58:58 -0400 (CST)
     From: Visitor #12 
     To: brown@chara.gsu.edu
     Subject: 20060714.09.headers.long

     20060714.09.001.fits[1118,1024][ushort]: bias
     No bad pixels, min=0., max=0. (old)
     Line storage mode, physdim [1118,1024], length of user area 2997 s.u.
     Created Sat 03:55:10 15-Jul-2006, Last modified Sat 03:55:10 15-Jul-2006
     Pixel file "20060714.09.001.fits" [ok]
     BSCALE  =       1.0000000000E0  /  REAL = TAPE*BSCALE + BZERO

   and so on. You must get rid of everything including blank rows so
   that the first line of the header reads:
   "20060714.09.001.fits[1118,1024][ushort]: bias"
   
D. Move the first (chronologically) night's headers into the directory
   /nfs/alphacen/subasavage/ctiocat/unprocessed.

   It is VERY IMPORTANT that you work chronologically because the
   program assigns frame numbers to the nights added & these must be
   in the correct sequence.

E. Make sure that the ccdlog0.9 in the data directory is sorted by
   frame number!!!

F. type in "excatctio" (in /nfs/alphacen/subasavage/ctiocat/unprocessed dir) 
   You should get a message that says:
   
   "This command takes a bit of time--please be patient.
   Splitting raw email files into single-frame-per-file format.
   Processing each frame.
   Next framenumber for telescope 0.9 will be: 921311"

   After a few seconds, you should get another message. This one
   should say:
 
   "Please open another terminal window and examine these files:

   /nfs/alphacen/subasavage/ctiocat/tmp/ccdtmp0.9
   Ready to insert this data into the CCD catalogs and append it to the CCDLOGS
   for this telescope(s)?  Type "y" to proceed or "n" to exit now:" 

   DO NOT TYPE EITHER Y OR N, YET!!!!!!!!! 
 
 G. Before continuing, you need to add catalog codes and check names.
    To do this, open a 2nd terminal & cd into
    /nfs/alphacen/subasavage/ctiocat/tmp/.

 H. emacs "ccdtmp0.9".  Add the catalog codes and check the names.

    Next to the filter column, you need to add a column that
    designates what kind of frame this is good for:

     . = good for pi

     b = bad frame (this means the frame is terrible and can never be
         used for anything)

     d = dropped 

     m = multiple 

     o = other target (someone else's special target or a non-parallax
         object --- e.g. binary, exoplanet, Solar System object)

     p = photometry

     r = refraction

     s = standard star/field for photometry

     x = this is different from a bad frame in that it is not usable
         yet, but might be at a future time (might have been done for
         pi, but in wrong filter)

    If, in the process of adding the codes, the far right columns get
    moved to the right by one space, you need to make sure you remove
    this blank column.  Otherwise, the program will crash.

 I. In 2nd terminal, cd back into the previous directory
    (/nfs/alphacen/subasavage/ctiocat).

 J. In 1st terminal, type "y" (once everything is looking good) and
    hit enter. You will then get a message that says:

    "Update complete.
    Now you must run "./rebuildcat 0.9" and/or "./rebuildcat 1.5""

    You may proceed with adding additional nights. It is probably a
    good idea rebuild the catalog after every 2-4 nights. More on this
    below.

 K. Start with the next (chronologically) night's header file and go
    through steps B through J with it. Do this with each night until
    you are all done.

 L. When you are ready to rebuild the catalog, you should go to the
    1st terminal, type "rebuildcat 0.9" (in unprocessed dir) and hit
    enter.  It will take a few seconds to rebuild the catalog.

 M. After all of the nights have been entered for the catalog update
    you are doing, you should cd into
    /nfs/alphacen/subasavage/ctiocat/data.  There is a file called
    ccdlog0.9 and this is the catalog in its raw form (i.e.
    chronological order).  You should open that file and look at the
    nights you have added to make sure everything looks ok.  You will
    have already done this after processing each night, so here you
    are just glancing to make sure you don't have any major errors
    (e.g. nights accidentally added twice.)  Make any corrections in
    this file; then, rebuild the catalog again.

    This file MUST end in ONLY ONE BLANK LINE. Otherwise, the
    rebuildcat command will die. The ccdlog must also be sorted by the
    far left column (the frame number) in order for the numbering
    sequence to be correct and in order for there to be no duplicate
    numbers.

 N. You should now cd into ccd0.9
    (/nfs/alphacen/subasavage/ctiocat/data/ccd0.9)
 
 O. Type in "cat ccd*>> 'date'". This will concatenate the file.

 P. If everything looks good, send the catted copy to Todd to post.

********************************************************************************************
  NOTES
********************************************************************************************

   1. For objects that have both parallax and photometry frames, you
      need to check to see which is the chosen parallax filter.
   
   2. Check that the names for the stars are correct.  Star names
      should all be standardized (e.g. "LHS2112").  If you see a name
      like "E2mosit", make a note of it.  It will have to be changed
      later.  If there are several "LHS2212AB" entries and then one
      "LHS2212" by itself, change it so that it says "LHS2212AB" also.

      For the most part, knowledge of star names will come with time,
      but in the meantime, things that may tip you off to the wrong
      names are:
      
      -- a short list of frames. The stars will all appear (unless you
         sort them) with breaks in between the different stars. (see
         above instructions for more on this).  

      -- if you suspect that a name may be wrong, refer to the
         protected ctiopi results list via the RECONS page

   3. In each of the individual files for the data, the second to last
      column has a number that will be either negative or positive. A
      negative number tells you that the frame was taken in the
      evening.

**********************************************************************
*****             A TIDY CATALOG IS A HAPPY CATALOG              *****
**********************************************************************