DESI Imaging Validation

Introduction

This is the User Notebook to run validation tests at NERSC You only need to input your localdir (at NERSC) to save outputs.

Each cell should have one test
To run a test you need to input

  • survey: DECaLS/BASS/MZLS
  • release: DR6/DR7/DR8b
  • bands: g,r,z
  • localdir: yourdirectory
  • verbose: true/false

Output: path to png image to plot

Enter your directory for outputs


In [1]:
from desi_image_validation4 import *
from IPython.display import Image
from astropy.io import fits
import scipy.signal
import matplotlib.pyplot as plt
#%matplotlib inline

In [2]:
#help(scipy.signal);

In [2]:
localdir = '/global/homes/m/manera/DESI/validation-outputs/'

In [ ]:

Validation Tests

Sanity check to see the hardcoded values of a sample


In [3]:
verbose=False
sample=mysample('DECaLS','DR8','g',localdir,verbose)

# TEST Information 
print( '----- check values sample ----' )
print( 'band = ', sample.band )
print( 'localdir = ', sample.localdir )
print( 'survey = ', sample.survey )
print( 'DR = ', sample.DR )
print( 'path ccd = ',sample.ccds )
print( '----------' )
print( 'zp0 = ', sample.zp0 )
print( 'extinction coef = ', sample.extc )
print( 'extinction raw = ', sample.be )
print( 'magnitude limit = ', sample.recm )
print( 'photoz req = ', sample.phreq )
print( 'catalogue = ', sample.catalog )
print(  'verbose = ', sample.verbose )
print( 'fraction of exposures = ', sample.FracExp )
print( '------------------------' )
print( '                        ' )


----- check values sample ----
band =  g
localdir =  /global/homes/m/manera/DESI/validation-outputs/
survey =  DECaLS
DR =  DR8
path ccd =  /global/project/projectdirs/cosmo/work/legacysurvey/dr8/ccds-annotated-decam-dr8.fits.gz
----------
zp0 =  25.08
extinction coef =  3.303
extinction raw =  1
magnitude limit =  24.0
photoz req =  0.01
catalogue =  DECaLS_DR8
verbose =  False
fraction of exposures =  [0.02, 0.24, 0.5, 0.22, 0.02]
------------------------
                        

Some tests


In [5]:
verbose=False
sample=mysample('BASS','DR8','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1,Nexpmax=500)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:25: RuntimeWarning: overflow encountered in power
  return 10.**(-m/2.5+9.)
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1021: RuntimeWarning: overflow encountered in square
  ivar= 1./nmag**2.
> Projection ivar  total  took : 21.38 sec for 1706597 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 20.71 sec for 1706597 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_r_nside1024_oversamp1_hits__total.fits
Area is  5595.0625665486  sq. deg.
2633 of  1706597  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  13.684178624636196  and max  depth  =  25.142154138773783
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_r_BASS_DR81024.png
Total pixels 1706597 probably too many for exact mean and std
Mean =  23.4603085812 ; Median =  23.4852187204 ; Std =  0.3280129914611642
Results for 90% 95% and 98% are:  23.2385445412 23.0835526344 22.7984475918
Percentage of hits for 0,1,2., to >7 pases
 [  0.00000000e+00   2.77646099e-02   6.46403340e-02   3.93967644e-01
   2.79878026e-01   1.35805934e-01   5.47838769e-02   2.27206540e-02
   9.43339289e-03   4.35486527e-03   2.21844993e-03   1.28208359e-03
   7.46514848e-04   3.82046845e-04   3.22278781e-04   1.83991886e-04
   1.81197300e-04   4.99152320e-05   7.67609459e-05   2.81261481e-05
   6.67996018e-05   4.57049907e-05   1.52349969e-05   1.01371326e-04
   1.79304194e-04   9.66836342e-05   9.66639710e-06]
Out[5]:

In [6]:
verbose=False
sample=mysample('MZLS','DR8','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1,Nexpmax=500)
fig = Image(filename=(fname))
fig


kaka1 0.073531030496 2051 2092
careful 2247 41 0.0710563790783 6.27778075097 0.073531030496 6.27506401064
> Projection ivar  total  took : 21.37 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 21.57 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
Area is  5353.74597260558  sq. deg.
893 of  1632991  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  15.135779377591092  and max  depth  =  24.977076533583716
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_z_MzLS_DR81024.png
Total pixels 1632991 probably too many for exact mean and std
Mean =  23.0264429586 ; Median =  23.0321509822 ; Std =  0.28143532651789194
Results for 90% 95% and 98% are:  22.784207073 22.6662247824 22.4227980852
Percentage of hits for 0,1,2., to >7 pases
 [  0.00000000e+00   1.49774524e-02   3.89586451e-02   2.63031327e-01
   3.31769125e-01   1.60040368e-01   8.20979701e-02   3.67442994e-02
   2.10283235e-02   1.26216482e-02   1.01335711e-02   7.77103077e-03
   6.35522123e-03   4.64730910e-03   3.12617117e-03   1.86039334e-03
   1.74479590e-03   5.19384189e-04   6.68712814e-04   4.57443655e-04
   4.48258040e-04   3.04962437e-04   3.23946042e-04   1.42683229e-04
   1.88611306e-04   8.02210427e-05   5.19490742e-06]
Out[6]:

In [4]:
verbose=False
sample=mysample('BASS','DR8','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:25: RuntimeWarning: overflow encountered in power
  return 10.**(-m/2.5+9.)
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1005: RuntimeWarning: overflow encountered in square
  ivar= 1./nmag**2.
> Projection ivar  total  took : 21.99 sec for 1706597 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 23.07 sec for 1706597 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_r_nside1024_oversamp1_hits__total.fits
Area is  2204.2736195150655  sq. deg.
53 of  672344  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  15.661693788216638  and max  depth  =  23.899805764092726
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_r_BASS_DR81024.png
Total pixels 672344 probably too many for exact mean and std
Mean =  23.4106646189 ; Median =  23.4208000716 ; Std =  0.1266443198466583
Results for 90% 95% and 98% are:  23.283123444 23.2319156676 23.1623261434
Percentage of hits for 0,1,2., to >7 pases
 [  0.00000000e+00   2.77646099e-02   6.46403340e-02   3.93967644e-01
   2.79878026e-01   1.35805934e-01   5.47838769e-02   2.27206540e-02
   9.43339289e-03   4.35486527e-03   2.21844993e-03   1.28208359e-03
   7.46514848e-04   3.82046845e-04   3.22278781e-04   1.83991886e-04
   1.81197300e-04   4.99152320e-05   7.67609459e-05   2.81261481e-05
   6.67996018e-05   4.57049907e-05   1.52349969e-05   1.01371326e-04
   1.79304194e-04   9.66836342e-05   9.66639710e-06]
Out[4]:

In [5]:
verbose=False
sample=mysample('BASS','DR8','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:25: RuntimeWarning: overflow encountered in power
  return 10.**(-m/2.5+9.)
> Projection ivar  total  took : 21.10 sec for 1696337 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 21.20 sec for 1696337 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_g_nside1024_oversamp1_hits__total.fits
Area is  2489.38429358594  sq. deg.
419 of  759308  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  15.929302125391478  and max  depth  =  24.444878713599802
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_g_BASS_DR81024.png
Total pixels 759308 probably too many for exact mean and std
Mean =  23.9978111064 ; Median =  24.0077298673 ; Std =  0.18005507406688842
Results for 90% 95% and 98% are:  23.8917574283 23.8459436259 23.7809805753
Percentage of hits for 0,1,2., to >7 pases
 [  0.00000000e+00   3.11576488e-02   7.18406847e-02   4.47623635e-01
   2.79105988e-01   1.12407586e-01   3.62298378e-02   1.15710050e-02
   3.43333673e-03   1.29457546e-03   6.50235305e-04   5.25258075e-04
   3.34844654e-04   2.12815000e-04   2.23426274e-04   1.74496510e-04
   1.46925336e-04   6.37549810e-05   1.20261108e-04   1.04933712e-04
   8.96063158e-05   9.96280748e-05   8.43006787e-05   4.77507341e-05
   5.95410388e-05   4.48031579e-05   3.19762559e-05]
Out[5]:

In [6]:
verbose=False
sample=mysample('MZLS','DR8','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


kaka1 0.073531030496 2051 2092
careful 2247 41 0.0710563790783 6.27778075097 0.073531030496 6.27506401064
> Projection ivar  total  took : 22.72 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 24.48 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
Area is  1408.2003185414721  sq. deg.
68 of  429527  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  16.934853764507764  and max  depth  =  23.67613289855102
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_z_MzLS_DR81024.png
Total pixels 429527 probably too many for exact mean and std
Mean =  22.9062761539 ; Median =  22.9166987632 ; Std =  0.14336673111452047
Results for 90% 95% and 98% are:  22.7537193967 22.6957527263 22.6179248965
Percentage of hits for 0,1,2., to >7 pases
 [  0.00000000e+00   1.49774524e-02   3.89586451e-02   2.63031327e-01
   3.31769125e-01   1.60040368e-01   8.20979701e-02   3.67442994e-02
   2.10283235e-02   1.26216482e-02   1.01335711e-02   7.77103077e-03
   6.35522123e-03   4.64730910e-03   3.12617117e-03   1.86039334e-03
   1.74479590e-03   5.19384189e-04   6.68712814e-04   4.57443655e-04
   4.48258040e-04   3.04962437e-04   3.23946042e-04   1.42683229e-04
   1.88611306e-04   8.02210427e-05   5.19490742e-06]
Out[6]:

In [7]:
verbose=False
sample=mysample('DECaLS','DR8','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1,Nexpmax=500)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 91.73 sec for 4746068 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 91.42 sec for 4746068 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_r_nside1024_oversamp1_hits__total.fits
Area is  15556.635563069138  sq. deg.
19885 of  4745060  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  1.7618368441390064  and max  depth  =  29.592272022529322
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_r_DECaLS_DR81024.png
Total pixels 4745060 probably too many for exact mean and std
Mean =  24.1766986755 ; Median =  24.0927175265 ; Std =  0.580359990408285
Results for 90% 95% and 98% are:  23.7419693636 23.5744996382 23.1441689145
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.02482354  0.03905529  0.12958599  0.1868157   0.14067328
  0.09101394  0.06153513  0.05064231  0.04496623  0.04191331  0.0366932
  0.0304694   0.022275    0.01613237  0.01215292  0.01893421  0.00544968
  0.00568877  0.00492903  0.00451787  0.00376827  0.00308484  0.00254706
  0.00240416  0.00189407  0.00030542]
Out[7]:

In [8]:
verbose=False
sample=mysample('DECaLS','DR8','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1,Nexpmax=500)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 86.48 sec for 4696321 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 86.18 sec for 4696321 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_hits__total.fits
Area is  15384.341035972331  sq. deg.
5161 of  4692507  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  -14.750942906966156  and max  depth  =  29.153415977633188
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR81024.png
Total pixels 4692507 probably too many for exact mean and std
Mean =  24.5732710178 ; Median =  24.5669669611 ; Std =  0.5167409709005278
Results for 90% 95% and 98% are:  24.170248726 23.9338133836 23.5459613762
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.02430626  0.04192194  0.13056985  0.18710731  0.14313019
  0.09605482  0.06248201  0.04659176  0.03860828  0.03600368  0.03298535
  0.02822556  0.0231839   0.01795418  0.01382952  0.01629364  0.00604635
  0.00630678  0.00497263  0.00407979  0.00330362  0.00277129  0.00250715
  0.00240928  0.00220989  0.00039908]
Out[8]:

In [4]:
verbose=False
sample=mysample('DECaLS','DR8','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1,Nexpmax=500)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 78.53 sec for 4751041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 81.11 sec for 4751041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
Area is  15568.100445402355  sq. deg.
17981 of  4748557  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  15.868551710463867  and max  depth  =  36.53690129970949
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_z_DECaLS_DR81024.png
Total pixels 4748557 probably too many for exact mean and std
Mean =  23.1329259881 ; Median =  23.1441759825 ; Std =  0.47682210120294205
Results for 90% 95% and 98% are:  22.6954655815 22.4208964817 22.1278547683
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.03265588  0.04859499  0.10419507  0.15244113  0.13573449
  0.1124973   0.09077132  0.07429773  0.06132973  0.05073715  0.03911423
  0.02714428  0.01754362  0.01124338  0.00732488  0.00777824  0.00275764
  0.00290441  0.00233299  0.00200685  0.00165411  0.00137611  0.00110971
  0.00096933  0.00088363  0.00016589]
Out[4]:

In [8]:
verbose=False
sample=mysample('DECaLS','DR8','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 86.52 sec for 4696321 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 92.48 sec for 4696321 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_hits__total.fits
Area is  2003.1250948733236  sq. deg.
827 of  610990  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  13.753686949675764  and max  depth  =  25.485623794468246
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR81024.png
Total pixels 610990 probably too many for exact mean and std
Mean =  24.2706577209 ; Median =  24.3240326538 ; Std =  0.3935312199711912
Results for 90% 95% and 98% are:  24.10219944 23.9462527958 23.5798729693
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.02430626  0.04192194  0.13056985  0.18710731  0.14313019
  0.09605482  0.06248201  0.04659176  0.03860828  0.03600368  0.03298535
  0.02822556  0.0231839   0.01795418  0.01382952  0.01629364  0.00604635
  0.00630678  0.00497263  0.00407979  0.00330362  0.00277129  0.00250715
  0.00240928  0.00220989  0.00039908]
Out[8]:

In [9]:
verbose=False
sample=mysample('DECaLS','DR8','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 83.31 sec for 4751041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 83.50 sec for 4751041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
Area is  1618.2663381635828  sq. deg.
2475 of  493601  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  17.38716891667876  and max  depth  =  32.94118926363319
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_z_DECaLS_DR81024.png
Total pixels 493601 probably too many for exact mean and std
Mean =  22.800511185 ; Median =  22.8404069431 ; Std =  0.288981130500062
Results for 90% 95% and 98% are:  22.5954320599 22.4560243983 22.193203758
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.03265588  0.04859499  0.10419507  0.15244113  0.13573449
  0.1124973   0.09077132  0.07429773  0.06132973  0.05073715  0.03911423
  0.02714428  0.01754362  0.01124338  0.00732488  0.00777824  0.00275764
  0.00290441  0.00233299  0.00200685  0.00165411  0.00137611  0.00110971
  0.00096933  0.00088363  0.00016589]
Out[9]:

In [5]:
verbose=False
sample=mysample('BASS','DR6','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 18.94 sec for 1349303 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 19.18 sec for 1349303 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_r_nside1024_oversamp1_hits__total.fits
Area is  1581.8127989405243  sq. deg.
158 of  482482  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  20.547802743668324  and max  depth  =  24.0440501255925
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_r_BASS_DR61024.png
Total pixels 482482 probably too many for exact mean and std
Mean =  23.3985883456 ; Median =  23.418668421 ; Std =  0.16063592677197244
Results for 90% 95% and 98% are:  23.2715043546 23.2078899392 23.0316626059
Percentage of hits for 0,1,2., to >7 pases
 [  0.00000000e+00   1.31542730e-01   2.03272356e-01   3.57578691e-01
   1.94434460e-01   7.54782284e-02   2.44644828e-02   7.76326741e-03
   2.38345279e-03   9.45673433e-04   4.33557177e-04   3.00896092e-04
   2.15666904e-04   8.15235718e-05   1.08945137e-04   7.55945848e-05
   4.10468334e-05   9.33266479e-06   3.63150456e-05   1.92692079e-05
   3.48327989e-05   3.40916755e-05   9.11581757e-05   1.32661085e-04
   6.67011042e-05   1.25990975e-05   6.08815448e-06]
Out[5]:

In [4]:
verbose=False
sample=mysample('DECaLS','DR8','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=3,Nexpmax=500,depthmin=22.5)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.40035546  1.37843847  1.38462842  1.32792389  1.3049556   1.29494798
  1.30253887  1.26291919  1.26832736  1.27024484  1.25783777  1.29604602
  1.28756726  1.26493835  1.24661672  1.26611578  1.25875723  1.31150615
  1.27472997  1.25403273  1.24434972  1.24464691  1.2668035   1.30526829
  1.3024497 ]
> Projection myfwhm  min  took : 60.34 sec for 4623804 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 60.78 sec for 4623804 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 62.26 sec for 4623804 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
Area is  13614.037965375066  sq. deg.
Area with fwhm above  1.3 is 68.38603963070207  sq. deg.
Corresponding to  20859 of  4152532  pixels
Within the plot, min  minfwhm =  0.558162  and max  minfwhm  =  1.84866
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_DECaLS_DR81024.png
Out[4]:

In [5]:
fig = Image(filename=(fname1))
fig


Out[5]:

In [6]:
verbose=False
sample=mysample('DECaLS','DR8','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=1,Nexpmax=500,depthmin=22.5)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.40035546  1.37843847  1.38462842  1.32792389  1.3049556   1.29494798
  1.30253887  1.26291919  1.26832736  1.27024484  1.25783777  1.29604602
  1.28756726  1.26493835  1.24661672  1.26611578  1.25875723  1.31150615
  1.27472997  1.25403273  1.24434972  1.24464691  1.2668035   1.30526829
  1.3024497 ]
> Projection myfwhm  min  took : 65.61 sec for 4623804 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 62.31 sec for 4623804 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 62.11 sec for 4623804 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
Area is  15104.161212067072  sq. deg.
Area with fwhm above  1.3 is 219.11793272534507  sq. deg.
Corresponding to  66835 of  4607047  pixels
Within the plot, min  minfwhm =  0.558162  and max  minfwhm  =  2.18833
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_DECaLS_DR81024.png
Out[6]:

In [7]:
fig = Image(filename=(fname1))
fig


Out[7]:

In [4]:
verbose=False
sample=mysample('MZLS','DR8','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=1,Nexpmax=500,depthmin=22.5)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.14139998  1.12059999  1.19859993  1.1882      1.19340003  1.13099992
  1.2349999   1.13099992  1.53139997  1.41179991  1.61459994  1.45340002
  1.09979999  1.09979999  1.10500002  1.08420002  1.08420002  1.05299997
  1.12059999  1.0582      1.20899999  1.20899999  1.20379996  1.19340003
  2.30619979]
kaka1 0.073531030496 2051 2092
careful 2247 41 0.0710563790783 6.27778075097 0.073531030496 6.27506401064
> Projection myfwhm  min  took : 20.67 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 22.12 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 22.03 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
Area is  5347.854524635094  sq. deg.
Area with fwhm above  1.3 is 23.1953224213633  sq. deg.
Corresponding to  7075 of  1631194  pixels
Within the plot, min  minfwhm =  0.3302  and max  minfwhm  =  37.9874
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_MzLS_DR81024.png
Out[4]:

In [5]:
fig = Image(filename=(fname1))
fig


Out[5]:

In [6]:
verbose=False
sample=mysample('MZLS','DR8','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=3,Nexpmax=500,depthmin=22.5)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.14139998  1.12059999  1.19859993  1.1882      1.19340003  1.13099992
  1.2349999   1.13099992  1.53139997  1.41179991  1.61459994  1.45340002
  1.09979999  1.09979999  1.10500002  1.08420002  1.08420002  1.05299997
  1.12059999  1.0582      1.20899999  1.20899999  1.20379996  1.19340003
  2.30619979]
kaka1 0.073531030496 2051 2092
careful 2247 41 0.0710563790783 6.27778075097 0.073531030496 6.27506401064
> Projection myfwhm  min  took : 22.21 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 21.18 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 21.37 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
Area is  5063.330700417707  sq. deg.
Area with fwhm above  1.3 is 7.478237518463561  sq. deg.
Corresponding to  2281 of  1544409  pixels
Within the plot, min  minfwhm =  0.3302  and max  minfwhm  =  2.015
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_MzLS_DR81024.png
Out[6]:

In [3]:
verbose=False
sample = mysample('MZLS','DR8','z',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1466: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/tbdata['CCDNPHOTOM']
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1466: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/tbdata['CCDNPHOTOM']
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1467: RuntimeWarning: divide by zero encountered in true_divide
  zptivar = 1./zptvar
WARNING: (MARCM:) Current ccd image may have wrong corner assignments in quicksip
> Projection zptvar  min  took : 44.33 sec for 1627702 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 0.488705715716
Number of pixels is  1627702
Area is  5336.406034755885  sq. deg.
Number of udegrade pixels with  photometric-pixels  >  0.02  for all subpixels = 0
nside of udgraded pixels is :  64
Out[3]:

In [6]:
verbose=False
sample = mysample('MZLS','DR8','z',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
kaka1 0.073531030496 2051 2092
careful 2247 41 0.0710563790783 6.27778075097 0.073531030496 6.27506401064
> Projection zptvar  min  took : 23.09 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 22.48 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 0.488705715716
Number of pixels is  1632991
Area is  5353.74597260558  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_z_MzLS_DR81024.png
inside 1.4079683973 6.13745713233
inside 1.51542950177 2.59702947389
inside 1.51542950177 2.61083530098
Number of udegrade pixels with  photometric-pixels  >  0.02  for all subpixels = 0
nside of udgraded pixels is :  64
Out[6]:

In [5]:
verbose=False
sample = mysample('DECaLS','DR8','z',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 93.13 sec for 4751041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 90.39 sec for 4751041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 inf
Number of pixels is  4751041
Area is  15576.244216553545  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_z_DECaLS_DR81024.png
inside 1.63398941893 0.63813600776
inside 2.04764803747 0.908116626428
inside 2.23347955914 5.90275807178
inside 2.26018775828 0.454058313214
inside 2.26018775828 0.47860200582
inside 2.26018775828 5.90275807178
inside 2.27376364121 0.466330159517
inside 2.27376364121 5.91502991809
inside 2.30139736182 0.318612158172
inside 2.31534843738 0.34863255118
inside 2.62640087736 5.26179896323
inside 2.65274206256 0.0815157896113
Number of udegrade pixels with  photometric-pixels  >  0.02  for all subpixels = 0
nside of udgraded pixels is :  64
Out[5]:

In [5]:
verbose=False
sample = mysample('DECaLS','DR8','g',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1466: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/tbdata['CCDNPHOTOM']
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1466: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/tbdata['CCDNPHOTOM']
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1467: RuntimeWarning: divide by zero encountered in true_divide
  zptivar = 1./zptvar
WARNING: (MARCM:) Current ccd image may have wrong corner assignments in quicksip
WARNING: (MARCM:) Current ccd image may have wrong corner assignments in quicksip
WARNING: (MARCM:) Current ccd image may have wrong corner assignments in quicksip
WARNING: (MARCM:) Current ccd image may have wrong corner assignments in quicksip
WARNING: (MARCM:) Current ccd image may have wrong corner assignments in quicksip
> Projection zptvar  min  took : 168.72 sec for 4671533 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 1.79189518404
Number of pixels is  4671533
Area is  15315.577969899445  sq. deg.
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 0
nside of udgraded pixels is :  64
Out[5]:

In [7]:
verbose=False
sample = mysample('BASS','DR8','g',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 23.34 sec for 1696337 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_g_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 22.41 sec for 1696337 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_g_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1541: RuntimeWarning: invalid value encountered in sqrt
  aux = 1.086 * np.sqrt(val[i])
Min and Max values of  min-zpt-rms-flux  values is  0.0 0.170477877349
Number of pixels is  1696337
Area is  5561.425250924121  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_g_BASS_DR81024.png
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1594: RuntimeWarning: invalid value encountered in sqrt
  dF= 1.086 * (np.sqrt(val[i]))   # 1.086 converts d(magnitudes) into d(flux)
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 0
nside of udgraded pixels is :  64
Out[7]:

In [4]:
verbose=False
sample = mysample('DECaLS','DR8','r',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 113.58 sec for 4746068 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_r_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 109.43 sec for 4746068 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_r_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 2.89802511978
Number of pixels is  4746068
Area is  15559.940281797157  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_r_DECaLS_DR81024.png
inside 1.14674278915 5.6473502706
inside 1.15814264695 5.63814638587
inside 1.1645300397 5.64504929942
inside 1.431018697 0.787699134579
inside 1.43430521214 0.797670009701
inside 1.43430521214 0.799203990488
inside 1.4356194009 0.797670009701
inside 1.44481228013 0.811475836792
inside 1.44612465687 0.809941856004
inside 1.49846765448 3.52201988899
inside 1.57144736851 0.711767085579
inside 1.60270278176 0.724038931882
inside 1.83492443071 0.0859029241216
inside 1.83492443071 6.12365130524
inside 1.83492443071 6.14819499785
inside 1.83492443071 6.27091346088
inside 1.838973242 5.799981359
inside 1.8403238439 5.7616318393
inside 1.8457313229 5.76776776245
inside 1.8457313229 5.79231145506
inside 1.8457313229 5.84139884027
inside 1.84776124674 5.81915611884
inside 1.85114706283 5.72941824275
inside 1.85114706283 5.74015610827
inside 1.85114706283 5.90889399494
inside 1.85385809228 5.72635028118
inside 1.85657126124 5.73095222354
inside 1.85657126124 5.85367068657
inside 1.85724989071 5.926534774
inside 1.85996576937 5.75166096418
inside 1.86676513015 5.71791338684
inside 1.86744583654 5.71868037724
inside 1.86744583654 5.74322406984
inside 1.86744583654 5.76776776245
inside 1.86744583654 5.79231145506
inside 1.86744583654 5.91502991809
inside 1.87630805892 5.92960273557
inside 1.87835668171 5.73095222354
inside 1.87835668171 5.78003960875
inside 1.87835668171 5.90275807178
inside 1.87835668171 5.92730176439
inside 1.88451059884 0.166436915486
inside 1.88930547441 0.171805848243
inside 1.89136273691 5.98636002472
inside 1.89548149205 5.68723377109
inside 1.89823049972 0.157233030758
inside 1.90029393999 0.15953400194
inside 1.90029393999 5.9763891496
inside 1.90373625086 5.99709789024
inside 1.91132385458 0.171805848243
inside 1.91132385458 5.66959299203
inside 1.91132385458 5.9641173033
inside 1.91201464196 5.98789400551
inside 2.07942407988 2.44133042392
inside 2.07942407988 2.44593236628
inside 2.08240816301 2.43826246234
inside 2.0831549643 2.44209741431
inside 2.08539725437 2.46434013574
inside 2.09364350723 2.42829158722
inside 2.09514702384 2.42982556801
inside 2.09514702384 2.45436926062
inside 2.10722284408 2.44209741431
inside 2.14398959483 0.417242774305
inside 2.15643816281 0.871301087519
inside 2.16899038054 0.859029241216
inside 2.18165091009 0.822213702307
inside 2.18165091009 0.99401955055
inside 2.19442468872 0.83448554861
inside 2.19442468872 0.981747704247
inside 2.23347955914 0.920388472731
inside 2.24676213926 0.908116626428
inside 2.26018775828 0.920388472731
inside 2.63958258979 0.644202987955
inside 2.65274206256 0.61977878133
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 32.0
nside of udgraded pixels is :  64
Out[4]:

In [8]:
verbose=False
sample = mysample('BASS','DR8','r',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 23.81 sec for 1706597 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_r_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 23.28 sec for 1706597 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_r_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1541: RuntimeWarning: invalid value encountered in sqrt
  aux = 1.086 * np.sqrt(val[i])
Min and Max values of  min-zpt-rms-flux  values is  0.0 0.0673543269262
Number of pixels is  1706597
Area is  5595.0625665486  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_r_BASS_DR81024.png
inside 0.723748705838 1.61236582418
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1594: RuntimeWarning: invalid value encountered in sqrt
  dF= 1.086 * (np.sqrt(val[i]))   # 1.086 converts d(magnitudes) into d(flux)
inside 1.05993097886 2.54027218474
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 0
nside of udgraded pixels is :  64
Out[8]:

DR8 seeing


In [ ]:
verbose=True
sample= mysample('BASS','DR8','g',localdir,verbose)
fname1, fname2 = val3p4c_seeing(sample)
print 'For pass >=3'
fig = Image(filename=(fname1))
fig

REPEAT


In [4]:
verbose=False
sample = mysample('MZLS','DR8','z',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
kaka1 0.073531030496 2051 2092
careful 2247 41 0.0710563790783 6.27778075097 0.073531030496 6.27506401064
> Projection zptvar  min  took : 23.17 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 23.92 sec for 1632991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MzLS_DR8/nside1024_oversamp1/MzLS_DR8_band_z_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 0.488705715716
Number of pixels is  1632991
Area is  5353.74597260558  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_z_MzLS_DR81024.png
inside 1.4079683973 6.13745713233
inside 1.51542950177 2.59702947389
inside 1.51542950177 2.61083530098
Number of udegrade pixels with  photometric-pixels  >  0.02  for all subpixels = 0
nside of udgraded pixels is :  64
Out[4]:

In [5]:
verbose=False
sample = mysample('DECaLS','DR8','z',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 100.30 sec for 4751041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 108.18 sec for 4751041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 inf
Number of pixels is  4751041
Area is  15576.244216553545  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_z_DECaLS_DR81024.png
inside 1.63398941893 0.63813600776
inside 2.04764803747 0.908116626428
inside 2.23347955914 5.90275807178
inside 2.26018775828 0.454058313214
inside 2.26018775828 0.47860200582
inside 2.26018775828 5.90275807178
inside 2.27376364121 0.466330159517
inside 2.27376364121 5.91502991809
inside 2.30139736182 0.318612158172
inside 2.31534843738 0.34863255118
inside 2.62640087736 5.26179896323
inside 2.65274206256 0.0815157896113
Number of udegrade pixels with  photometric-pixels  >  0.02  for all subpixels = 0
nside of udgraded pixels is :  64
Out[5]:

In [6]:
verbose=False
sample = mysample('BASS','DR8','r',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 24.73 sec for 1706597 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_r_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 24.77 sec for 1706597 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_r_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1541: RuntimeWarning: invalid value encountered in sqrt
  aux = 1.086 * np.sqrt(val[i])
Min and Max values of  min-zpt-rms-flux  values is  0.0 0.0673543269262
Number of pixels is  1706597
Area is  5595.0625665486  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_r_BASS_DR81024.png
inside 0.723748705838 1.61236582418
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1594: RuntimeWarning: invalid value encountered in sqrt
  dF= 1.086 * (np.sqrt(val[i]))   # 1.086 converts d(magnitudes) into d(flux)
inside 1.05993097886 2.54027218474
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 0
nside of udgraded pixels is :  64
Out[6]:

In [7]:
verbose=False
sample = mysample('DECaLS','DR8','r',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 98.73 sec for 4746068 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_r_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 96.97 sec for 4746068 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_r_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 2.89802511978
Number of pixels is  4746068
Area is  15559.940281797157  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_r_DECaLS_DR81024.png
inside 1.14674278915 5.6473502706
inside 1.15814264695 5.63814638587
inside 1.1645300397 5.64504929942
inside 1.431018697 0.787699134579
inside 1.43430521214 0.797670009701
inside 1.43430521214 0.799203990488
inside 1.4356194009 0.797670009701
inside 1.44481228013 0.811475836792
inside 1.44612465687 0.809941856004
inside 1.49846765448 3.52201988899
inside 1.57144736851 0.711767085579
inside 1.60270278176 0.724038931882
inside 1.83492443071 0.0859029241216
inside 1.83492443071 6.12365130524
inside 1.83492443071 6.14819499785
inside 1.83492443071 6.27091346088
inside 1.838973242 5.799981359
inside 1.8403238439 5.7616318393
inside 1.8457313229 5.76776776245
inside 1.8457313229 5.79231145506
inside 1.8457313229 5.84139884027
inside 1.84776124674 5.81915611884
inside 1.85114706283 5.72941824275
inside 1.85114706283 5.74015610827
inside 1.85114706283 5.90889399494
inside 1.85385809228 5.72635028118
inside 1.85657126124 5.73095222354
inside 1.85657126124 5.85367068657
inside 1.85724989071 5.926534774
inside 1.85996576937 5.75166096418
inside 1.86676513015 5.71791338684
inside 1.86744583654 5.71868037724
inside 1.86744583654 5.74322406984
inside 1.86744583654 5.76776776245
inside 1.86744583654 5.79231145506
inside 1.86744583654 5.91502991809
inside 1.87630805892 5.92960273557
inside 1.87835668171 5.73095222354
inside 1.87835668171 5.78003960875
inside 1.87835668171 5.90275807178
inside 1.87835668171 5.92730176439
inside 1.88451059884 0.166436915486
inside 1.88930547441 0.171805848243
inside 1.89136273691 5.98636002472
inside 1.89548149205 5.68723377109
inside 1.89823049972 0.157233030758
inside 1.90029393999 0.15953400194
inside 1.90029393999 5.9763891496
inside 1.90373625086 5.99709789024
inside 1.91132385458 0.171805848243
inside 1.91132385458 5.66959299203
inside 1.91132385458 5.9641173033
inside 1.91201464196 5.98789400551
inside 2.07942407988 2.44133042392
inside 2.07942407988 2.44593236628
inside 2.08240816301 2.43826246234
inside 2.0831549643 2.44209741431
inside 2.08539725437 2.46434013574
inside 2.09364350723 2.42829158722
inside 2.09514702384 2.42982556801
inside 2.09514702384 2.45436926062
inside 2.10722284408 2.44209741431
inside 2.14398959483 0.417242774305
inside 2.15643816281 0.871301087519
inside 2.16899038054 0.859029241216
inside 2.18165091009 0.822213702307
inside 2.18165091009 0.99401955055
inside 2.19442468872 0.83448554861
inside 2.19442468872 0.981747704247
inside 2.23347955914 0.920388472731
inside 2.24676213926 0.908116626428
inside 2.26018775828 0.920388472731
inside 2.63958258979 0.644202987955
inside 2.65274206256 0.61977878133
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 32.0
nside of udgraded pixels is :  64
Out[7]:

In [8]:
verbose=False
sample = mysample('BASS','DR8','g',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 23.10 sec for 1696337 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_g_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 22.45 sec for 1696337 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR8/nside1024_oversamp1/BASS_DR8_band_g_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1541: RuntimeWarning: invalid value encountered in sqrt
  aux = 1.086 * np.sqrt(val[i])
Min and Max values of  min-zpt-rms-flux  values is  0.0 0.170477877349
Number of pixels is  1696337
Area is  5561.425250924121  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_g_BASS_DR81024.png
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1594: RuntimeWarning: invalid value encountered in sqrt
  dF= 1.086 * (np.sqrt(val[i]))   # 1.086 converts d(magnitudes) into d(flux)
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 0
nside of udgraded pixels is :  64
Out[8]:

In [ ]:
verbose=False
sample = mysample('DECaLS','DR8','g',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: divide by zero encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
/global/u1/m/manera/DESI/legacypipe/validationtests/desi_image_validation4.py:1486: RuntimeWarning: invalid value encountered in true_divide
  zptvar = tbdata['CCDPHRMS']**2/(tbdata['CCDNPHOTOM'])
> Projection zptvar  min  took : 102.44 sec for 4696321 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_zptvar__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection nccd  total  took : 99.17 sec for 4696321 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_nccd__total.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.0 1.79189518404
Number of pixels is  4696321
Area is  15396.845199889658  sq. deg.
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/min-zpt-rms-flux_g_DECaLS_DR81024.png

PAST DR8

Pixel maps


In [4]:
verbose=False
sample=mysample('DECaLS','DR8b','z',localdir,verbose)
fname0,fname1,fname2=maps_fwhm(sample,minfwhm=1.3,Nexpmin=3,Nexpmax=500)
print(fname0,fname1,fname2)


> Projection myfwhm  min  took : 7.53 sec for 191416 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection myfwhm  max  took : 8.32 sec for 191416 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__max.fits
> Projection myfwhm  mean  took : 12.84 sec for 191416 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__mean.fits
/global/homes/m/manera/DESI/validation-outputs/DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__min.fits.gz /global/homes/m/manera/DESI/validation-outputs/DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__max.fits.gz /global/homes/m/manera/DESI/validation-outputs/DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__mean.fits.gz

Minseeing DR8b


In [3]:
verbose=False
sample=mysample('DECaLS','DR8b','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=3,Nexpmax=500)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.52412677  1.50143397  1.47681952  1.43955255  1.41005194  1.3878181
  1.42735362  1.39269447  1.35594809  1.33838725  1.33940637  1.42617452
  1.35803926  1.3476212   1.3493849   1.31116629  1.31183898  1.41314566
  1.33526945  1.32707572  1.33616316  1.2934823   1.29591441  1.43465233
  1.34739292]
> Projection myfwhm  min  took : 7.13 sec for 191936 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 7.62 sec for 191936 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 7.50 sec for 191936 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
Area is  480.8824737979825  sq. deg.
Area with fwhm above  1.3 is 1.0032181852914728  sq. deg.
Corresponding to  306 of  146678  pixels
Within the plot, min  minfwhm =  0.561415  and max  minfwhm  =  1.6525
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_DECaLS_DR81024.png
Out[3]:

In [5]:
fig = Image(filename=(fname1))
fig


Out[5]:

In [4]:
verbose=False
sample=mysample('DECaLS','DR8b','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=3,Nexpmax=500)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.52412677  1.50143397  1.47681952  1.43955255  1.41005194  1.3878181
  1.42735362  1.39269447  1.35594809  1.33838725  1.33940637  1.42617452
  1.35803926  1.3476212   1.3493849   1.31116629  1.31183898  1.41314566
  1.33526945  1.32707572  1.33616316  1.2934823   1.29591441  1.43465233
  1.34739292]
> Projection myfwhm  min  took : 6.22 sec for 191416 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 6.97 sec for 191416 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 6.88 sec for 191416 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
Area is  472.1813592105199  sq. deg.
Area with fwhm above  1.3 is 0.8753570440288342  sq. deg.
Corresponding to  267 of  144024  pixels
Within the plot, min  minfwhm =  0.64933  and max  minfwhm  =  1.70633
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_DECaLS_DR81024.png
Out[4]:

In [5]:
fig = Image(filename=(fname1))
fig


Out[5]:

depth maps


In [5]:
verbose=False
sample=mysample('DECaLS','DR8b','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 5.15 sec for 190861 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 5.72 sec for 190861 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_g_nside1024_oversamp1_hits__total.fits
Area is  101.79713938987004  sq. deg.
0 of  31050  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  23.15137659427011  and max  depth  =  24.992683481816044
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR81024.png
Total pixels 31050 probably too many for exact mean and std
Mean =  24.2340251551 ; Median =  24.2609032561 ; Std =  0.14938584675759137
Results for 90% 95% and 98% are:  24.0727587158 23.9779156818 23.7736478001
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.11613493  0.12530208  0.16491308  0.15943722  0.11471152
  0.08625937  0.06074431  0.04162927  0.02907888  0.01997546  0.0138357
  0.01025064  0.00754723  0.00634159  0.0044986   0.0060221   0.00208514
  0.00262374  0.00251751  0.00265561  0.00235287  0.00174739  0.0015615
  0.00107286  0.00073295  0.00023284]
Out[5]:

In [6]:
from quicksipManera3 import *
import fitsio

In [7]:
nside = 512       # Resolution of output maps
    nsideSTR='512'    # same as nside but in string format
    nsidesout = None   # if you want full sky degraded maps to be written
    ratiores = 1       # Superresolution/oversampling ratio, simp mode doesn't allow anything other than 1
    mode = 1           # 1: fully sequential, 2: parallel then sequential, 3: fully parallel
    pixoffset = 0      # How many pixels are being removed on the edge of each CCD? 15 for DES.
    oversamp='1'       # ratiores in string format

In [10]:
nside = 1024       # Resolution of output maps
    nsideSTR='1024'    # same as nside but in string format
    nsidesout = None   # if you want full sky degraded maps to be written
    ratiores = 1       # Superresolution/oversampling ratio, simp mode doesn't allow anything other than 1
    mode = 1           # 1: fully sequential, 2: parallel then sequential, 3: fully parallel
    pixoffset = 0      # How many pixels are being removed on the edge of each CCD? 15 for DES.
    oversamp='1'       # ratiores in string format
    
    band = sample.band
    catalogue_name = sample.catalog
    fname = sample.ccds    
    localdir = sample.localdir
    extc = sample.extc

In [12]:
#Read ccd file 
    tbdata = pyfits.open(fname)[1].data
    
    # ------------------------------------------------------
    # Obtain indices
    auxstr='band_'+band
    sample_names = [auxstr]
 
    if(sample.DR == 'DR7'):
        if(sample.survey == 'DECaLS'):
            inds = np.where((tbdata['filter'] == band)) 
        elif(sample.survey == 'DEShyb'):
            inds = np.where((tbdata['filter'] == band) & (list(map(InDEShybFootprint,tbdata['ra'],tbdata['dec']))))
        elif(sample.survey == 'NGCproxy'):
            inds = np.where((tbdata['filter'] == band) & (list(map(InNGCproxyFootprint,tbdata['ra'])))) 
    elif(sample.DR == 'DR8b'):
        if(sample.survey == 'DECaLS'):
            inds = np.where((tbdata['filter'] == band)) 
        elif(sample.survey == 'DEShyb'):
            inds = np.where((tbdata['filter'] == band) & (list(map(InDEShybFootprint,tbdata['ra'],tbdata['dec']))))
        elif(sample.survey == 'NGCproxy'):
            inds = np.where((tbdata['filter'] == band) & (list(map(InNGCproxyFootprint,tbdata['ra']))))

In [14]:
#Read data 
    #obtain invnoisesq here, including extinction 
    nmag = Magtonanomaggies(tbdata['galdepth']-extc*tbdata['EBV'])/5.
    ivar= 1./nmag**2.

    hits=np.ones(np.shape(ivar)) 

    # What properties do you want mapped?
    # Each each tuple has [(quantity to be projected, weighting scheme, operation),(etc..)] 
    propertiesandoperations = [ ('ivar', '', 'total'), ('hits','','total') ]

 
    # What properties to keep when reading the images? 
    # Should at least contain propertiesandoperations and the image corners.
    # MARCM - actually no need for ra dec image corners.   
    # Only needs ra0 ra1 ra2 ra3 dec0 dec1 dec2 dec3 only if fast track appropriate quicksip subroutines were implemented 
    #propertiesToKeep = [ 'filter', 'FWHM','mjd_obs'] \
    # 	+ ['RA', 'DEC', 'crval1', 'crval2', 'crpix1', 'crpix2', 'cd1_1', 'cd1_2', 'cd2_1', 'cd2_2','width','height']
    propertiesToKeep = [ 'filter', 'FWHM','mjd_obs'] \
    	+ ['RA', 'DEC', 'ra0','ra1','ra2','ra3','dec0','dec1','dec2','dec3']
    
    # Create big table with all relevant properties. 

    tbdata = np.core.records.fromarrays([tbdata[prop] for prop in propertiesToKeep] + [ivar] + [hits], names = propertiesToKeep + [ 'ivar', 'hits'])
    
    # Read the table, create Healtree, project it into healpix maps, and write these maps.
    # Done with Quicksip library, note it has quite a few hardcoded values (use new version by MARCM for BASS and MzLS) 
    # project_and_write_maps_simp(mode, propertiesandoperations, tbdata, catalogue_name, outroot, sample_names, inds, nside)
    #project_and_write_maps(mode, propertiesandoperations, tbdata, catalogue_name, localdir, sample_names, inds, nside, ratiores, pixoffset, nsidesout)
    project_and_write_maps_simp(mode, propertiesandoperations, tbdata, catalogue_name, localdir, sample_names, inds, nside)
 
    # Read Haelpix maps from quicksip  
    prop='ivar'
    op='total'
    vmin=21.0
    vmax=24.0

    fname2=localdir+catalogue_name+'/nside'+nsideSTR+'_oversamp'+oversamp+'/'+\
    catalogue_name+'_band_'+band+'_nside'+nsideSTR+'_oversamp'+oversamp+'_'+prop+'__'+op+'.fits.gz'
    f = fitsio.read(fname2)


> Projection ivar  total  took : 8.56 sec for 191936 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 7.87 sec for 191936 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_hits__total.fits

In [16]:
print(fname2)


/global/homes/m/manera/DESI/validation-outputs/DECaLS_DR8/nside1024_oversamp1/DECaLS_DR8_band_z_nside1024_oversamp1_ivar__total.fits.gz

In [ ]:
# HEALPIX DEPTH MAPS 
    # convert ivar to depth 
    import healpy as hp
    from healpix3 import pix2ang_ring,thphi2radec

    ral = []
    decl = []
    val = f['SIGNAL']
    pix = f['PIXEL']

    #get hits
    prop = 'hits'
    op = 'total'
    fname2=localdir+catalogue_name+'/nside'+nsideSTR+'_oversamp'+oversamp+'/'+\
    catalogue_name+'_band_'+band+'_nside'+nsideSTR+'_oversamp'+oversamp+'_'+prop+'__'+op+'.fits.gz'
    f = fitsio.read(fname2)
    hitsb=f['SIGNAL']
 
    # Obtain values to plot 
    #if (prop == 'ivar'):
    myval = []
    mylabel='depth' 
            
    below=0 
    for i in range(0,len(val)):
       depth=nanomaggiesToMag(sqrt(1./val[i]) * 5.)
       npases=hitsb[i]
       if(npases >= Nexpmin and npases <= Nexpmax ):
           myval.append(depth)
           th,phi = hp.pix2ang(int(nside),pix[i])
           ra,dec = thphi2radec(th,phi)
           ral.append(ra)
           decl.append(dec)
           if(depth < vmin):
              below=below+1

    npix=len(myval)

    print('Area is ', npix/(float(nside)**2.*12)*360*360./pi, ' sq. deg.')
    print(below, 'of ', npix, ' pixels are not plotted as their ', mylabel,' < ', vmin)
    print('Within the plot, min ', mylabel, '= ', min(myval), ' and max ', mylabel, ' = ', max(myval))

In [ ]:
# Plot depth 
    #from matplotlib import pyplot as plt
    #import matplotlib.cm as cm

    #ralB = [ ra-360 if ra > 300 else ra for ra in ral ]
    #vmax = sample.recm
    #vmin = vmax - 2.0
      
    #mapa = plt.scatter(ralB,decl,c=myval, cmap=cm.rainbow,s=2., vmin=vmin, vmax=vmax, lw=0,edgecolors='none')
    #mapa = plt.scatter(ralB,decl,c=myval, cmap=cm.gnuplot,s=2., vmin=vmin, vmax=vmax, lw=0,edgecolors='none')
    #mapa.cmap.set_over('yellowgreen')
    #cbar = plt.colorbar(mapa,extend='both')
    #plt.xlabel('r.a. (degrees)')
    #plt.ylabel('declination (degrees)')
    #plt.title('Map of '+ mylabel +' for '+catalogue_name+' '+band+'-band \n with 3 or more exposures')
    #plt.xlim(-60,300)
    #plt.ylim(-30,90)
    #mapfile=localdir+mylabel+'_'+band+'_'+catalogue_name+str(nside)+'.png'
    #print 'saving plot to ', mapfile
    #plt.savefig(mapfile)
    #plt.close()
    #plt.show()
    #cbar.set_label(r'5$\sigma$ galaxy depth', rotation=270,labelpad=1)
    #plt.xscale('log')
    mapfile=localdir+mylabel+'_'+band+'_'+catalogue_name+str(nside)+'.png'
    mytitle='Map of '+ mylabel +' for '+catalogue_name+' '+band+'-band \n with '+str(Nexpmin)+\
           ' or more exposures'
    plot_magdepth2D(sample,ral,decl,myval,mapfile,mytitle)


    # Statistics depths

    deptharr=np.array(myval)
    p90=np.percentile(deptharr,10)
    p95=np.percentile(deptharr,5)
    p98=np.percentile(deptharr,2)
    med=np.percentile(deptharr,50)
    mean = sum(deptharr)/float(np.size(deptharr))  # 1M array, too long for precision
    std = sqrt(sum(deptharr**2.)/float(len(deptharr))-mean**2.)

   

    ndrawn=np.size(deptharr)
    print("Total pixels", np.size(deptharr), "probably too many for exact mean and std")
    print("Mean = ", mean, "; Median = ", med ,"; Std = ", std)
    print("Results for 90% 95% and 98% are: ", p90, p95, p98)

    # Statistics pases
    #prop = 'hits'
    #op = 'total'
    #fname2=localdir+catalogue_name+'/nside'+nsideSTR+'_oversamp'+oversamp+'/'+\
    #catalogue_name+'_band_'+band+'_nside'+nsideSTR+'_oversamp'+oversamp+'_'+prop+'__'+op+'.fits.gz'
    #f = fitsio.read(fname2)
    
    #hitsb=f['SIGNAL']
    hist, bin_edges =np.histogram(hitsb,bins=[-0.5,0.5,1.5,2.5,3.5,4.5,5.5,6.5,7.5,8.5,9.5,10.5, 11.5,12.5, 13.5, 14.5, 15.5, 16.15,17.5,18.5,19.5,20.5,21.5,22.5,23.5,24.5,25.5,100],density=True)
    #print hitsb[1000:10015]
    #hist, bin_edges =np.histogram(hitsb,density=True)
    print("Percentage of hits for 0,1,2., to >7 pases\n", end=' ') 
    #print bin_edges 
    print(hist)
    #print 100*hist

    return mapfile

----------------------------------------------------------

--------------------- OLD OLD -------------------------

----------------------------------------------------------

Temporal averages


In [6]:
import numpy

def smooth(x,window_len=11,window='hanning'):
    """smooth the data using a window with requested size.
    
    This method is based on the convolution of a scaled window with the signal.
    The signal is prepared by introducing reflected copies of the signal 
    (with the window size) in both ends so that transient parts are minimized
    in the begining and end part of the output signal.
    
    input:
        x: the input signal 
        window_len: the dimension of the smoothing window; should be an odd integer
        window: the type of window from 'flat', 'hanning', 'hamming', 'bartlett', 'blackman'
            flat window will produce a moving average smoothing.

    output:
        the smoothed signal
        
    example:

    t=linspace(-2,2,0.1)
    x=sin(t)+randn(len(t))*0.1
    y=smooth(x)
    
    see also: 
    
    numpy.hanning, numpy.hamming, numpy.bartlett, numpy.blackman, numpy.convolve
    scipy.signal.lfilter
 
    TODO: the window parameter could be the window itself if an array instead of a string
    NOTE: length(output) != length(input), to correct this: return y[(window_len/2-1):-(window_len/2)] instead of just y.
    """

    if x.ndim != 1:
        raise ValueError, "smooth only accepts 1 dimension arrays."

    if x.size < window_len:
        raise ValueError, "Input vector needs to be bigger than window size."


    if window_len<3:
        return x


    if not window in ['flat', 'hanning', 'hamming', 'bartlett', 'blackman']:
        raise ValueError, "Window is on of 'flat', 'hanning', 'hamming', 'bartlett', 'blackman'"


    s=numpy.r_[x[window_len-1:0:-1],x,x[-2:-window_len-1:-1]]
    #print(len(s))
    if window == 'flat': #moving average
        w=numpy.ones(window_len,'d')
    else:
        w=eval('numpy.'+window+'(window_len)')

    y=numpy.convolve(w/w.sum(),s,mode='valid')
    return y




from numpy import *
from pylab import *

def smooth_demo():

    t=linspace(-4,4,100)
    x=sin(t)
    xn=x+randn(len(t))*0.1
    y=smooth(x)

    ws=31

    subplot(211)
    plot(ones(ws))

    windows=['flat', 'hanning', 'hamming', 'bartlett', 'blackman']

    hold(True)
    for w in windows[1:]:
        eval('plot('+w+'(ws) )')

    axis([0,30,0,1.1])

    legend(windows)
    title("The smoothing windows")
    subplot(212)
    plot(x)
    plot(xn)
    for w in windows:
        plot(smooth(xn,10,w))
    l=['original signal', 'signal with noise']
    l.extend(windows)

    legend(l)
    title("Smoothing a noisy signal")
    show()


if __name__=='__main__':
    smooth_demo()


/global/common/cori/contrib/desi/code/desiconda/20170414-1.1.2-imaging_conda/lib/python2.7/site-packages/ipykernel_launcher.py:80: MatplotlibDeprecationWarning: pyplot.hold is deprecated.
    Future behavior will be consistent with the long-time default:
    plot commands add elements without first clearing the
    Axes and/or Figure.
/global/common/cori/contrib/desi/code/desiconda/20170414-1.1.2-imaging_conda/lib/python2.7/site-packages/matplotlib/__init__.py:917: UserWarning: axes.hold is deprecated. Please remove it from your matplotlibrc and/or style files.
  warnings.warn(self.msg_depr_set % key)
/global/common/cori/contrib/desi/code/desiconda/20170414-1.1.2-imaging_conda/lib/python2.7/site-packages/matplotlib/rcsetup.py:152: UserWarning: axes.hold is deprecated, will be removed in 3.0
  warnings.warn("axes.hold is deprecated, will be removed in 3.0")

In [9]:
verbose=False
sample=mysample('BASS','DR6','g',localdir,verbose)
print sample.ccds
hdul=fits.open(sample.ccds)
myheader=hdul[1].header
mydata=hdul[1].data
hdul.close()

galdepth=mydata['galdepth']
mjdobs=mydata['mjd_obs']
mjddepth=galdepth[mjdobs.argsort()]   # depth sorted by modified julian date
depthsmooth=smooth(mjddepth,window_len=401,window='flat')  #remove window in output y[200,-200]

plt.scatter(mjdobs,depthsmooth[200:-200],s=0.05,c='green') 
plt.xlabel("MJD observed")
plt.ylabel("Average depth")
plt.title("g-band hanning mean depth \n (400 exposures window)")
plt.show()


/global/cscratch1/sd/dstn/dr6plus/ccds-annotated-90prime-g.fits.gz

In [10]:
verbose=False
sample=mysample('BASS','DR6','r',localdir,verbose)
print sample.ccds
hdul=fits.open(sample.ccds)
myheader=hdul[1].header
mydata=hdul[1].data
hdul.close()

galdepth=mydata['galdepth']
mjdobs=mydata['mjd_obs']
mjddepth=galdepth[mjdobs.argsort()]   # depth sorted by modified julian date
depthsmooth=smooth(mjddepth,window_len=401,window='flat')  #remove window in output y[200,-200]

plt.scatter(mjdobs,depthsmooth[200:-200],s=0.05,c='red') 
plt.xlabel("MJD observed")
plt.ylabel("Average depth")
plt.title("r-band hanning mean depth \n (400 exposures window)")
plt.show()


/global/cscratch1/sd/dstn/dr6plus/ccds-annotated-90prime-r.fits.gz

In [11]:
verbose=False
sample=mysample('MZLS','DR6','z',localdir,verbose)
print sample.ccds
hdul=fits.open(sample.ccds)
myheader=hdul[1].header
mydata=hdul[1].data
hdul.close()

galdepth=mydata['galdepth']
mjdobs=mydata['mjd_obs']
mjddepth=galdepth[mjdobs.argsort()]   # depth sorted by modified julian date
depthsmooth=smooth(mjddepth,window_len=401,window='flat')  #remove window in output y[200,-200]

plt.scatter(mjdobs,depthsmooth[200:-200],s=0.05,c='blue') 
plt.xlabel("MJD observed")
plt.ylabel("Average depth")
plt.title("z-band hanning mean depth \n (400 exposures window)")
plt.show()


/global/cscratch1/sd/dstn/dr6plus/ccds-annotated-mosaic-z.fits.gz

In [19]:
verbose=False
sample=mysample('BASS','DR6','g',localdir,verbose)
print sample.ccds
hdul=fits.open(sample.ccds)
myheader=hdul[1].header
mydata=hdul[1].data
hdul.close()

galdepth=mydata['galdepth']
mjdobs=mydata['mjd_obs']
mjddepth=galdepth[mjdobs.argsort()]   # depth sorted by modified julian date
depthsmooth=smooth(mjddepth,window_len=2001,window='hanning')  #remove window in output y[200,-200]

plt.scatter(mjdobs,depthsmooth[1000:-1000],s=0.05,c='green') 
plt.xlabel("MJD observed")
plt.ylabel("Average depth")
plt.title("g-band hanning mean depth \n (2000 exposures window)")
plt.show()


/global/cscratch1/sd/dstn/dr6plus/ccds-annotated-90prime-g.fits.gz

In [20]:
verbose=False
sample=mysample('BASS','DR6','r',localdir,verbose)
print sample.ccds
hdul=fits.open(sample.ccds)
myheader=hdul[1].header
mydata=hdul[1].data
hdul.close()

galdepth=mydata['galdepth']
mjdobs=mydata['mjd_obs']
mjddepth=galdepth[mjdobs.argsort()]   # depth sorted by modified julian date
depthsmooth=smooth(mjddepth,window_len=2001,window='hanning')  #remove window in output y[200,-200]

plt.scatter(mjdobs,depthsmooth[1000:-1000],s=0.05,c='red') 
plt.xlabel("MJD observed")
plt.ylabel("Average depth")
plt.title("r-band hanning mean depth \n (2000 exposures window)")
plt.show()


/global/cscratch1/sd/dstn/dr6plus/ccds-annotated-90prime-r.fits.gz

In [21]:
verbose=False
sample=mysample('MZLS','DR6','z',localdir,verbose)
print sample.ccds
hdul=fits.open(sample.ccds)
myheader=hdul[1].header
mydata=hdul[1].data
hdul.close()

galdepth=mydata['galdepth']
mjdobs=mydata['mjd_obs']
mjddepth=galdepth[mjdobs.argsort()]   # depth sorted by modified julian date
depthsmooth=smooth(mjddepth,window_len=2001,window='hanning')  #remove window in output y[200,-200]

plt.scatter(mjdobs,depthsmooth[1000:-1000],s=0.05,c='blue') 
plt.xlabel("MJD observed")
plt.ylabel("Average depth")
plt.title("z-band hanning mean depth \n (2000 exposures window)")
plt.show()


/global/cscratch1/sd/dstn/dr6plus/ccds-annotated-mosaic-z.fits.gz

Image Quality (Val 4.1)


In [3]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=3,Nexpmax=500)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.23419178  1.26395977  1.18252039  1.17553473  1.17538762  1.16822684
  1.16115642  1.14993489  1.17659056  1.14851499  1.17477083  1.15315819
  1.14407551  1.17817307  1.15981793  1.19421387  1.17604065  1.15403318
  1.14455092  1.14330423  1.18197548  1.18113172  1.20749581  1.16672933
  1.15267968]
> Projection myfwhm  min  took : 80.02 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 82.39 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 83.79 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_ivar__total.fits
Area is  9029.80623975927  sq. deg.
Area with fwhm above  1.3 is 589.3283925335098  sq. deg.
Corresponding to  179756 of  2754257  pixels
Within the plot, min  minfwhm =  0.529213  and max  minfwhm  =  3.64586
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_DECaLS_DR71024.png
Out[3]:

In [6]:
fig = Image(filename=(fname1))
fig


Out[6]:

In [7]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=3,Nexpmax=500,depthmin=22.5)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.23419178  1.26395977  1.18252039  1.17553473  1.17538762  1.16822684
  1.16115642  1.14993489  1.17659056  1.14851499  1.17477083  1.15315819
  1.14407551  1.17817307  1.15981793  1.19421387  1.17604065  1.15403318
  1.14455092  1.14330423  1.18197548  1.18113172  1.20749581  1.16672933
  1.15267968]
> Projection myfwhm  min  took : 87.48 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 84.45 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 84.22 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_ivar__total.fits
Area is  9024.29509672177  sq. deg.
Area with fwhm above  1.3 is 584.4565552023231  sq. deg.
Corresponding to  178270 of  2752576  pixels
Within the plot, min  minfwhm =  0.529213  and max  minfwhm  =  3.64586
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_DECaLS_DR71024.png
Out[7]:

In [9]:
fig = Image(filename=(fname1))
fig


Out[9]:

In [3]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname1,fname2=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=3,Nexpmax=500,depthmin=22.5)
fig = Image(filename=(fname1))
fig
fig = Image(filename=(fname2))
fig


[ 1.23419178  1.26395977  1.18252039  1.17553473  1.17538762  1.16822684
  1.16115642  1.14993489  1.17659056  1.14851499  1.17477083  1.15315819
  1.14407551  1.17817307  1.15981793  1.19421387  1.17604065  1.15403318
  1.14455092  1.14330423  1.18197548  1.18113172  1.20749581  1.16672933
  1.15267968]
> Projection myfwhm  min  took : 82.29 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 83.47 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
> Projection ivar  total  took : 85.51 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_ivar__total.fits
Area is  9024.29509672177  sq. deg.
Area with fwhm above  1.3 is 584.4565552023231  sq. deg.
Corresponding to  178270 of  2752576  pixels
Within the plot, min  minfwhm =  0.529213  and max  minfwhm  =  3.64586
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_DECaLS_DR71024.png
Out[3]:

In [4]:
fig = Image(filename=(fname1))
fig


Out[4]:

In [3]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=1,Nexpmax=500)
fig = Image(filename=(fname))
fig


[ 1.23419178  1.26395977  1.18252039  1.17553473  1.17538762  1.16822684
  1.16115642  1.14993489  1.17659056  1.14851499  1.17477083  1.15315819
  1.14407551  1.17817307  1.15981793  1.19421387  1.17604065  1.15403318
  1.14455092  1.14330423  1.18197548  1.18113172  1.20749581  1.16672933
  1.15267968]
> Projection myfwhm  min  took : 67.08 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 70.88 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
Area is  10922.22981422556  sq. deg.
Area with fwhm above  1.3 is 1308.4128940129867  sq. deg.
Corresponding to  399090 of  3331481  pixels
Within the plot, min  minfwhm =  0.529213  and max  minfwhm  =  4.99071
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/minfwhm_z_DECaLS_DR71024.png
Out[3]:

In [ ]:
verbose=False
sample=mysample('DECaLS','DR7','r',localdir,verbose)
fname=val4p1_bandquality(sample,minfwhm=1.3,Nexpmin=1,Nexpmax=500)
fig = Image(filename=(fname))
fig


[ 1.23419178  1.26395977  1.18252039  1.17553473  1.17538762  1.16822684
  1.16115642  1.14993489  1.17659056  1.14851499  1.17477083  1.15315819
  1.14407551  1.17817307  1.15981793  1.19421387  1.17604065  1.15403318
  1.14455092  1.14330423  1.18197548  1.18113172  1.20749581  1.16672933
  1.15267968]
> Projection myfwhm  min  took : 69.98 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_myfwhm__min.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 70.18 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_hits__total.fits
Area is  10536.144901956019  sq. deg.
Area with fwhm above  1.3 is 2048.0141909289146  sq. deg.
Corresponding to  624682 of  3213718  pixels
Within the plot, min  minfwhm =  0.527932  and max  minfwhm  =  7.48209

Extinction corrected depth maps (Val 3.4c)

Visually explore the maps for depth patterns


In [4]:
verbose=False
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 51.27 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 52.27 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_hits__total.fits
Area is  2093.277034935889  sq. deg.
0 of  638488  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.354980915781123  and max  depth  =  43.334794023597425
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR71024.png
Total pixels 638488 probably too many for exact mean and std
Mean =  24.2533024672 ; Median =  24.2815868319 ; Std =  0.3666916210294647
Results for 90% 95% and 98% are:  24.0411512966 23.9430088828 23.7890534762
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.09804808  0.14823496  0.20733294  0.19860563  0.10990054
  0.05556302  0.03251795  0.024456    0.01998162  0.01592223  0.01199664
  0.00886791  0.00695788  0.00545213  0.00446497  0.0054284   0.002256
  0.00273548  0.0024744   0.00217923  0.00188048  0.00204512  0.00199771
  0.00196978  0.00163986  0.00037854]
Out[4]:

In [5]:
verbose=False
sample=mysample('DECaLS','DR7','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 54.56 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 54.82 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_hits__total.fits
Area is  2016.7636166080051  sq. deg.
701 of  615150  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  17.846756729412903  and max  depth  =  42.67914303303001
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_r_DECaLS_DR71024.png
Total pixels 615150 probably too many for exact mean and std
Mean =  23.7521070334 ; Median =  23.7669826125 ; Std =  0.5158006042445328
Results for 90% 95% and 98% are:  23.5536941952 23.4441230948 23.23269492
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.08958166  0.13417267  0.19177232  0.18441287  0.10976927
  0.06232078  0.04236075  0.03582649  0.02672343  0.01945749  0.01441745
  0.01276206  0.00858993  0.00672286  0.00579604  0.01480615  0.00318169
  0.00410542  0.00382578  0.00320883  0.00252454  0.00208529  0.00176575
  0.00189917  0.00143467  0.00027577]
Out[5]:

In [6]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 56.28 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 59.79 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
Area is  1850.5113480585587  sq. deg.
95 of  564440  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  18.234019205720443  and max  depth  =  42.276840209307736
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_z_DECaLS_DR71024.png
Total pixels 564440 probably too many for exact mean and std
Mean =  22.7686170013 ; Median =  22.7979842774 ; Std =  0.26625905801495386
Results for 90% 95% and 98% are:  22.5129633392 22.4075928923 22.2617573548
Percentage of hits for 0,1,2., to >7 pases
 [  0.00000000e+00   7.29212255e-02   1.00575196e-01   1.69661279e-01
   1.94909380e-01   1.36119781e-01   9.56678722e-02   7.10858634e-02
   5.18518340e-02   3.30638704e-02   2.07393509e-02   1.26088713e-02
   7.76346734e-03   4.89770547e-03   3.55590129e-03   2.94601763e-03
   3.86966409e-03   1.53252989e-03   1.74969581e-03   1.41664943e-03
   1.22427608e-03   1.01116246e-03   9.71184876e-04   9.27600287e-04
   7.95644186e-04   7.87227852e-04   1.09593908e-04]
Out[6]:

In [7]:
verbose=False
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 55.74 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 56.42 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_hits__total.fits
Area is  10121.40925857124  sq. deg.
4381 of  3087216  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  17.796938487618135  and max  depth  =  45.55135238004402
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR71024.png
Total pixels 3087216 probably too many for exact mean and std
Mean =  24.4032350914 ; Median =  24.3657430766 ; Std =  1.1143533142988178
Results for 90% 95% and 98% are:  23.7692784938 23.5778951575 23.332278762
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.09804808  0.14823496  0.20733294  0.19860563  0.10990054
  0.05556302  0.03251795  0.024456    0.01998162  0.01592223  0.01199664
  0.00886791  0.00695788  0.00545213  0.00446497  0.0054284   0.002256
  0.00273548  0.0024744   0.00217923  0.00188048  0.00204512  0.00199771
  0.00196978  0.00163986  0.00037854]
Out[7]:

In [3]:
verbose=False
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 43.39 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 45.29 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_hits__total.fits
Area is  10131.090641908384  sq. deg.
4381 of  3090169  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  17.796938487618135  and max  depth  =  45.55135238004402
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR71024.png
Total pixels 3090169 probably too many for exact mean and std
Mean =  24.4060662458 ; Median =  24.3660799386 ; Std =  1.1183774122357504
Results for 90% 95% and 98% are:  23.7694812606 23.5780836082 23.3325069726
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.09804808  0.14823496  0.20733294  0.19860563  0.10990054
  0.05556302  0.03251795  0.024456    0.01998162  0.01592223  0.01199664
  0.00886791  0.00695788  0.00545213  0.00446497  0.0054284   0.002256
  0.00273548  0.0024744   0.00217923  0.00188048  0.00204512  0.00199771
  0.00196978  0.00163986  0.00037854]
Out[3]:

In [3]:
verbose=False
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 58.01 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 61.88 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_hits__total.fits
Area is  10131.090641908384  sq. deg.
4381 of  3090169  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  17.796938487618135  and max  depth  =  45.55135238004402
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR71024.png
Total pixels 3090169 probably too many for exact mean and std
Mean =  24.4060662458 ; Median =  24.3660799386 ; Std =  1.1183774122357504
Results for 90% 95% and 98% are:  23.7694812606 23.5780836082 23.3325069726
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.09804808  0.14823496  0.20733294  0.19860563  0.10990054
  0.05556302  0.03251795  0.024456    0.00136985]
Out[3]:

In [4]:
verbose=False
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 60.81 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 66.33 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_hits__total.fits
Area is  7644.565192301444  sq. deg.
0 of  2331733  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.354980915781123  and max  depth  =  45.55135238004402
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR71024.png
Total pixels 2331733 probably too many for exact mean and std
Mean =  24.6072496378 ; Median =  24.4652754609 ; Std =  1.1894952727052077
Results for 90% 95% and 98% are:  24.1706069148 24.0692837317 23.9308835061
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.09804808  0.14823496  0.20733294  0.19860563  0.10990054
  0.05556302  0.03251795  0.024456    0.00136985]
Out[4]:

In [7]:
verbose=False
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 57.32 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 57.93 sec for 3090169 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_g_nside1024_oversamp1_hits__total.fits
Area is  10131.090641908384  sq. deg.
4381 of  3090169  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  17.796938487618135  and max  depth  =  45.55135238004402
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR71024.png
Total pixels 3090169 probably too many for exact mean and std
Mean =  24.4060662458 ; Median =  24.3660799386 ; Std =  1.1183774122357504
Results for 90% 95% and 98% are:  23.7694812606 23.5780836082 23.3325069726
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.09804808  0.14823496  0.20733294  0.19860563  0.10990054
  0.05556302  0.03251795  0.024456    0.00136985]
Out[7]:

In [4]:
verbose=False
sample=mysample('DECaLS','DR7','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 52.11 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 54.52 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_hits__total.fits
Area is  8183.4244974350295  sq. deg.
1977 of  2496095  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  0.7883345739397685  and max  depth  =  45.23453244863504
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_DECaLS_DR71024.png
Total pixels 2496095 probably too many for exact mean and std
Mean =  24.223322833 ; Median =  23.9886171654 ; Std =  1.432703200102813
Results for 90% 95% and 98% are:  23.6980596864 23.598090772 23.443336963
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.08958166  0.13417267  0.19177232  0.18441287  0.10976927
  0.06232078  0.04236075  0.03582649  0.00163697]
Out[4]:

In [18]:
verbose=False
sample=mysample('DECaLS','DR7','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 52.17 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 51.92 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_hits__total.fits
Area is  10536.525206889004  sq. deg.
34007 of  3213834  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  -4.677224179122472  and max  depth  =  45.23453244863504
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_r_DECaLS_DR71024.png
Total pixels 3213834 probably too many for exact mean and std
Mean =  23.9811672622 ; Median =  23.8989568769 ; Std =  1.4265287690916355
Results for 90% 95% and 98% are:  23.272977585 23.0817194864 22.2721719901
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.08958166  0.13417267  0.19177232  0.18441287  0.10976927
  0.06232078  0.04236075  0.03582649  0.02672343  0.01945749  0.01441745
  0.01276206  0.00858993  0.00672286  0.00579604  0.01480615  0.00318169
  0.00410542  0.00382578  0.00320883  0.00252454  0.00208529  0.00176575
  0.00189917  0.00143467  0.00027577]
Out[18]:

In [4]:
verbose=False
sample=mysample('DECaLS','DR7','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 57.84 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 60.27 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_hits__total.fits
Area is  10536.525206889004  sq. deg.
34007 of  3213834  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  -4.677224179122472  and max  depth  =  45.23453244863504
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_r_DECaLS_DR71024.png
Total pixels 3213834 probably too many for exact mean and std
Mean =  23.9811672622 ; Median =  23.8989568769 ; Std =  1.4265287690916355
Results for 90% 95% and 98% are:  23.272977585 23.0817194864 22.2721719901
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.08958166  0.13417267  0.19177232  0.18441287  0.10976927
  0.06232078  0.04236075  0.03582649  0.00163697]
Out[4]:

In [8]:
verbose=False
sample=mysample('DECaLS','DR7','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 51.51 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 71.72 sec for 3213834 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_r_nside1024_oversamp1_hits__total.fits
Area is  10536.525206889004  sq. deg.
34007 of  3213834  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  -4.677224179122472  and max  depth  =  45.23453244863504
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_DECaLS_DR71024.png
Total pixels 3213834 probably too many for exact mean and std
Mean =  23.9811672622 ; Median =  23.8989568769 ; Std =  1.4265287690916355
Results for 90% 95% and 98% are:  23.272977585 23.0817194864 22.2721719901
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.08958166  0.13417267  0.19177232  0.18441287  0.10976927
  0.06232078  0.04236075  0.03582649  0.00163697]
Out[8]:

In [10]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 53.38 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 55.53 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
Area is  9033.17652830332  sq. deg.
1384 of  2755285  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  18.234019205720443  and max  depth  =  44.11473280500019
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_DECaLS_DR71024.png
Total pixels 2755285 probably too many for exact mean and std
Mean =  23.108865523 ; Median =  23.0517593591 ; Std =  0.6642935076070003
Results for 90% 95% and 98% are:  22.707133824 22.5913288256 22.4413185759
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.07292123  0.1005752   0.16966128  0.19490938  0.13611978
  0.09566787  0.07108586  0.05185183  0.00117167]
Out[10]:

In [3]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 45.95 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 49.23 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
Area is  10925.518140499571  sq. deg.
10564 of  3332484  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  -5.187253974717061  and max  depth  =  44.11473280500019
saving plot image to %s /global/homes/m/manera/DESI/validation-outputs/depth_z_DECaLS_DR71024.png
Total pixels 3332484 probably too many for exact mean and std
Mean =  22.9719724154 ; Median =  22.978675076 ; Std =  0.7056397839441547
Results for 90% 95% and 98% are:  22.3921703797 22.1796687984 21.9678330144
Percentage of hits for 0,1,2., to >7 pases
 [  0.00000000e+00   7.29212255e-02   1.00575196e-01   1.69661279e-01
   1.94909380e-01   1.36119781e-01   9.56678722e-02   7.10858634e-02
   5.18518340e-02   3.30638704e-02   2.07393509e-02   1.26088713e-02
   7.76346734e-03   4.89770547e-03   3.55590129e-03   2.94601763e-03
   3.86966409e-03   1.53252989e-03   1.74969581e-03   1.41664943e-03
   1.22427608e-03   1.01116246e-03   9.71184876e-04   9.27600287e-04
   7.95644186e-04   7.87227852e-04   1.09593908e-04]
Out[3]:

In [ ]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 60.87 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 59.00 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
Area is  10925.518140499571  sq. deg.
10564 of  3332484  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  -5.187253974717061  and max  depth  =  44.11473280500019

In [9]:
verbose=False
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 55.32 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_ivar__total.fits
WARNING: AstropyDeprecationWarning: "clobber" was deprecated in version 2.0 and will be removed in a future version. Use argument "overwrite" instead. [quicksipManera3]
> Projection hits  total  took : 53.50 sec for 3332484 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR7/nside1024_oversamp1/DECaLS_DR7_band_z_nside1024_oversamp1_hits__total.fits
Area is  10925.518140499571  sq. deg.
10564 of  3332484  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  -5.187253974717061  and max  depth  =  44.11473280500019
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_DECaLS_DR71024.png
Total pixels 3332484 probably too many for exact mean and std
Mean =  22.9719724154 ; Median =  22.978675076 ; Std =  0.7056397839441547
Results for 90% 95% and 98% are:  22.3921703797 22.1796687984 21.9678330144
Percentage of hits for 0,1,2., to >7 pases
 [ 0.          0.07292123  0.1005752   0.16966128  0.19490938  0.13611978
  0.09566787  0.07108586  0.05185183  0.00117167]
Out[9]:

In [9]:
verbose=False
sample=mysample('BASS','DR6','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 18.04 sec for 1349414 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_g_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 18.10 sec for 1349414 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_g_nside1024_oversamp1_hits__total.fits
Area is  2698.46676597  sq. deg.
0 of  823082  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  22.3777457024  and max  depth  =  26.0370694244
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_BASS_DR61024.png
Total pixels 823082 probably too many for exact mean and std
Mean =  24.0715056634 ; Median =  24.0476100088 ; Std =  0.160135430713
Results for 90% 95% and 98% are:  23.9152536085 23.8753174773 23.8219363214
Percentage of hits for 0,1,2., to >7 pases
[  0.00000000e+00   1.32716868e-01   2.57327996e-01   3.74247636e-01
   1.63378326e-01   5.21700531e-02   1.25069104e-02   2.89533086e-03
   7.67740664e-04   4.35971474e-05]
Out[9]:

In [ ]:
verbose=False
sample=mysample('BASS','DR6','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3,Nexpmax=3)
fig = Image(filename=(fname))
fig

In [11]:
verbose=False
sample=mysample('BASS','DR6','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 17.93 sec for 1349303 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_r_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 18.47 sec for 1349303 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_r_nside1024_oversamp1_hits__total.fits
Area is  2942.56352011  sq. deg.
200 of  897536  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  20.5478027437  and max  depth  =  25.0851329046
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_BASS_DR61024.png
Total pixels 897536 probably too many for exact mean and std
Mean =  23.484260878 ; Median =  23.4819884846 ; Std =  0.194759004682
Results for 90% 95% and 98% are:  23.3092600921 23.2410636426 23.071959758
Percentage of hits for 0,1,2., to >7 pases
[  0.00000000e+00   1.31542730e-01   2.03272356e-01   3.57578691e-01
   1.94434460e-01   7.54782284e-02   2.44644828e-02   7.76326741e-03
   2.38345279e-03   3.36866900e-05]
Out[11]:

In [10]:
verbose=False
sample=mysample('MZLS','DR6','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 22.39 sec for 1506382 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MZLS_DR6/nside1024_oversamp1/MZLS_DR6_band_z_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 23.56 sec for 1506382 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MZLS_DR6/nside1024_oversamp1/MZLS_DR6_band_z_nside1024_oversamp1_hits__total.fits
Area is  3709.71725372  sq. deg.
1 of  1131532  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  19.8569933426  and max  depth  =  24.4835914831
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_MZLS_DR61024.png
Total pixels 1131532 probably too many for exact mean and std
Mean =  23.0097885331 ; Median =  22.9851695311 ; Std =  0.211228503266
Results for 90% 95% and 98% are:  22.7911902606 22.7410050154 22.6783950776
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.09882752  0.15001374  0.34048601  0.28559223  0.06094603
  0.0173296   0.00672605  0.00641935  0.00036786]
Out[10]:

In [12]:
verbose=False
sample=mysample('BASS','DR6','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 18.20 sec for 1349414 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_g_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 18.23 sec for 1349414 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_g_nside1024_oversamp1_hits__total.fits
Area is  4424.04138656  sq. deg.
0 of  1349414  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.5769673179  and max  depth  =  26.0370694244
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_BASS_DR61024.png
Total pixels 1349414 probably too many for exact mean and std
Mean =  23.8987134024 ; Median =  23.9558119988 ; Std =  0.286431885179
Results for 90% 95% and 98% are:  23.4592366169 23.3458470964 23.2346367799
Percentage of hits for 0,1,2., to >7 pases
[  0.00000000e+00   1.32716868e-01   2.57327996e-01   3.74247636e-01
   1.63378326e-01   5.21700531e-02   1.25069104e-02   2.89533086e-03
   7.67740664e-04   4.35971474e-05]
Out[12]:

In [13]:
verbose=False
sample=mysample('BASS','DR6','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 18.98 sec for 1349303 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_r_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 19.42 sec for 1349303 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR6/nside1024_oversamp1/BASS_DR6_band_r_nside1024_oversamp1_hits__total.fits
Area is  4423.67747408  sq. deg.
1097 of  1349303  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  19.4287621882  and max  depth  =  25.0851329046
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_BASS_DR61024.png
Total pixels 1349303 probably too many for exact mean and std
Mean =  23.3132838472 ; Median =  23.3988276054 ; Std =  0.36343597125
Results for 90% 95% and 98% are:  22.8490455334 22.6911783065 22.315045435
Percentage of hits for 0,1,2., to >7 pases
[  0.00000000e+00   1.31542730e-01   2.03272356e-01   3.57578691e-01
   1.94434460e-01   7.54782284e-02   2.44644828e-02   7.76326741e-03
   2.38345279e-03   3.36866900e-05]
Out[13]:

In [7]:
verbose=False
sample=mysample('MZLS','DR6','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig
#projection in some pointings to healpix pixels is not correct 
#This is only for 8 pointins and close to dec=0, usually excluded. 
#Edit careful line in quickipManera.py to check the effect
#The efect is actually a covering band around dec=0, whicn need not be there
#Keep the results without these 8 pointings is a very good approximation for what we want


> Projection ivar  total  took : 18.56 sec for 1506382 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MZLS_DR6/nside1024_oversamp1/MZLS_DR6_band_z_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 19.72 sec for 1506382 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MZLS_DR6/nside1024_oversamp1/MZLS_DR6_band_z_nside1024_oversamp1_hits__total.fits
Area is  4938.65953071  sq. deg.
204 of  1506382  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  18.5925220537  and max  depth  =  24.4835914831
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_MZLS_DR61024.png
Total pixels 1506382 probably too many for exact mean and std
Mean =  22.8623093448 ; Median =  22.9164844401 ; Std =  0.348139395571
Results for 90% 95% and 98% are:  22.3905498139 22.1434807854 21.9984364477
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.09882752  0.15001374  0.34048601  0.28559223  0.06094603
  0.0173296   0.00672605  0.00641935  0.00036786]
Out[7]:

DR5 --- new


In [4]:
verbose=False
sample=mysample('DECaLS','DR5','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


desi_image_validation.py:474: RuntimeWarning: divide by zero encountered in divide
  ivar= 1./nmag**2.
> Projection ivar  total  took : 36.34 sec for 2224544 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_g_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 31.81 sec for 2224544 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_g_nside1024_oversamp1_hits__total.fits
Area is  7293.14704177  sq. deg.
167 of  2224544  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  20.595955888  and max  depth  =  27.8815833825
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR51024.png
Total pixels 2224544 probably too many for exact mean and std
Mean =  24.0841589102 ; Median =  24.0855497155 ; Std =  0.469556600865
Results for 90% 95% and 98% are:  23.5362767606 23.4143113446 23.2586931671
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.25407564  0.26202016  0.2008089   0.1165043   0.05768607
  0.03055816  0.01753059  0.01128612  0.00054131]
Out[4]:

In [5]:
verbose=False
sample=mysample('DECaLS','DR5','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 34.69 sec for 2364469 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_r_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 36.14 sec for 2364469 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_r_nside1024_oversamp1_hits__total.fits
Area is  7751.88986718  sq. deg.
2803 of  2364469  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  9.62868721768  and max  depth  =  27.1042250459
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_DECaLS_DR51024.png
Total pixels 2364469 probably too many for exact mean and std
Mean =  23.7048844865 ; Median =  23.6633539923 ; Std =  0.587233897579
Results for 90% 95% and 98% are:  23.0995583298 22.9843664767 22.7052595397
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.25321035  0.24894512  0.19982516  0.11197582  0.05169094
  0.02838197  0.01659293  0.01270556  0.00083795]
Out[5]:

In [6]:
verbose=False
sample=mysample('DECaLS','DR5','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 40.84 sec for 3089312 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_z_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 42.54 sec for 3089312 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_z_nside1024_oversamp1_hits__total.fits
Area is  10128.2809753  sq. deg.
4120 of  3089312  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  20.1267671564  and max  depth  =  26.7398815338
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_DECaLS_DR51024.png
Total pixels 3089312 probably too many for exact mean and std
Mean =  22.7010171934 ; Median =  22.7194285397 ; Std =  0.455398619455
Results for 90% 95% and 98% are:  22.1237803017 21.9819974718 21.7854548086
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.16409487  0.20509931  0.22185124  0.17917381  0.09884698
  0.0528469   0.03079998  0.01695732  0.00033147]
Out[6]:

In [5]:
verbose=False
sample=mysample('DECaLS','DR5','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 35.16 sec for 2224544 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_g_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 31.54 sec for 2224544 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_g_nside1024_oversamp1_hits__total.fits
Area is  3533.00332103  sq. deg.
0 of  1077631  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  22.4154471186  and max  depth  =  27.8815833825
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_DECaLS_DR51024.png
Total pixels 1077631 probably too many for exact mean and std
Mean =  24.4026438262 ; Median =  24.3391882451 ; Std =  0.407871938
Results for 90% 95% and 98% are:  24.0402448867 23.9336373995 23.7833787467
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.25407564  0.26202016  0.2008089   0.1165043   0.05768607
  0.03055816  0.01753059  0.01128612  0.00054131]
Out[5]:

In [4]:
verbose=False
sample=mysample('DECaLS','DR5','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 37.12 sec for 2364469 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_r_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 37.51 sec for 2364469 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_r_nside1024_oversamp1_hits__total.fits
Area is  3861.1671363  sq. deg.
213 of  1177727  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  9.62868721768  and max  depth  =  27.1042250459
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_DECaLS_DR51024.png
Total pixels 1177727 probably too many for exact mean and std
Mean =  24.0993055706 ; Median =  23.986513448 ; Std =  0.481940322969
Results for 90% 95% and 98% are:  23.6665610688 23.5887584435 23.4574352217
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.25321035  0.24894512  0.19982516  0.11197582  0.05169094
  0.02838197  0.01659293  0.01270556  0.00083795]
Out[4]:

In [3]:
verbose=False
sample=mysample('DECaLS','DR5','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


desi_image_validation.py:474: RuntimeWarning: divide by zero encountered in divide
  ivar= 1./nmag**2.
> Projection ivar  total  took : 47.16 sec for 3089312 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_z_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 48.51 sec for 3089312 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR5/nside1024_oversamp1/DECaLS_DR5_band_z_nside1024_oversamp1_hits__total.fits
Area is  6392.15219967  sq. deg.
0 of  1949724  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.0816428552  and max  depth  =  26.7398815338
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_DECaLS_DR51024.png
Total pixels 1949724 probably too many for exact mean and std
Mean =  22.9348694726 ; Median =  22.8994737781 ; Std =  0.353237070573
Results for 90% 95% and 98% are:  22.5706222619 22.4494434718 22.2703581598
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.16409487  0.20509931  0.22185124  0.17917381  0.09884698
  0.0528469   0.03079998  0.01695732  0.00033147]
Out[3]:

DR5 -- with separation of areas


In [ ]:
verbose=False
sample=mysample('DEShyb','DR5','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 6.79 sec for 373990 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DEShyb_DR5/nside1024_oversamp1/DEShyb_DR5_band_g_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 6.53 sec for 373990 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DEShyb_DR5/nside1024_oversamp1/DEShyb_DR5_band_g_nside1024_oversamp1_hits__total.fits
Area is  1226.12277489  sq. deg.
0 of  373990  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  22.5547623894  and max  depth  =  27.058308366
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_DEShyb_DR51024.png
Total pixels 373990 probably too many for exact mean and std
Mean =  24.391679583 ; Median =  24.3988681172 ; Std =  0.372392068385
Results for 90% 95% and 98% are:  23.9735244947 23.7907910321 23.6181638784
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.05630407  0.1150137   0.17937386  0.19872562  0.16289429
  0.10606191  0.05939081  0.03659564  0.00093596]
Out[ ]:

In [3]:
verbose=False
sample=mysample('NGCproxy','DR5','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


desi_image_validation.py:474: RuntimeWarning: divide by zero encountered in divide
  ivar= 1./nmag**2.
> Projection ivar  total  took : 18.23 sec for 1558991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_g_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 18.27 sec for 1558991 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_g_nside1024_oversamp1_hits__total.fits
Area is  5111.13765329  sq. deg.
0 of  1558991  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.8288993648  and max  depth  =  27.8815833825
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_NGCproxy_DR51024.png
Total pixels 1558991 probably too many for exact mean and std
Mean =  24.0560281776 ; Median =  24.0549793292 ; Std =  0.455497978128
Results for 90% 95% and 98% are:  23.536539093 23.4277415888 23.2994770695
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.26086153  0.30014674  0.21670867  0.10562459  0.03785182
  0.01559726  0.00953565  0.00655716  0.00051494]
Out[3]:

In [4]:
verbose=False
sample=mysample('DEShyb','DR5','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 4.84 sec for 373838 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DEShyb_DR5/nside1024_oversamp1/DEShyb_DR5_band_r_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 4.79 sec for 373838 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DEShyb_DR5/nside1024_oversamp1/DEShyb_DR5_band_r_nside1024_oversamp1_hits__total.fits
Area is  1225.62444429  sq. deg.
0 of  373838  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.1246791215  and max  depth  =  27.1042250459
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_DEShyb_DR51024.png
Total pixels 373838 probably too many for exact mean and std
Mean =  24.1930822536 ; Median =  24.1418625454 ; Std =  0.434919873812
Results for 90% 95% and 98% are:  23.746712113 23.5850788031 23.4112107862
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.06266044  0.14438457  0.26366204  0.21840221  0.11764659
  0.06750214  0.03976363  0.0216039   0.00070355]
Out[4]:

In [5]:
verbose=False
sample=mysample('NGCproxy','DR5','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 17.88 sec for 1618148 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_r_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 18.14 sec for 1618148 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_r_nside1024_oversamp1_hits__total.fits
Area is  5305.08333364  sq. deg.
499 of  1618148  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  20.372340748  and max  depth  =  26.6376941926
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_NGCproxy_DR51024.png
Total pixels 1618148 probably too many for exact mean and std
Mean =  23.6571757799 ; Median =  23.6033890804 ; Std =  0.490095459133
Results for 90% 95% and 98% are:  23.1129980173 23.0355788039 22.9229951102
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.25065636  0.2860528   0.2014189   0.09759792  0.04049898
  0.02174639  0.0132613   0.00932253  0.00086825]
Out[5]:

In [6]:
verbose=False
sample=mysample('DEShyb','DR5','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 5.24 sec for 368789 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DEShyb_DR5/nside1024_oversamp1/DEShyb_DR5_band_z_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 5.31 sec for 368789 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DEShyb_DR5/nside1024_oversamp1/DEShyb_DR5_band_z_nside1024_oversamp1_hits__total.fits
Area is  1209.07134423  sq. deg.
62 of  368789  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  20.3984952117  and max  depth  =  26.7398815338
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_DEShyb_DR51024.png
Total pixels 368789 probably too many for exact mean and std
Mean =  22.9305194863 ; Median =  22.91076812 ; Std =  0.471055956279
Results for 90% 95% and 98% are:  22.4444841089 22.2621726743 22.0467710834
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.07544372  0.14354925  0.25794241  0.25598429  0.13964939
  0.04930537  0.02165679  0.01349384  0.00046967]
Out[6]:

In [7]:
verbose=False
sample=mysample('NGCproxy','DR5','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 20.58 sec for 1815506 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_z_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 21.00 sec for 1815506 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_z_nside1024_oversamp1_hits__total.fits
Area is  5952.11972126  sq. deg.
1083 of  1815506  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  20.4826021098  and max  depth  =  24.9175907475
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_NGCproxy_DR51024.png
Total pixels 1815506 probably too many for exact mean and std
Mean =  22.7781511749 ; Median =  22.789759511 ; Std =  0.421425993989
Results for 90% 95% and 98% are:  22.2470140935 22.0680523113 21.8464422596
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.10567412  0.18553891  0.2276258   0.19067687  0.11298393
  0.0696456   0.04381919  0.02387158  0.00043895]
Out[7]:

---


In [6]:
verbose=False
sample=mysample('NGCproxy','DR5','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 21.78 sec for 1618148 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_r_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 21.14 sec for 1618148 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_r_nside1024_oversamp1_hits__total.fits
Area is  5305.08333364  sq. deg.
499 of  1618148  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.0107522556  and max  depth  =  26.6376941926
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_NGCproxy_DR51024.png
Total pixels 1617649 probably too many for exact mean and std
Mean =  23.6581045007 ; Median =  23.6035261435 ; Std =  0.487308424924
Results for 90% 95% and 98% are:  23.1133794494 23.0361629006 22.9248675779
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.25065636  0.2860528   0.2014189   0.09759792  0.04049898
  0.02174639  0.0132613   0.00932253  0.00086825]
Out[6]:

In [7]:
verbose=False
sample=mysample('DEShyb','DR5','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 6.20 sec for 368789 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DEShyb_DR5/nside1024_oversamp1/DEShyb_DR5_band_z_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 6.16 sec for 368789 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DEShyb_DR5/nside1024_oversamp1/DEShyb_DR5_band_z_nside1024_oversamp1_hits__total.fits
Area is  1209.07134423  sq. deg.
62 of  368789  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.0551786346  and max  depth  =  26.7398815338
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_DEShyb_DR51024.png
Total pixels 368727 probably too many for exact mean and std
Mean =  22.9308934688 ; Median =  22.9108448803 ; Std =  0.470203971006
Results for 90% 95% and 98% are:  22.4450040617 22.2627234392 22.0500421909
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.07544372  0.14354925  0.25794241  0.25598429  0.13964939
  0.04930537  0.02165679  0.01349384  0.00046967]
Out[7]:

In [8]:
verbose=False
sample=mysample('NGCproxy','DR5','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 25.95 sec for 1815506 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_z_nside1024_oversamp1_ivar__total.fits
> Projection hits  total  took : 24.98 sec for 1815506 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//NGCproxy_DR5/nside1024_oversamp1/NGCproxy_DR5_band_z_nside1024_oversamp1_hits__total.fits
Area is  5952.11972126  sq. deg.
1083 of  1815506  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.000382906  and max  depth  =  24.9175907475
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_NGCproxy_DR51024.png
Total pixels 1814423 probably too many for exact mean and std
Mean =  22.7792680608 ; Median =  22.7899936617 ; Std =  0.419059129447
Results for 90% 95% and 98% are:  22.2491653981 22.0709323416 21.8534469578
Percentage of hits for 0,1,2., to >7 pases
[ 0.          0.10567412  0.18553891  0.2276258   0.19067687  0.11298393
  0.0696456   0.04381919  0.02387158  0.00043895]
Out[8]:

DR4


In [4]:
verbose=False
sample=mysample('BASS','DR4','g',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 28.13 sec for 1032960 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR4/nside1024_oversamp1/BASS_DR4_band_g_nside1024_oversamp1_ivar__total.fits
Area is  3386.54985843  sq. deg.
6391 of  1032960  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.492640974  and max  depth  =  25.2674991197
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_g_BASS_DR41024.png
Out[4]:

In [5]:
verbose=False
sample=mysample('BASS','DR4','r',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 24.13 sec for 900041 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR4/nside1024_oversamp1/BASS_DR4_band_r_nside1024_oversamp1_ivar__total.fits
Area is  2950.77613957  sq. deg.
3553 of  900041  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.0032415064  and max  depth  =  24.093121473
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_r_BASS_DR41024.png
Out[5]:

In [6]:
verbose=False
sample=mysample('MZLS','DR4','z',localdir,verbose)
fname=val3p4c_depthfromIvar(sample)
fig = Image(filename=(fname))
fig


> Projection ivar  total  took : 28.03 sec for 1003899 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MZLS_DR4/nside1024_oversamp1/MZLS_DR4_band_z_nside1024_oversamp1_ivar__total.fits
Area is  3363.76762585  sq. deg.
6788 of  1026011  pixels are not plotted as their  depth  <  21.0
Within the plot, min  depth =  21.0101700532  and max  depth  =  23.5305051132
saving plot to  /global/homes/m/manera/DESI/validation-outputs/depth_z_MZLS_DR41024.png
Out[6]:

Depth Histograms (Val 3.4)

Requirement V3.4
90% filled to g=24, r=23.4 and z=22.5 and 95% and 98% at 0.3/0.6 mag shallower.
Done by montecarlo exposure statistics to the final ratio of exposures


In [5]:
sample=mysample('DECaLS','DR7','g',localdir,verbose)
type(sample.FracExp)


Out[5]:
list

In [4]:
#g-band DR7
fraclist= [ 0. , 0.09804808, 0.14823496, 0.20733294, 0.19860563, 0.10990054,  0.05556302, 0.03251795, 0.024456, 0.01998162, 0.01592223, 0.01199664, 0.00886791, 0.00695788, 0.00545213, 0.00446497, 0.0054284, 0.002256, 0.00273548, 0.0024744, 0.00217923, 0.00188048, 0.00204512, 0.00199771, 0.00196978, 0.00163986, 0.00037854]

In [16]:
print(np.sum(fraclist))
xfill=1.0 - np.sum(fraclist)
fraclist2 = fraclist[1:]
fraclist2[-1]=fraclist2[-1]+xfill
print(np.sum(fraclist2))


1.0
1.0

In [17]:
verbose=True
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=1,enterFrac=True,fraclist=fraclist2)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1255434
Total images drawn with either  1  to 5 exposures 100001
We are in fact runing with a minimum of 1 exposures
Mean =  24.4030620503 ; Median =  24.3539399652 ; Std =  1.2286679165109493
percentage better than requirements = 0.7988720112798872
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.7550671315 23.5401096344 23.143573761
min,max depth =  4.4408920985e-15 45.3373222351
counts below  21.0  =  127
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7g_pred_exposures.png
Out[17]:

---


In [4]:
sample=mysample('DECaLS','DR7','r',localdir,verbose)
type(sample.FracExp)


Out[4]:
list

In [5]:
#r-band DR7
fraclist=[ 0.0, 0.08958166, 0.13417267, 0.19177232, 0.18441287, 0.10976927, 0.06232078, 0.04236075, 0.03582649, 0.02672343, 0.01945749, 0.01441745, 0.01276206, 0.00858993, 0.00672286, 0.00579604, 0.01480615, 0.00318169, 0.00410542, 0.00382578, 0.00320883, 0.00252454, 0.00208529, 0.00176575, 0.00189917, 0.00143467, 0.00027577]

In [6]:
print(np.sum(fraclist))
xfill=1.0 - np.sum(fraclist)
fraclist2 = fraclist[1:]
fraclist2[-1]=fraclist2[-1]+xfill
print(np.sum(fraclist2))


0.98379913
1.0

In [7]:
verbose=True
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=1,enterFrac=True,fraclist=fraclist2)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1255434
Total images drawn with either  1  to 5 exposures 100001
We are in fact runing with a minimum of 1 exposures
Mean =  24.4422291942 ; Median =  24.3921421624 ; Std =  1.2484543533470693
percentage better than requirements = 0.8164218357816422
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.7857376022 23.5751220311 23.2120177337
min,max depth =  4.4408920985e-15 45.3373222351
counts below  21.0  =  117
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7g_pred_exposures.png
Out[7]:

---


In [8]:
sample=mysample('DECaLS','DR7','z',localdir,verbose)
type(sample.FracExp)


Out[8]:
list

In [10]:
#z-band DR7
fraclist = [0.00000000e+00, 7.29212255e-02, 1.00575196e-01, 1.69661279e-01, 1.94909380e-01, 1.36119781e-01, 9.56678722e-02, 7.10858634e-02, 5.18518340e-02, 3.30638704e-02, 2.07393509e-02, 1.26088713e-02, 7.76346734e-03, 4.89770547e-03, 3.55590129e-03, 2.94601763e-03, 3.86966409e-03, 1.53252989e-03, 1.74969581e-03, 1.41664943e-03, 1.22427608e-03, 1.01116246e-03, 9.71184876e-04, 9.27600287e-04, 7.95644186e-04, 7.87227852e-04, 1.09593908e-04]

In [11]:
print(np.sum(fraclist))
xfill=1.0 - np.sum(fraclist)
fraclist2 = fraclist[1:]
fraclist2[-1]=fraclist2[-1]+xfill
print(np.sum(fraclist2))


0.992762844299
1.0

In [13]:
verbose=True
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=1,enterFrac=True,fraclist=fraclist2)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1148333
Total images drawn with either  1  to 5 exposures 100002
We are in fact runing with a minimum of 1 exposures
Mean =  23.0981116871 ; Median =  23.1323156902 ; Std =  0.7387980220183671
percentage better than requirements = 0.9024019519609607
Requirements are > 90%, 95% and 98% at 22.5, 22.2, 21.9
Results are:  22.5093355928 22.2625065804 22.0043896103
min,max depth =  -5.18237257004 42.2793045044
counts below  21.0  =  303
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7z_pred_exposures.png
Out[13]:

---


In [4]:
verbose=True
sample=mysample('DECaLS','DR7','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1135556
Total images drawn with either  1  to 5 exposures 100000
We are in fact runing with a minimum of 1 exposures
Mean =  23.8855710469 ; Median =  23.8137236975 ; Std =  1.1597758670822984
percentage better than requirements = 0.89799
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.3955685076 23.2314635037 23.0244472601
min,max depth =  4.4408920985e-15 44.3237419128
counts below  21.0  =  66
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7r_pred_exposures.png
Out[4]:

In [5]:
verbose=True
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1255434
Total images drawn with either  1  to 5 exposures 100000
We are in fact runing with a minimum of 1 exposures
Mean =  24.2216796725 ; Median =  24.2144746161 ; Std =  0.8805623040558892
percentage better than requirements = 0.78431
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.8225476244 23.670547054 23.4312491437
min,max depth =  4.4408920985e-15 43.7735061646
counts below  21.0  =  29
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7g_pred_exposures.png
Out[5]:

In [6]:
verbose=True
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=1)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1148333
Total images drawn with either  1  to 5 exposures 100000
We are in fact runing with a minimum of 1 exposures
Mean =  22.8781839211 ; Median =  22.8813781708 ; Std =  0.48594290448890404
percentage better than requirements = 0.89021
Requirements are > 90%, 95% and 98% at 22.5, 22.2, 21.9
Results are:  22.4799431484 22.3284578167 22.1414381564
min,max depth =  0.37628749458 42.2793045044
counts below  21.0  =  92
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7z_pred_exposures.png
Out[6]:

In [7]:
verbose=True
sample=mysample('DECaLS','DR7','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1135556
Total images drawn with either  3  to 5 exposures 74000
We are in fact runing with a minimum of 3 exposures
Mean =  23.9976811639 ; Median =  23.8791037273 ; Std =  1.2291081191401967
percentage better than requirements = 0.9643513513513513
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.5595022038 23.4517956331 23.3058220098
min,max depth =  21.8775966462 44.995223999
counts below  21.8775966462  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7r_pred_exposures.png
Out[7]:

In [8]:
verbose=True
sample=mysample('DECaLS','DR7','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1255434
Total images drawn with either  3  to 5 exposures 74000
We are in fact runing with a minimum of 3 exposures
Mean =  24.3209253298 ; Median =  24.2818526674 ; Std =  0.9141261428784986
percentage better than requirements = 0.8921486486486486
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.9880249062 23.877963193 23.7355128244
min,max depth =  22.0441147362 45.5534820557
counts below  22.0441147362  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7g_pred_exposures.png
Out[8]:

In [9]:
verbose=True
sample=mysample('DECaLS','DR7','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  3539323
Counts with dec < -20 =  14504
Number of objects in the sample =  1148333
Total images drawn with either  3  to 5 exposures 74000
We are in fact runing with a minimum of 3 exposures
Mean =  22.9711380636 ; Median =  22.947191677 ; Std =  0.48582488861897904
percentage better than requirements = 0.9626891891891892
Requirements are > 90%, 95% and 98% at 22.5, 22.2, 21.9
Results are:  22.6423155479 22.5401817089 22.4105836064
min,max depth =  19.3811579021 44.1161308289
counts below  21.0  =  2
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR7z_pred_exposures.png
Out[9]:

DR6


In [3]:
verbose=True
sample=mysample('BASS','DR6','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  46504
Counts with dec < -20 =  2
Number of objects in the sample =  46504
Total images drawn with either  3  to 5 exposures 94000
We are in fact runing with a minimum of 3 exposures
Mean =  23.4064689993 ; Median =  23.4153847059 ; Std =  0.138250546623
percentage better than requirements = 0.554617021277
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.2365012299 23.1719960187 23.0835890265
min,max depth =  22.0342805845 24.0322437349
counts below  22.0342805845  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/BASS_DR6r_pred_exposures.png
Out[3]:

In [4]:
verbose=True
sample=mysample('BASS','DR6','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  44144
Counts with dec < -20 =  0
Number of objects in the sample =  44144
Total images drawn with either  3  to 5 exposures 94000
We are in fact runing with a minimum of 3 exposures
Mean =  24.0113015814 ; Median =  24.0057597833 ; Std =  0.110369677706
percentage better than requirements = 0.526031914894
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.8844140965 23.8407735112 23.7842311659
min,max depth =  23.269073722 24.6196708816
counts below  23.269073722  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/BASS_DR6g_pred_exposures.png
Out[4]:

In [5]:
verbose=True
sample=mysample('MZLS','DR6','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  170275
Counts with dec < -20 =  0
Number of objects in the sample =  170275
Total images drawn with either  3  to 5 exposures 85000
We are in fact runing with a minimum of 3 exposures
Mean =  22.8756863631 ; Median =  22.8785879342 ; Std =  0.109481630925
percentage better than requirements = 0.998117647059
Requirements are > 90%, 95% and 98% at 22.5, 22.2, 21.9
Results are:  22.7373845223 22.6917459818 22.6363413819
min,max depth =  22.0268959928 23.4105805504
counts below  22.0268959928  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/MZLS_DR6z_pred_exposures.png
Out[5]:

In [6]:
verbose=True
sample=mysample('BASS','DR6','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  46504
Counts with dec < -20 =  2
Number of objects in the sample =  46504
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  23.3907023928 ; Median =  23.4073605915 ; Std =  0.153943390585
percentage better than requirements = 0.52417
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.2011858551 23.1263590664 23.0137473029
min,max depth =  21.2522716522 24.0247590354
counts below  21.2522716522  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/BASS_DR6r_pred_exposures.png
Out[6]:

In [7]:
verbose=True
sample=mysample('BASS','DR6','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  44144
Counts with dec < -20 =  0
Number of objects in the sample =  44144
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  23.9956057783 ; Median =  23.999128876 ; Std =  0.127058290303
percentage better than requirements = 0.49628
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.8465776971 23.7800987959 23.7019013866
min,max depth =  22.4918347067 24.571176415
counts below  22.4918347067  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/BASS_DR6g_pred_exposures.png
Out[7]:

In [8]:
verbose=True
sample=mysample('MZLS','DR6','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  170275
Counts with dec < -20 =  0
Number of objects in the sample =  170275
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  22.8406463589 ; Median =  22.8578349069 ; Std =  0.145157408664
percentage better than requirements = 0.97708
Requirements are > 90%, 95% and 98% at 22.5, 22.3, 21
Results are:  22.6550506655 22.5778112716 22.4852127441
min,max depth =  20.5390491486 23.4310196081
counts below  21.0  =  1
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/MZLS_DR6z_pred_exposures.png
Out[8]:

DR5


In [6]:
verbose=True
sample=mysample('DECaLS','DR5','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts with dec < -20 =  13075
Number of objects in the sample =  539702
Total images drawn with either  3  to 5 exposures 74000
We are in fact runing with a minimum of 3 exposures
Mean =  23.930464184 ; Median =  23.8823995833 ; Std =  0.301782184199
percentage better than requirements = 0.982756756757
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.6002718727 23.5163412935 23.4160328602
min,max depth =  22.3405577961 25.0485798493
counts below  22.3405577961  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5r_pred_exposures.png
Out[6]:

In [7]:
verbose=True
sample=mysample('DECaLS','DR5','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts with dec < -20 =  13075
Number of objects in the sample =  528626
Total images drawn with either  3  to 5 exposures 74000
We are in fact runing with a minimum of 3 exposures
Mean =  24.2889079077 ; Median =  24.2911943506 ; Std =  0.208254722944
percentage better than requirements = 0.923337837838
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  24.0328228431 23.9482944181 23.8384076416
min,max depth =  22.7928264155 25.4469867488
counts below  22.7928264155  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5g_pred_exposures.png
Out[7]:

In [8]:
verbose=True
sample=mysample('DECaLS','DR5','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample,Nexpmin=3)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts with dec < -20 =  13075
Number of objects in the sample =  689388
Total images drawn with either  3  to 5 exposures 74000
We are in fact runing with a minimum of 3 exposures
Mean =  22.893711822 ; Median =  22.8759292993 ; Std =  0.23372262471
percentage better than requirements = 0.964986486486
Requirements are > 90%, 95% and 98% at 22.5, 22.2, 21.9
Results are:  22.6144456748 22.53684198 22.4466028971
min,max depth =  21.4719591142 23.7729037715
counts below  21.4719591142  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5z_pred_exposures.png
Out[8]:

In [13]:
verbose=True
sample=mysample('DECaLS','DR5','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts with dec < -20 =  13075
Number of objects in the sample =  528626
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  24.2047074997 ; Median =  24.2300236032 ; Std =  0.27099848879
percentage better than requirements = 0.81038
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.8717687463 23.7423485852 23.5604571827
min,max depth =  21.4889698029 25.3586243634
counts below  21.4889698029  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5g_pred_exposures.png
Out[13]:

In [11]:
verbose=True
sample=mysample('DECaLS','DR5','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts with dec < -20 =  13075
Number of objects in the sample =  539702
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  23.8425509351 ; Median =  23.8175633515 ; Std =  0.356554523213
percentage better than requirements = 0.91876
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.4389074448 23.3052346175 23.1321868185
min,max depth =  20.46667099 25.2130308881
counts below  21.0  =  5
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5r_pred_exposures.png
Out[11]:

In [12]:
verbose=True
sample=mysample('DECaLS','DR5','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts with dec < -20 =  13075
Number of objects in the sample =  689388
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  22.8074812513 ; Median =  22.8124018609 ; Std =  0.290604817308
percentage better than requirements = 0.8689
Requirements are > 90%, 95% and 98% at 22.5, 22.2, 21.9
Results are:  22.452211846 22.3270688857 22.1633448784
min,max depth =  19.9536361694 23.8367842017
counts below  21.0  =  10
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5z_pred_exposures.png
Out[12]:

---- old DR5 ----


In [5]:
verbose=True
sample=mysample('DEShyb','DR5','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  124159
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  24.1838370518 ; Median =  24.2099142499 ; Std =  0.280599884812
percentage better than requirements = 0.78104
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.8360147465 23.7010912612 23.5122098509
min,max depth =  21.3609409332 25.0236269297
counts below  21.3609409332  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DEShyb_DR5g_pred_exposures.png
Out[5]:

In [6]:
verbose=True
sample=mysample('NGCproxy','DR5','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


creating directory for plots /global/homes/m/manera/DESI/validation-outputs/NGCproxy_DR5
-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  366804
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  24.2153387468 ; Median =  24.2418202086 ; Std =  0.267397248547
percentage better than requirements = 0.82598
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.8909109582 23.7597470263 23.5700310399
min,max depth =  21.1560192108 25.2931528002
counts below  21.1560192108  =  0
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/NGCproxy_DR5g_pred_exposures.png
Out[6]:

In [7]:
verbose=True
sample=mysample('DECaLS','DR5','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


creating directory for plots /global/homes/m/manera/DESI/validation-outputs/DECaLS_DR5
-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  528626
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  24.2048776006 ; Median =  24.2304521411 ; Std =  0.275360980801
percentage better than requirements = 0.80966
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.8708821524 23.7365246903 23.5536577492
min,max depth =  20.7588405609 25.2655482125
counts below  21.0  =  2
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5g_pred_exposures.png
Out[7]:

In [8]:
verbose=True
sample=mysample('DEShyb','DR5','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  111905
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  24.0967350952 ; Median =  24.0844806187 ; Std =  0.334522276514
percentage better than requirements = 0.97785
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.7021382403 23.5637934786 23.382436418
min,max depth =  20.5994987488 25.1288276243
counts below  21.0  =  4
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DEShyb_DR5r_pred_exposures.png
Out[8]:

In [9]:
verbose=True
sample=mysample('NGCproxy','DR5','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  351752
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  23.7644127247 ; Median =  23.741426656 ; Std =  0.322339405322
percentage better than requirements = 0.91678
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.4297006979 23.3178598232 23.156239727
min,max depth =  -0.0688880085945 25.0804602131
counts below  21.0  =  4
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/NGCproxy_DR5r_pred_exposures.png
Out[9]:

In [11]:
verbose=True
sample=mysample('DECaLS','DR5','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  539702
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  23.8413805348 ; Median =  23.8170753056 ; Std =  0.364457871284
percentage better than requirements = 0.91804
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.4381448292 23.3047377957 23.1292440372
min,max depth =  -0.0688880085945 25.0559045881
counts below  21.0  =  5
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5r_pred_exposures.png
Out[11]:

In [12]:
verbose=True
sample=mysample('DEShyb','DR5','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  140737
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  23.0642600205 ; Median =  23.0925442784 ; Std =  0.309003850329
percentage better than requirements = 0.95529
Requirements are > 90%, 95% and 98% at 22.5, 22.3, 21
Results are:  22.657506824 22.5223158002 22.3455825154
min,max depth =  20.0157680511 23.9200181911
counts below  21.0  =  2
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DEShyb_DR5z_pred_exposures.png
Out[12]:

In [13]:
verbose=True
sample=mysample('NGCproxy','DR5','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  416107
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  22.753287841 ; Median =  22.7655239658 ; Std =  0.249418436836
percentage better than requirements = 0.86126
Requirements are > 90%, 95% and 98% at 22.5, 22.3, 21
Results are:  22.4459195799 22.335141552 22.1808316012
min,max depth =  20.3578929901 23.6471932569
counts below  21.0  =  16
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/NGCproxy_DR5z_pred_exposures.png
Out[13]:

In [14]:
verbose=True
sample=mysample('DECaLS','DR5','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  2723220
Counts before or during 2014 =  1266922
Counts with dec < -20 =  13075
Number of objects in the sample =  689388
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  22.8064779956 ; Median =  22.8126459375 ; Std =  0.292226721611
percentage better than requirements = 0.86885
Requirements are > 90%, 95% and 98% at 22.5, 22.3, 21
Results are:  22.4521908377 22.322765752 22.1597849906
min,max depth =  20.3543758392 23.7643932756
counts below  21.0  =  19
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/DECaLS_DR5z_pred_exposures.png
Out[14]:

In [3]:
verbose=True
sample=mysample('BASS','DR4','g',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  49032
Counts before or during 2014 =  0
Counts with dec < -20 =  16
Number of objects in the sample =  21919
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  23.9078045632 ; Median =  23.916499922 ; Std =  0.157173139042
percentage better than requirements = 0.22469
Requirements are > 90%, 95% and 98% at 24, 23.7, 23.4
Results are:  23.7394484346 23.6691735204 23.5798986111
min,max depth =  4.4408920985e-15 24.4988843412
counts below  21.0  =  1
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/BASS_DR4g_pred_exposures.png
Out[3]:

In [4]:
verbose=True
sample=mysample('BASS','DR4','r',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  49032
Counts before or during 2014 =  0
Counts with dec < -20 =  16
Number of objects in the sample =  23718
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  23.3125535232 ; Median =  23.3314726417 ; Std =  0.242451537445
percentage better than requirements = 0.28556
Requirements are > 90%, 95% and 98% at 23.4, 23.1, 22.8
Results are:  23.1149276268 23.0344432049 22.915762313
min,max depth =  4.4408920985e-15 23.9711193767
counts below  21.0  =  7
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/BASS_DR4r_pred_exposures.png
Out[4]:

In [5]:
verbose=True
sample=mysample('MZLS','DR4','z',localdir,verbose)
fname=val3p4b_maghist_pred(sample)
fig = Image(filename=(fname))
fig


-----------
Number of objects =  80486
Counts before or during 2014 =  0
Counts with dec < -20 =  0
Number of objects in the sample =  72150
Total images drawn with either 1,2,3,4,5 exposures 100000
Mean =  22.8105140816 ; Median =  22.8344044032 ; Std =  0.2607307769
percentage better than requirements = 0.96722
Requirements are > 90%, 95% and 98% at 22.5, 22.3, 21
Results are:  22.6225030872 22.5438015882 22.4455493114
min,max depth =  4.4408920985e-15 23.2442334432
counts below  21.0  =  9
saving histogram plot in /global/homes/m/manera/DESI/validation-outputs/validationplots/MZLS_DR4z_pred_exposures.png
Out[5]:

Seeing Requirements (Val 4.1)

z-band image quality will be smaller than 1.3 arcsec FWHM in at least one pass.

val3p4c_seeing - runs everything
val3p4c_seeingplots - runs the plots only if the previous have been run


In [3]:
verbose=True
sample= mysample('BASS','DR4','g',localdir,verbose)
#fname1,fname2 = val3p4c_seeing(sample)
fname1, fname2 = val3p4c_seeing(sample)
print 'For pass >=3'
fig = Image(filename=(fname1))
fig


> Projection FWHM  min  took : 23.44 sec for 1032960 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR4/nside1024_oversamp1/BASS_DR4_band_g_nside1024_oversamp1_FWHM__min.fits
> Projection FWHM  num  took : 20.59 sec for 1032960 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR4/nside1024_oversamp1/BASS_DR4_band_g_nside1024_oversamp1_FWHM__num.fits
2.37794 9.52291
1.0 38.0
1032960 131050
2.37794 7.25379
saving plot to  /global/homes/m/manera/DESI/validation-outputs/FWHMminpass3_g_BASS_DR41024map.png
The total area is  3386.54985843  sq. deg.
A total of  429.64621955 squaredegrees with pass >= 3
#FWHM  Area(>FWHM) Fractional Area(>FWHM)
1.29369443974 3.70141611501 0.00863037678589
#mean  STD
3.31503719954 0.451763193891
Area with FWHM greater than 1.3 arcsec fraction
3.70 0.01
saving plot to  /global/homes/m/manera/DESI/validation-outputs/FWHMminpass3_g_BASS_DR41024histo.png
For pass >=3
Out[3]:

In [4]:
fig = Image(filename=(fname2))
fig


Out[4]:

Photometric Requirements (Val 5.1e)

Requirement V5.1
No region > 3deg will be based upon non-photometric observations
Done by visual inspection and if necessary pixel value counts.


In [7]:
verbose=False
sample = mysample('BASS','DR4','g',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


> Projection zptvar  min  took : 20.32 sec for 1040981 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR4/nside1024_oversamp1/BASS_DR4_band_g_nside1024_oversamp1_zptvar__min.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.000341442358971 0.010842128031
Number of pixels is  1040981
Area is  3412.84663315  sq. deg.
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 0
nside of udgraded pixels is :  64
Out[7]:

In [6]:
verbose=False
sample = mysample('BASS','DR4','r',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


desi_image_validation.py:447: RuntimeWarning: divide by zero encountered in divide
  zptvar = tbdata['CCDPHRMS']**2/tbdata['CCDNMATCH']
> Projection zptvar  min  took : 17.61 sec for 908419 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR4/nside1024_oversamp1/BASS_DR4_band_r_nside1024_oversamp1_zptvar__min.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.000370434955345 0.00748266271781
Number of pixels is  908419
Area is  2978.2433355  sq. deg.
Number of udegrade pixels with  photometric-pixels  >  0.01  for all subpixels = 0
nside of udgraded pixels is :  64
Out[6]:

In [3]:
verbose=False
sample = mysample('MZLS','DR4','z',localdir,verbose)
fname = v5p1e_photometricReqPlot(sample)
fig = Image(filename=(fname))
fig


desi_image_validation.py:454: RuntimeWarning: divide by zero encountered in divide
  zptvar = tbdata['CCDPHRMS']**2/tbdata['CCDNMATCH']
> Projection zptvar  min  took : 94.96 sec for 1014477 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MZLS_DR4/nside1024_oversamp1/MZLS_DR4_band_z_nside1024_oversamp1_zptvar__min.fits
Plotting min zpt rms
Min and Max values of  min-zpt-rms-flux  values is  0.00073402407614 0.0432843339667
Number of pixels is  1014477
Area is  3325.95351294  sq. deg.
Number of udegrade pixels with  photometric-pixels  >  0.02  for all subpixels = 0
nside of udgraded pixels is :  64
Out[3]:

Area Requirements (Val 5.3 and Val 3.1)

Requirement V5.1
450 sq degrees overlap between all instruments br> Requirement V3.1
1200 sq degrees filled


In [4]:
verbose=False
sample1 = mysample('DECaLS','DR3','g',localdir,verbose)
sample2 = mysample('BASS','DR4','g',localdir,verbose)
fname = v3p5_Areas(sample1,sample2)
fig = Image(filename=(fname))
fig


> Projection nccd1  total  took : 16.34 sec for 896872 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR3/nside1024_oversamp1/DECaLS_DR3_band_g_nside1024_oversamp1_nccd1__total.fits
> Projection nccd2  total  took : 18.89 sec for 1040981 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR4/nside1024_oversamp1/BASS_DR4_band_g_nside1024_oversamp1_nccd2__total.fits
Area of sample DECaLS_DR3  is  2940.0  sq. deg.
Area of sample BASS_DR4  is  3413.0  sq. deg.
The total JOINT area is  6324.0 sq. deg.
The INTERSECTING area is  29.0  sq. deg.
Out[4]:

In [5]:
verbose=False
sample1 = mysample('DECaLS','DR3','r',localdir,verbose)
sample2 = mysample('BASS','DR4','r',localdir,verbose)
fname = v3p5_Areas(sample1,sample2)
fig = Image(filename=(fname))
fig


> Projection nccd1  total  took : 16.55 sec for 929020 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR3/nside1024_oversamp1/DECaLS_DR3_band_r_nside1024_oversamp1_nccd1__total.fits
> Projection nccd2  total  took : 17.57 sec for 908419 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//BASS_DR4/nside1024_oversamp1/BASS_DR4_band_r_nside1024_oversamp1_nccd2__total.fits
Area of sample DECaLS_DR3  is  3046.0  sq. deg.
Area of sample BASS_DR4  is  2978.0  sq. deg.
The total JOINT area is  6008.0 sq. deg.
The INTERSECTING area is  16.0  sq. deg.
Out[5]:

In [3]:
verbose=False
sample1 = mysample('DECaLS','DR3','z',localdir,verbose)
sample2 = mysample('MZLS','DR4','z',localdir,verbose)
fname = v3p5_Areas(sample1,sample2)
fig = Image(filename=(fname))
fig


WARNING: (MARCM:) Current ccd image may have wrong corner assignments in quicksip
> Projection nccd1  total  took : 38.14 sec for 2086258 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//DECaLS_DR3/nside1024_oversamp1/DECaLS_DR3_band_z_nside1024_oversamp1_nccd1__total.fits
> Projection nccd2  total  took : 18.47 sec for 1014477 pixels
Creating and writing /global/homes/m/manera/DESI/validation-outputs//MZLS_DR4/nside1024_oversamp1/MZLS_DR4_band_z_nside1024_oversamp1_nccd2__total.fits
Area of sample DECaLS_DR3  is  6840.0  sq. deg.
Area of sample MZLS_DR4  is  3326.0  sq. deg.
The total JOINT area is  10138.0 sq. deg.
The INTERSECTING area is  28.0  sq. deg.
Out[3]:

OLD TEST Read Header and files


In [1]:
import numpy as np
import healpy as hp
import astropy.io.fits as pyfits
from multiprocessing import Pool
import matplotlib as mpl
## mpl.use('Agg')
import matplotlib.pyplot as plt

from quicksipManera import *

In [2]:
inputdir='/project/projectdirs/cosmo/data/legacysurvey/dr3/'
localdir = '/global/homes/m/manera/DESI/validation-outputs/' 
fname = inputdir+'ccds-annotated-decals.fits.gz'

In [ ]:
# Obtain Header and DATA 
tbdataDR3 = pyfits.open(fname)[1].data
headerDR3=pyfits.open(fname)[1].header
print len(tbdataDR3)
headerDR3

In [3]:
# Compare extinction values 
gdepth=tbdataDR3['galdepth'][indsDR3]
ebv=tbdataDR3['EBV'][indsDR3]
exti=tbdataDR3['decam_extinction'][indsDR3][:,1]
print ebv
print exti #compare exti with ebv*3.303

In [ ]:
# Select particular indices
indsDR4 = np.where((tbdataDR3['filter'] == 'g') & (tbdataDR3['photometric'] == True) & (tbdataDR3['blacklist_ok'] == True))
print np.size(indsDR3)

In [ ]:
# Inspect one item
ic=69720
print tbdataDR3['galdepth'][ic]
print tbdataDR3['height'][ic]
print tbdataDR3['CRPIX1'][ic]
print tbdataDR3['CD1_2'][ic]
print tbdataDR3['CRVAL1'][ic], tbdataDR3['CRVAL2'][ic]
print tbdataDR3['RA0'][ic], tbdataDR3['RA1'][ic],tbdataDR3['RA2'][ic], tbdataDR3['RA3'][ic]
print tbdataDR3['DEC0'][ic], tbdataDR3['DEC1'][ic],tbdataDR3['DEC2'][ic], tbdataDR3['DEC3'][ic]
print tbdataDR3['RA'][ic], tbdataDR3['DEC'][ic]
print tbdataDR3['decam_extinction'][ic]

OLD TEST :Compare extinction corrected magnitudes obtained in various ways


In [12]:
def nanomaggiesToMag(nm):
        return -2.5 * (log(nm,10.) - 9.)
def Magtonanomaggies(m):
        return 10.**(-m/2.5+9.)

In [13]:
# Way 1 
    ext = 0.13
    mag = 22.5
    detsig1 = Magtonanomaggies(mag)/5. #total noise
    signalext = 1./10.**(-ext/2.5)
    nmagNew=detsig1*signalext
    print nmagNew


0.225439491235

In [14]:
# Way 2
    ext = 0.13
    mag = 22.5
    mag2 = mag -ext
    detsig1 = Magtonanomaggies(mag2)/5. #total noise
    nmagNew=detsig1
    print nmagNew


0.225439491235