diff --git a/ChangeLog b/ChangeLog index 2ff6f52..d8d1a3f 100644 --- a/ChangeLog +++ b/ChangeLog @@ -1,9 +1,19 @@ -2015-03-28 Juergen Knoedlseder +2015-06-09 Juergen Knoedlseder - * Version 1.0.0 released + * Version 0.10.0 released + ========================= + + Check existence of ROI in ctbin (#1476) + Allocate optimizer in ctlike upon construction (#1471) + Move cscripts into the ctools Python module (#1470) + + +2015-05-22 Juergen Knoedlseder + + * Version 0.9.0 released ======================== - Adapt to GammaLib 1.0.0 interface + Adapt to GammaLib 0.10.0 interface Do not import automatically Python scripts Support INDEF/NONE/UNDEF/UNDEFINED parameters in ctselect Modify cssens parameter interface (#1426) @@ -12,6 +22,9 @@ Allow ctmodel usage for stacked analysis from command line Correct rate check in ctobssim for map cubes (#1452) Handle background cubes for stacked analysis (#1371) + Add csspec script (#1364) + Add cslightcrv script (#1365) + Correct sensitivity computation in cssens 2015-01-08 Juergen Knoedlseder diff --git a/NEWS b/NEWS index d133223..bfecfa4 100644 --- a/NEWS +++ b/NEWS @@ -1,15 +1,15 @@ -New Features and Important Changes in ctools 1.0.0 +New Features and Important Changes in ctools 0.10.0 Author(s) : Juergen Knoedlseder -28 March 2015 +9 June 2015 1. Introduction --------------- This document briefly summarizes executable by executable the most important changes made since the last release of ctools. The code complies to GammaLib -version 1.0.0 or above. +version 0.11.0 or above. 2. Configuration @@ -19,11 +19,8 @@ None 3. Python interface ------------------- -The ctools module does no longer import automatically Python scripts. This -prevents to break the ctools interface in case that some dependencies in -the scripts are broken. Scripts (such as obsutils, analysisutils or plotutils) -are support scripts that may not be fully supported throughout the -development. They may be moved into a special contributions area in the future. +The cscripts have been moved to the ctools module. Now everything is comprised +in that module. 4. Support model @@ -33,31 +30,29 @@ None 5. ctobssim - CTA observation simulation ---------------------------------------- -The rate check is now also correctly done for map cubes. Before, the rate check -made simulations with a diffuse map cube fail (#1452). +None 6. ctselect - CTA event selection --------------------------------- -If INDEF, UNDEF, NONE or UNDEFINED are passed for the selection parameters, no -selection will be performed. +None 7. ctbin - CTA event binning ---------------------------- -None +ctbin now verifies if an ROI has been set properly, and throws an exception in +case that no ROI information could be found. 8. ctlike - Maximum likelihood fitting -------------------------------------- -The bkgcube parameter has been added to allow specification of a background -cube for stacked analysis. +The optimizer is now allocated upon construction so that ctlike always returns a +meaningful object using the opt() method. 9. cttsmap - Generation of Test Statistics map ---------------------------------------------- -The bkgcube parameter has been added to allow specification of a background -cube for stacked analysis. +None 10. ctskymap - CTA sky mapping @@ -67,14 +62,7 @@ None 11. ctmodel - CTA counts cube modelling --------------------------------------- -The ctmodel tool can now be used for stacked analysis from the command line. -It directly makes use of the cube response to compute the model without using -the original IRF information. This makes generation of model cubes substantially -faster. The old method of accessing the IRF response for model computation is -still possible. - -The bkgcube parameter has been added to allow specification of a background -cube for stacked analysis. +None 12. ctexpcube - CTA exposure cube generation @@ -99,16 +87,12 @@ None 16. ctbutterfly - Generate butterfly diagrams --------------------------------------------- -The bkgcube parameter has been added to allow specification of a background -cube for stacked analysis. +None 17. ctulimit - Compute upper limit ---------------------------------- -Added an initial version of the upper limit computation tool. - -The bkgcube parameter has been added to allow specification of a background -cube for stacked analysis. +None 18. Examples @@ -118,16 +102,7 @@ None 19. Scripts ----------- -The user parameter interface of cssens has been modified. The script -now reads a source model that is used for sensitivity estimation. -This provides more flexibility in the choice of the model for -sensitivity estimation. - -The csobsdef script has been added that allows creation of observation -definition XML files from colon separated value ASCII files. The -observation definition files from csobsdef can be fed to ctobssim for -simulation of multiple pointings in one shot. This enables for example -survey observations to be simulated in a single ctobssim run. +None 20. caldb diff --git a/README b/README index 1b51830..aa84080 100644 --- a/README +++ b/README @@ -1,8 +1,8 @@ ctools information ================== -Version: 00-08-01 (8 January 2015) +Version: 0.9.0 (20 May 2015) Author: Juergen Knodlseder (jurgen.knodlseder@irap.omp.eu) -GammaLib dependency: 00-09-00 +GammaLib dependency: 0.10.0 License information @@ -34,20 +34,27 @@ for the high-level analysis of astronomical gamma-ray data. The following tools are available: - ctbin - event binning - ctlike - maximum likelihood model fitting - ctmodel - generation of model counts map - ctobssim - simulation of CTA observations - ctselect - event selection - ctskymap - CTA sky mapping tool + ctbin - event binning + ctbkgcube - generate a background cube + ctbutterfly - create a butterfly + ctcubemask - mask bins in binned analysis + ctexpcube - generate an exposure cube + ctlike - maximum likelihood model fitting + ctmodel - generation of model counts map + ctobssim - simulation of CTA observations + ctpsfcube - generate a PSF cube + ctselect - event selection + ctskymap - CTA sky mapping tool + cttsmap - generate a TS map + ctulimit - compute upper limits Web sites ========= -http://cta.irap.omp.eu/ctools - ctools documentation -https://cta-redmine.irap.omp.eu/projects/ctools - for ctools development -http://gammalib.sourceforge.net - for GammaLib documentation -https://sourceforge.net/projects/gammalib/ - for GammaLib downloads +http://cta.irap.omp.eu/ctools - ctools documentation +https://cta-redmine.irap.omp.eu/projects/ctools - for ctools development +https://cta-redmine.irap.omp.eu/projects/gammalib - for GammaLib documentation +https://sourceforge.net/projects/gammalib/ - for GammaLib downloads Prerequisites diff --git a/caldb/Makefile.am b/caldb/Makefile.am index 4d26926..b1aff4c 100644 --- a/caldb/Makefile.am +++ b/caldb/Makefile.am @@ -1,12 +1,18 @@ ## Process this file with automake to produce Makefile.in # Calibration files to distribute -caldb_indx = caldb.indx -caldb_irf = cta_dummy_irf.dat - -# Distribute calibration database files -EXTRA_DIST = $(caldb_indx) $(caldb_irf) -caldbindxdir = $(datadir)/caldb/data/cta/dummy -caldbindx_DATA = $(caldb_indx) -caldbirfdir = $(datadir)/caldb/data/cta/dummy/bcf -caldbirf_DATA = $(caldb_irf) +caldb_prod2_indxdir = $(datadir)/caldb/data/cta/prod2 +caldb_prod2_indx_DATA = data/cta/prod2/caldb.indx +caldb_prod2_north1dir = $(datadir)/caldb/data/cta/prod2/bcf/North_0.5h +caldb_prod2_north1_DATA = data/cta/prod2/bcf/North_0.5h/irf_file.fits.gz +caldb_prod2_north2dir = $(datadir)/caldb/data/cta/prod2/bcf/North_5h +caldb_prod2_north2_DATA = data/cta/prod2/bcf/North_5h/irf_file.fits.gz +caldb_prod2_north3dir = $(datadir)/caldb/data/cta/prod2/bcf/North_50h +caldb_prod2_north3_DATA = data/cta/prod2/bcf/North_50h/irf_file.fits.gz +# +caldb_prod2_south1dir = $(datadir)/caldb/data/cta/prod2/bcf/South_0.5h +caldb_prod2_south1_DATA = data/cta/prod2/bcf/South_0.5h/irf_file.fits.gz +caldb_prod2_south2dir = $(datadir)/caldb/data/cta/prod2/bcf/South_5h +caldb_prod2_south2_DATA = data/cta/prod2/bcf/South_5h/irf_file.fits.gz +caldb_prod2_south3dir = $(datadir)/caldb/data/cta/prod2/bcf/South_50h +caldb_prod2_south3_DATA = data/cta/prod2/bcf/South_50h/irf_file.fits.gz diff --git a/caldb/caldb.indx b/caldb/caldb.indx deleted file mode 100644 index 5aa32fc..0000000 --- a/caldb/caldb.indx +++ /dev/null @@ -1 +0,0 @@ -SIMPLE = T / file does conform to FITS standard BITPIX = 8 / number of bits per data pixel NAXIS = 0 / number of data axes EXTEND = T / FITS dataset may contain extensions COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H END XTENSION= 'BINTABLE' / binary table extension BITPIX = 8 / 8-bit bytes NAXIS = 2 / 2-dimensional binary table NAXIS1 = 945 / width of table in bytes NAXIS2 = 4 / number of rows in table PCOUNT = 0 / size of special data area GCOUNT = 1 / one data group (required keyword) TFIELDS = 18 / number of fields in each row TTYPE1 = 'TELESCOP' / label for field 1 TFORM1 = '10A ' / data format of field: ASCII Character TTYPE2 = 'INSTRUME' / label for field 2 TFORM2 = '10A ' / data format of field: ASCII Character TTYPE3 = 'DETNAM ' / label for field 3 TFORM3 = '20A ' / data format of field: ASCII Character TTYPE4 = 'FILTER ' / label for field 4 TFORM4 = '10A ' / data format of field: ASCII Character TTYPE5 = 'CAL_DEV ' / label for field 5 TFORM5 = '20A ' / data format of field: ASCII Character TTYPE6 = 'CAL_DIR ' / label for field 6 TFORM6 = '70A ' / data format of field: ASCII Character TTYPE7 = 'CAL_FILE' / label for field 7 TFORM7 = '40A ' / data format of field: ASCII Character TTYPE8 = 'CAL_CLAS' / label for field 8 TFORM8 = '3A ' / data format of field: ASCII Character TTYPE9 = 'CAL_DTYP' / label for field 9 TFORM9 = '4A ' / data format of field: ASCII Character TTYPE10 = 'CAL_CNAM' / label for field 10 TFORM10 = '20A ' / data format of field: ASCII Character TTYPE11 = 'CAL_CBD ' / label for field 11 TFORM11 = '630A70 ' / data format of field: ASCII Character TTYPE12 = 'CAL_XNO ' / label for field 12 TFORM12 = '1I ' / data format of field: 2-byte INTEGER TTYPE13 = 'CAL_VSD ' / label for field 13 TFORM13 = '10A ' / data format of field: ASCII Character TTYPE14 = 'CAL_VST ' / label for field 14 TFORM14 = '8A ' / data format of field: ASCII Character TTYPE15 = 'REF_TIME' / label for field 15 TFORM15 = '1D ' / data format of field: 8-byte DOUBLE TTYPE16 = 'CAL_QUAL' / label for field 16 TFORM16 = '1I ' / data format of field: 2-byte INTEGER TTYPE17 = 'CAL_DATE' / label for field 17 TFORM17 = '8A ' / data format of field: ASCII Character TTYPE18 = 'CAL_DESC' / label for field 18 TFORM18 = '70A ' / data format of field: ASCII Character EXTNAME = 'CIF ' / name of this extension CIFVERSN= '1992a ' / Version of CIF format HISTORY File modified by user 'jurgen' with fv on 2014-02-20T15:10:40 END CTA DUMMY NONE NONE ONLINE data/cta/dummy/bcf cta_dummy_irf.dat BCFDATAEFF_AREA NAME(cta_dummy_irf) VERSION(Prod1) CLASS(BEST) ANALYSIS(MPIK) NONE NONE NONE NONE NONE 2014-01-0100:00:00@é+14/01/01CTA effective area CTA DUMMY NONE NONE ONLINE data/cta/dummy/bcf cta_dummy_irf.dat BCFDATARPSF NAME(cta_dummy_irf) VERSION(Prod1) CLASS(BEST) ANALYSIS(MPIK) NONE NONE NONE NONE NONE 2014-01-0100:00:00@é+14/01/01CTA point spread function CTA DUMMY NONE NONE ONLINE data/cta/dummy/bcf cta_dummy_irf.dat BCFDATAEDISP NAME(cta_dummy_irf) VERSION(Prod1) CLASS(BEST) ANALYSIS(MPIK) NONE NONE NONE NONE NONE 2014-01-0100:00:00@é+14/01/01CTA energy dispersion CTA DUMMY NONE NONE ONLINE data/cta/dummy/bcf cta_dummy_irf.dat BCFDATABGD NAME(cta_dummy_irf) VERSION(Prod1) CLASS(BEST) ANALYSIS(MPIK) NONE NONE NONE NONE NONE 2014-01-0100:00:00@é+14/01/01CTA background \ No newline at end of file diff --git a/caldb/cta_dummy_irf.dat b/caldb/cta_dummy_irf.dat deleted file mode 100644 index 0b6e757..0000000 --- a/caldb/cta_dummy_irf.dat +++ /dev/null @@ -1,32 +0,0 @@ -log(E) Area r68 r80 ERes. BG Rate Diff Sens --1.7 261.6 0.3621 0.4908 0.5134 1.89924e-02 6.88237e-11 --1.5 5458.2 0.2712 0.3685 0.4129 1.00972e-01 1.72717e-11 --1.3 15590.0 0.1662 0.2103 0.2721 5.75623e-02 6.16963e-12 --1.1 26554.1 0.1253 0.1567 0.2611 2.13008e-02 2.89932e-12 --0.9 52100.5 0.1048 0.1305 0.1987 8.87292e-03 1.39764e-12 --0.7 66132.1 0.0827 0.1024 0.1698 1.09756e-03 6.03531e-13 --0.5 108656.8 0.0703 0.0867 0.1506 4.84287e-04 3.98147e-13 --0.3 129833.0 0.0585 0.0722 0.1338 1.57546e-04 3.23090e-13 --0.1 284604.3 0.0531 0.0656 0.1008 1.36703e-04 2.20178e-13 -0.1 263175.3 0.0410 0.0506 0.0831 2.09694e-05 1.87452e-13 -0.3 778048.6 0.0470 0.0591 0.0842 6.92374e-05 1.53976e-13 -0.5 929818.8 0.0391 0.0492 0.0650 1.45844e-05 1.18947e-13 -0.7 1078450.0 0.0335 0.0415 0.0541 1.15959e-05 1.51927e-13 -0.9 1448579.1 0.0317 0.0397 0.0516 4.71231e-06 1.42439e-13 -1.1 1899905.0 0.0290 0.0372 0.0501 8.14997e-06 1.96670e-13 -1.3 2476403.8 0.0285 0.0367 0.0538 5.91940e-06 2.20695e-13 -1.5 2832570.6 0.0284 0.0372 0.0636 7.33847e-06 3.22523e-13 -1.7 3534065.3 0.0290 0.0386 0.0731 1.34549e-05 4.84153e-13 -1.9 3250103.4 0.0238 0.0308 0.0729 4.42228e-06 6.26265e-13 -2.1 3916071.6 0.0260 0.0354 0.0908 2.26648e-06 7.69921e-13 ---------------------------------------------- -Notes - 1) log(E) = log10(E/TeV) - bin centre - 2) Eff Area - in square metres after background cut (no theta cut) - 3) Ang. Res - 68% containment radius of gamma-ray PSF post cuts - in degrees - 4) Ang. Res - 80% containment radius of gamma-ray PSF post cuts - in degrees - 5) Fractional Energy Resolution (rms) - 6) BG Rate - inside point-source selection region - post call cuts - in Hz - 7) Diff Sens - differential sensitivity for this bin expressed as E^2 dN/dE - - in erg cm^-2 s^-1 - for a 50 hours exposure - 5 sigma significance including - systematics and statistics and at least 10 photons. diff --git a/caldb/data/cta/prod2/bcf/North_0.5h/irf_file.fits.gz b/caldb/data/cta/prod2/bcf/North_0.5h/irf_file.fits.gz new file mode 100644 index 0000000..b4f12a7 --- /dev/null +++ b/caldb/data/cta/prod2/bcf/North_0.5h/irf_file.fits.gz diff --git a/caldb/data/cta/prod2/bcf/North_50h/irf_file.fits.gz b/caldb/data/cta/prod2/bcf/North_50h/irf_file.fits.gz new file mode 100644 index 0000000..1650c4c --- /dev/null +++ b/caldb/data/cta/prod2/bcf/North_50h/irf_file.fits.gz diff --git a/caldb/data/cta/prod2/bcf/North_5h/irf_file.fits.gz b/caldb/data/cta/prod2/bcf/North_5h/irf_file.fits.gz new file mode 100644 index 0000000..668517d --- /dev/null +++ b/caldb/data/cta/prod2/bcf/North_5h/irf_file.fits.gz diff --git a/caldb/data/cta/prod2/bcf/South_0.5h/irf_file.fits.gz b/caldb/data/cta/prod2/bcf/South_0.5h/irf_file.fits.gz new file mode 100644 index 0000000..a68857d --- /dev/null +++ b/caldb/data/cta/prod2/bcf/South_0.5h/irf_file.fits.gz diff --git a/caldb/data/cta/prod2/bcf/South_50h/irf_file.fits.gz b/caldb/data/cta/prod2/bcf/South_50h/irf_file.fits.gz new file mode 100644 index 0000000..e9e0aa4 --- /dev/null +++ b/caldb/data/cta/prod2/bcf/South_50h/irf_file.fits.gz diff --git a/caldb/data/cta/prod2/bcf/South_5h/irf_file.fits.gz b/caldb/data/cta/prod2/bcf/South_5h/irf_file.fits.gz new file mode 100644 index 0000000..8e7f24d --- /dev/null +++ b/caldb/data/cta/prod2/bcf/South_5h/irf_file.fits.gz diff --git a/caldb/data/cta/prod2/caldb.indx b/caldb/data/cta/prod2/caldb.indx new file mode 100644 index 0000000..65afbf1 --- /dev/null +++ b/caldb/data/cta/prod2/caldb.indx @@ -0,0 +1 @@ +SIMPLE = T / file does conform to FITS standard BITPIX = 8 / number of bits per data pixel NAXIS = 0 / number of data axes EXTEND = T / FITS dataset may contain extensions COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H COMMENT FITS (Flexible Image Transport System) format is defined in 'AstronomyCOMMENT and Astrophysics', volume 376, page 359; bibcode: 2001A&A...376..359H END XTENSION= 'BINTABLE' / binary table extension BITPIX = 8 / 8-bit bytes NAXIS = 2 / 2-dimensional binary table NAXIS1 = 945 / width of table in bytes NAXIS2 = 24 / number of rows in table PCOUNT = 0 / size of special data area GCOUNT = 1 / one data group (required keyword) TFIELDS = 18 / number of fields in each row TTYPE1 = 'TELESCOP' / label for field 1 TFORM1 = '10A ' / data format of field: ASCII Character TTYPE2 = 'INSTRUME' / label for field 2 TFORM2 = '10A ' / data format of field: ASCII Character TTYPE3 = 'DETNAM ' / label for field 3 TFORM3 = '20A ' / data format of field: ASCII Character TTYPE4 = 'FILTER ' / label for field 4 TFORM4 = '10A ' / data format of field: ASCII Character TTYPE5 = 'CAL_DEV ' / label for field 5 TFORM5 = '20A ' / data format of field: ASCII Character TTYPE6 = 'CAL_DIR ' / label for field 6 TFORM6 = '70A ' / data format of field: ASCII Character TTYPE7 = 'CAL_FILE' / label for field 7 TFORM7 = '40A ' / data format of field: ASCII Character TTYPE8 = 'CAL_CLAS' / label for field 8 TFORM8 = '3A ' / data format of field: ASCII Character TTYPE9 = 'CAL_DTYP' / label for field 9 TFORM9 = '4A ' / data format of field: ASCII Character TTYPE10 = 'CAL_CNAM' / label for field 10 TFORM10 = '20A ' / data format of field: ASCII Character TTYPE11 = 'CAL_CBD ' / label for field 11 TFORM11 = '630A70 ' / data format of field: ASCII Character TTYPE12 = 'CAL_XNO ' / label for field 12 TFORM12 = '1I ' / data format of field: 2-byte INTEGER TTYPE13 = 'CAL_VSD ' / label for field 13 TFORM13 = '10A ' / data format of field: ASCII Character TTYPE14 = 'CAL_VST ' / label for field 14 TFORM14 = '8A ' / data format of field: ASCII Character TTYPE15 = 'REF_TIME' / label for field 15 TFORM15 = '1D ' / data format of field: 8-byte DOUBLE TTYPE16 = 'CAL_QUAL' / label for field 16 TFORM16 = '1I ' / data format of field: 2-byte INTEGER TTYPE17 = 'CAL_DATE' / label for field 17 TFORM17 = '8A ' / data format of field: ASCII Character TTYPE18 = 'CAL_DESC' / label for field 18 TFORM18 = '70A ' / data format of field: ASCII Character EXTNAME = 'CIF ' / name of this extension CIFVERSN= '1992a ' / Version of CIF format END CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_0.5h irf_file.fits BCFDATAEFF_AREA NAME(South_0.5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0050-501.19)TeV THETA(0.00-4.50)deg PHI(0-360)deg NONE NONE 2015-05-1800:00:00@é+15/05/18CTA effective area CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_0.5h irf_file.fits BCFDATARPSF NAME(South_0.5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0126-199.53)TeV THETA(0.00-9.00)deg PHI(0-360)deg PSF(GAUSS) NONE 2015-05-1800:00:00@é+15/05/18CTA point spread function CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_0.5h irf_file.fits BCFDATAEDISP NAME(South_0.5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ETRUE(0.0050-501.19)TeV MIGRA(0.0000-3.00) THETA(0.00-9.00)deg PHI(0-360)deg NONE 2015-05-1800:00:00@é+15/05/18CTA energy dispersion CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_0.5h irf_file.fits BCFDATABGD NAME(South_0.5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) DETX(-4.50-4.50)deg DETY(-4.50-4.50)deg ENERG(0.0126-199.53)TeV NONE NONE 2015-05-1800:00:00@é+15/05/18CTA background CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_5h irf_file.fits BCFDATAEFF_AREA NAME(South_5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0050-501.19)TeV THETA(0.00-4.50)deg PHI(0-360)deg NONE NONE 2015-05-1800:00:00@é+15/05/18CTA effective area CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_5h irf_file.fits BCFDATARPSF NAME(South_5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0126-199.53)TeV THETA(0.00-9.00)deg PHI(0-360)deg PSF(GAUSS) NONE 2015-05-1800:00:00@é+15/05/18CTA point spread function CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_5h irf_file.fits BCFDATAEDISP NAME(South_5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ETRUE(0.0050-501.19)TeV MIGRA(0.0000-3.00) THETA(0.00-9.00)deg PHI(0-360)deg NONE 2015-05-1800:00:00@é+15/05/18CTA energy dispersion CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_5h irf_file.fits BCFDATABGD NAME(South_5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) DETX(-4.50-4.50)deg DETY(-4.50-4.50)deg ENERG(0.0126-199.53)TeV NONE NONE 2015-05-1800:00:00@é+15/05/18CTA background CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_50h irf_file.fits BCFDATAEFF_AREA NAME(South_50h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0050-501.19)TeV THETA(0.00-4.50)deg PHI(0-360)deg NONE NONE 2015-05-1800:00:00@é+15/05/18CTA effective area CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_50h irf_file.fits BCFDATARPSF NAME(South_50h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0126-199.53)TeV THETA(0.00-9.00)deg PHI(0-360)deg PSF(GAUSS) NONE 2015-05-1800:00:00@é+15/05/18CTA point spread function CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_50h irf_file.fits BCFDATAEDISP NAME(South_50h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ETRUE(0.0050-501.19)TeV MIGRA(0.0000-3.00) THETA(0.00-9.00)deg PHI(0-360)deg NONE 2015-05-1800:00:00@é+15/05/18CTA energy dispersion CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/South_50h irf_file.fits BCFDATABGD NAME(South_50h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) DETX(-4.50-4.50)deg DETY(-4.50-4.50)deg ENERG(0.0126-199.53)TeV NONE NONE 2015-05-1800:00:00@é+15/05/18CTA background CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_0.5h irf_file.fits BCFDATAEFF_AREA NAME(North_0.5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0050-501.19)TeV THETA(0.00-4.50)deg PHI(0-360)deg NONE NONE 2015-05-1800:00:00@é+15/05/18CTA effective area CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_0.5h irf_file.fits BCFDATARPSF NAME(North_0.5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0126-199.53)TeV THETA(0.00-9.00)deg PHI(0-360)deg PSF(GAUSS) NONE 2015-05-1800:00:00@é+15/05/18CTA point spread function CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_0.5h irf_file.fits BCFDATAEDISP NAME(North_0.5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ETRUE(0.0050-501.19)TeV MIGRA(0.0000-3.00) THETA(0.00-9.00)deg PHI(0-360)deg NONE 2015-05-1800:00:00@é+15/05/18CTA energy dispersion CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_0.5h irf_file.fits BCFDATABGD NAME(North_0.5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) DETX(-4.50-4.50)deg DETY(-4.50-4.50)deg ENERG(0.0126-199.53)TeV NONE NONE 2015-05-1800:00:00@é+15/05/18CTA background CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_5h irf_file.fits BCFDATAEFF_AREA NAME(North_5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0050-501.19)TeV THETA(0.00-4.50)deg PHI(0-360)deg NONE NONE 2015-05-1800:00:00@é+15/05/18CTA effective area CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_5h irf_file.fits BCFDATARPSF NAME(North_5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0126-199.53)TeV THETA(0.00-9.00)deg PHI(0-360)deg PSF(GAUSS) NONE 2015-05-1800:00:00@é+15/05/18CTA point spread function CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_5h irf_file.fits BCFDATAEDISP NAME(North_5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ETRUE(0.0050-501.19)TeV MIGRA(0.0000-3.00) THETA(0.00-9.00)deg PHI(0-360)deg NONE 2015-05-1800:00:00@é+15/05/18CTA energy dispersion CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_5h irf_file.fits BCFDATABGD NAME(North_5h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) DETX(-4.50-4.50)deg DETY(-4.50-4.50)deg ENERG(0.0126-199.53)TeV NONE NONE 2015-05-1800:00:00@é+15/05/18CTA background CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_50h irf_file.fits BCFDATAEFF_AREA NAME(North_50h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0050-501.19)TeV THETA(0.00-4.50)deg PHI(0-360)deg NONE NONE 2015-05-1800:00:00@é+15/05/18CTA effective area CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_50h irf_file.fits BCFDATARPSF NAME(North_50h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ENERG(0.0126-199.53)TeV THETA(0.00-9.00)deg PHI(0-360)deg PSF(GAUSS) NONE 2015-05-1800:00:00@é+15/05/18CTA point spread function CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_50h irf_file.fits BCFDATAEDISP NAME(North_50h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) ETRUE(0.0050-501.19)TeV MIGRA(0.0000-3.00) THETA(0.00-9.00)deg PHI(0-360)deg NONE 2015-05-1800:00:00@é+15/05/18CTA energy dispersion CTA PROD2 NONE NONE ONLINE data/cta/prod2/bcf/North_50h irf_file.fits BCFDATABGD NAME(North_50h) VERSION(Prod2) CLASS(BEST) ANALYSIS(IFAE) DETX(-4.50-4.50)deg DETY(-4.50-4.50)deg ENERG(0.0126-199.53)TeV NONE NONE 2015-05-1800:00:00@é+15/05/18CTA background \ No newline at end of file diff --git a/configure.ac b/configure.ac index 9442b21..e976bac 100644 --- a/configure.ac +++ b/configure.ac @@ -29,7 +29,7 @@ ############################################################################# # Initialisation # ############################################################################# -AC_INIT([ctools], [1.0.0], [jurgen.knodlseder@irap.omp.eu], [ctools]) +AC_INIT([ctools], [0.9.0], [jurgen.knodlseder@irap.omp.eu], [ctools]) AC_CONFIG_SRCDIR([src/ctselect/ctselect.cpp]) AC_CONFIG_MACRO_DIR([m4]) #AM_INIT_AUTOMAKE([gnu no-dependencies]) @@ -749,8 +749,8 @@ darwin_kluge=no # Detect if GammaLib has been compiled with OpenMP AC_MSG_CHECKING(whether GammaLib has been compiled with OpenMP) AC_LINK_IFELSE([AC_LANG_PROGRAM([[#include ]],,)], - [gammalib_with_openmp=no;AC_MSG_RESULT(no)], - [gammalib_with_openmp=yes;AC_MSG_RESULT(yes)]) + [gammalib_with_openmp=no;AC_MSG_RESULT(no)], + [gammalib_with_openmp=yes;AC_MSG_RESULT(yes)]) # Check if openMP is available m4_ifdef([AC_OPENMP],[AC_OPENMP], [AX_OPENMP([openmp_ok=yes],[openmp_ok=no])]) diff --git a/ctools.pc.in b/ctools.pc.in index f150c20..64914cb 100644 --- a/ctools.pc.in +++ b/ctools.pc.in @@ -6,9 +6,9 @@ includedir=${prefix}/include Name: ctools Description: CTA science analysis tools URL: http://cta.irap.omp.eu/ctools -Version: 1.0.0 +Version: 0.9.0 Requires: -Requires.private: gammalib >= 1.0.0 +Requires.private: gammalib >= 0.10.0 Conflicts: Cflags: -I${includedir}/ctools @OPENMP_CXXFLAGS@ Libs: -L${libdir} -lctools diff --git a/doc/Doxyfile b/doc/Doxyfile index da6b3e5..ddd3e86 100644 --- a/doc/Doxyfile +++ b/doc/Doxyfile @@ -32,7 +32,7 @@ PROJECT_NAME = ctools # This could be handy for archiving the generated documentation or # if some version control system is used. -PROJECT_NUMBER = 1.0.0 +PROJECT_NUMBER = 0.9.0 # Using the PROJECT_BRIEF tag one can provide an optional one line description # for a project that appears at the top of each page and should give viewer diff --git a/doc/source/_templates/index.html b/doc/source/_templates/index.html index 415a253..2456023 100644 --- a/doc/source/_templates/index.html +++ b/doc/source/_templates/index.html @@ -2,8 +2,6 @@ body %}

{{ _('ctools') }}

-

{%trans%}About{%endtrans%}

-

{%trans%} ctools is a software package developed for the scientific analysis of Cherenkov Telescope Array (CTA) data. Analysis of data from existing Imaging Air Cherenkov Telescopes (such as H.E.S.S., MAGIC or diff --git a/doc/source/_themes/sphinx13/layout.html b/doc/source/_themes/sphinx13/layout.html index 6bee1fc..37b2cf4 100644 --- a/doc/source/_themes/sphinx13/layout.html +++ b/doc/source/_themes/sphinx13/layout.html @@ -67,6 +67,7 @@ {% block header %}

    +
  • About
  • Home
  • Download
  • Documentation
    • diff --git a/doc/source/about.rst b/doc/source/about.rst new file mode 100644 index 0000000..f92cc93 --- /dev/null +++ b/doc/source/about.rst @@ -0,0 +1,57 @@ +.. _about: + +About +===== + +ctools is a software package developed for the scientific analysis of +Cherenkov Telescope Array (CTA) data. +Analysis of data from existing Imaging Air Cherenkov Telescopes (such as +H.E.S.S., MAGIC or VERITAS) is also supported, provided that the data and +response functions are available in the format defined for CTA. + +ctools comprises a set of ftools-like binary executables with a +command-line interface allowing for interactive step-wise data analysis. +ctools includes also a Python module allowing to control all executables. +Creation of shell or Python scripts and pipelines is supported. +ctools provides cscripts, which are Python scripts complementing the +binary executables. +Extensions of the ctools package by user defined binary executables or +Python scripts is supported. + +ctools are based on GammaLib, a versatile toolbox for the high-level +analysis of astronomical gamma-ray data. +Besides CTA, GammaLib supports also the analysis of Fermi/LAT and COMPTEL +data, and extensions to support further gamma-ray instruments are planned. +An interface to virtual observatory ressources is also in preparation. +By making use of the GammaLib multi-instrument capabilities, ctools +supports the joint analysis of CTA (or any IACT providing data in the +CTA format), Fermi/LAT and COMPTEL data. + + +Acknowledging or citing ctools +------------------------------ + +If you use ctools for work/research presented in a publication we ask you +that you include the following standard acknowledgment: + + *This research made use of ctools, a community-developed analysis package + for Imaging Air Cherenkov Telescope data. ctools is based on GammaLib, + a community-developed toolbox for the high-level analysis of astronomical + gamma-ray data.* + + +If you wish, you can also include a link to http://cta.irap.omp.eu/ctools/ +(if the journal allows this) in addition to the above text. + +If you are giving a presentation or talk featuring work/research that makes +use of ctools, we suggest using this logo on your title slide: + +.. figure:: ctools-logo.jpg + :width: 150px + :align: center + + +License +------- + +ctools is free software distributed under the GNU GPL license version 3. diff --git a/doc/source/conf.py b/doc/source/conf.py index 0288704..95c7cfa 100644 --- a/doc/source/conf.py +++ b/doc/source/conf.py @@ -66,10 +66,10 @@ copyright = u'2014-2015, ctools developers' # built documents. # # The short X.Y version. -version = '1.0' +version = '0.9' # The full version, including alpha/beta/rc tags. -release = '1.0.0' +release = '0.9.0' # The language for content autogenerated by Sphinx. Refer to documentation # for a list of supported languages. diff --git a/doc/source/ctools-logo.jpg b/doc/source/ctools-logo.jpg new file mode 100644 index 0000000..772ccc5 --- /dev/null +++ b/doc/source/ctools-logo.jpg diff --git a/doc/source/download.rst b/doc/source/download.rst index 8d4f056..d6a6bf5 100644 --- a/doc/source/download.rst +++ b/doc/source/download.rst @@ -13,7 +13,7 @@ bugs. Releases -------- -The latest ctools release is ``ctools-00-08-01`` (8 January 2015). +The latest ctools release is ``ctools-0.9.0`` (22 May 2015). Below a table of ctools releases. Please note that at this stage of the project there is a strict link between the ctools and gammalib versions. @@ -28,6 +28,9 @@ gammalib. * - `ctools `_ - `gammalib `_ - Mac OS X package + * - `0.9.0 `_ + - `0.10.0 `_ + - `ctools-0.9.0-macosx10.3.dmg `_ * - `0.8.1 `_ - `0.9.1 `_ - `ctools-00-08-01-macosx10.3.dmg `_ diff --git a/doc/source/reference_manual/cslightcrv.rst b/doc/source/reference_manual/cslightcrv.rst new file mode 100644 index 0000000..c96932e --- /dev/null +++ b/doc/source/reference_manual/cslightcrv.rst @@ -0,0 +1,138 @@ +.. _cslightcrv: + +cslightcrv +========== + +Computes a lightcurve for a given source. + + +Synopsis +-------- + +Computes a lightcurve for a given source. + + +General parameters +------------------ + +``(inobs = NONE) [file]`` + Input event list, counts cube or observation definition XML file. + +``inmodel [file]`` + Input source model XML file. + +``srcname [string]`` + Name of the source in the source model XML file which should be used + for sensitivity computation. + +``outfile [file]`` + Name of the source spectrum output file. + +``expcube [file]`` + Exposure cube file (only needed for stacked analysis). + +``psfcube [file]`` + PSF cube file (only needed for stacked analysis). + +``bkgcube [file]`` + Background cube file (only needed for stacked analysis). + +``caldb [string]`` + Calibration database. + +``irf [string]`` + Instrumental response function. + +``tmin [real]`` + Lightcurve start time (in MJD). + +``tmax [real]`` + Lightcurve stop time (in MJD). + +``tbins [integer]`` + Number of time bins. + +``(tbinalg = GTI) [string]`` + Algorithm for defining time bins. + +``tbinfile [file]`` + File defining the time binning. + +``binned [boolean]`` + Use binned analysis in each time bin. + +``enumbins [integer]`` + Number of energy bins per light curve bin (0=unbinned). + +``emin [real]`` + Lower energy limit of events (in TeV). + +``emax [real]`` + Upper energy limit of events (in TeV). + +``coordsys [string]`` + Coordinate system (CEL - celestial, GAL - galactic). + +``proj [string]`` + Projection method. + +``xref [real]`` + Right Ascension / Galactic longitude of image centre (J2000, in degrees). + +``yref [real]`` + Declination / Galactic latitude of image centre (J2000, in degrees). + +``nxpix [integer]`` + Size of the Right Ascension / Galactic longitude axis (in pixels). + +``nypix [integer]`` + Size of the Declination / Galactic latitude axis (in pixels). + +``binsz [real]`` + Pixel size (in degrees/pixel). + +``(calc_ts = yes) [boolean]`` + Compute TS value for each time bin? + +``(calc_ulim = yes) [boolean]`` + Compute upper limit for each time bin? + +``(fix_srcs = yes) [boolean]`` + Fix other sky model parameters? + +``(fix_bkg = no) [boolean]`` + Fix background model parameters? + + +Standard parameters +------------------- + +``(chatter = 2) [integer]`` + Verbosity of the executable: + chatter = 0: no information will be logged + + chatter = 1: only errors will be logged + + chatter = 2: errors and actions will be logged + + chatter = 3: report about the task execution + + chatter = 4: detailed report about the task execution + +``(clobber = yes) [boolean]`` + Specifies whether an existing output counts cube should be overwritten. + +``(debug = no) [boolean]`` + Enables debug mode. In debug mode the executable will dump any log file output to the console. + +``(mode = ql) [string]`` + Mode of automatic parameters (default is "ql", i.e. "query and learn"). + +``(logfile = cslightcrv.log) [filename]`` + Log filename. + + +Related tools +------------- + +None diff --git a/doc/source/reference_manual/csobsdef.rst b/doc/source/reference_manual/csobsdef.rst index 56a7fce..8c9086e 100644 --- a/doc/source/reference_manual/csobsdef.rst +++ b/doc/source/reference_manual/csobsdef.rst @@ -45,9 +45,9 @@ Here some usage examples: ``csobsdef rad=5`` Creates observation definition file with a ROI radius of 5 deg. -``csobsdef caldb=dummy irf=cta_dummy_irf`` - Creates observation definition file using the "cta_dummy_irf" IRF in the - "dummy" calibration database. +``csobsdef caldb=prod2 irf=South_50h`` + Creates observation definition file using the "South_50h" IRF in the + "prod2" calibration database. General parameters diff --git a/doc/source/reference_manual/cspull.rst b/doc/source/reference_manual/cspull.rst index 8e96bf2..31c04c7 100644 --- a/doc/source/reference_manual/cspull.rst +++ b/doc/source/reference_manual/cspull.rst @@ -41,6 +41,9 @@ General parameters ``irf [string]`` Instrumental response function. +``(deadc = 0.95) [real]`` + Average deadtime correction factor. + ``(edisp = no) [boolean]`` Apply energy dispersion to response computation. @@ -62,12 +65,18 @@ General parameters ``enumbins [integer]`` Number of energy bins (0=unbinned). -``duration [real]`` - Duration of observation (in seconds). +``(tmin = 0.0) [real]`` + Start time (in seconds). -``(deadc = 0.95) [real]`` - Average deadtime correction factor. +``tmax [real]`` + Stop time (in seconds). + +``npix [integer]`` + Number of pixels for binned analysis. +``binsz [real]`` + Pixel size for binned analysis. + ``(rad = 5.0) [real]`` ROI radius (in degrees). @@ -77,12 +86,6 @@ General parameters ``(offset = 1.5) [real]`` Observation pattern offset (in degrees). -``(npix = 200) [integer]`` - Number of pixels for binned analysis. - -``(binsz = 0.05) [real]`` - Pixel size for binned analysis. - Standard parameters ------------------- @@ -108,6 +111,9 @@ Standard parameters ``(mode = ql) [string]`` Mode of automatic parameters (default is "ql", i.e. "query and learn"). +``(logfile = cspull.log) [string]`` + Log filename. + Related tools ------------- diff --git a/doc/source/reference_manual/csspec.rst b/doc/source/reference_manual/csspec.rst new file mode 100644 index 0000000..d4f6665 --- /dev/null +++ b/doc/source/reference_manual/csspec.rst @@ -0,0 +1,129 @@ +.. _csspec: + +csspec +====== + +Computes spectrum for a given source. + + +Synopsis +-------- + +Computes spectral points for a given source. + + +General parameters +------------------ + +``(inobs = NONE) [file]`` + Input event list, counts cube or observation definition XML file. + +``inmodel [file]`` + Input source model XML file. + +``srcname [string]`` + Name of the source in the source model XML file which should be used + for sensitivity computation. + +``outfile [file]`` + Name of the source spectrum output file. + +``expcube [file]`` + Exposure cube file (only needed for stacked analysis). + +``psfcube [file]`` + PSF cube file (only needed for stacked analysis). + +``bkgcube [file]`` + Background cube file (only needed for stacked analysis). + +``caldb [string]`` + Calibration database. + +``irf [string]`` + Instrumental response function. + +``emin [real]`` + Lower energy limit of events (in TeV). + +``emax [real]`` + Upper energy limit of events (in TeV). + +``enumbins [integer]`` + Number of energy bins (0=unbinned). + +``(ebinalg = LOG) [string]`` + Algorithm for defining energy bins. + +``binned [boolean]`` + Specifies whether a binned computation should be used. + +``(nebins = 5) [integer]`` + Number of bins per spectral point for binned analysis. + +``coordsys [string]`` + Coordinate system (CEL - celestial, GAL - galactic). + +``proj [string]`` + Projection method. + +``xref [real]`` + Right Ascension / Galactic longitude of image centre (J2000, in degrees). + +``yref [real]`` + Declination / Galactic latitude of image centre (J2000, in degrees). + +``nxpix [integer]`` + Size of the Right Ascension / Galactic longitude axis (in pixels). + +``nypix [integer]`` + Size of the Declination / Galactic latitude axis (in pixels). + +``binsz [real]`` + Pixel size (in degrees/pixel). + +``(calc_ts = yes) [boolean]`` + Compute TS for each spectral point? + +``(calc_ulim = yes) [boolean]`` + Compute upper limit for each spectral point? + +``(fix_srcs = yes) [boolean]`` + Fix other sky model parameters? + +``(fix_bkg = no) [boolean]`` + Fix background model parameters? + + +Standard parameters +------------------- + +``(chatter = 2) [integer]`` + Verbosity of the executable: + chatter = 0: no information will be logged + + chatter = 1: only errors will be logged + + chatter = 2: errors and actions will be logged + + chatter = 3: report about the task execution + + chatter = 4: detailed report about the task execution + +``(clobber = yes) [boolean]`` + Specifies whether an existing output counts cube should be overwritten. + +``(debug = no) [boolean]`` + Enables debug mode. In debug mode the executable will dump any log file output to the console. + +``(mode = ql) [string]`` + Mode of automatic parameters (default is "ql", i.e. "query and learn"). + +``(logfile = csspec.log) [filename]`` + Log filename. + + +Related tools +------------- + +None diff --git a/doc/source/reference_manual/cstsdist.rst b/doc/source/reference_manual/cstsdist.rst index 442a36e..43fd28a 100644 --- a/doc/source/reference_manual/cstsdist.rst +++ b/doc/source/reference_manual/cstsdist.rst @@ -16,30 +16,49 @@ Monte-Carlo simulations. General parameters ------------------ -``(outfile = ts.dat) [file]`` +``(inobs = NONE) [file]`` + Input event list, counts cube or observation definition XML file. + +``inmodel [file]`` + Input source model XML file. + +``srcname [string]`` + Name of the source in the source model XML file which should be used + for sensitivity computation. + +``outfile [file]`` ASCII file containing the TS distribution values. - -``ntrials [integer]`` - Number of Monte Carlo samples. - + +``expcube [file]`` + Exposure cube file (only needed for stacked analysis). + +``psfcube [file]`` + PSF cube file (only needed for stacked analysis). + +``bkgcube [file]`` + Background cube file (only needed for stacked analysis). + ``caldb [string]`` Calibration database. ``irf [string]`` Instrumental response function. -``type [string]`` - Source model type. - -``(index = -2.48) [real]`` - Spectral index for source model. - -``offset [real]`` - Source offset angle (in degrees). - -``bkg [string]`` - Background model file function (none=power law for subarray E). +``(deadc = 0.95) [real]`` + Average deadtime correction factor. + +``(edisp = no) [boolean]`` + Apply energy dispersion to response computation. + +``ntrials [integer]`` + Number of Monte Carlo samples. + +``ra [real]`` + Right Ascension of CTA pointing (J2000, in degrees). +``dec [real]`` + Declination of CTA pointing (J2000, in degrees). + ``emin [real]`` Lower energy limit (in TeV). @@ -49,18 +68,27 @@ General parameters ``enumbins [integer]`` Number of energy bins (0=unbinned). -``duration [real]`` - Effective exposure time (in seconds). +``(tmin = 0.0) [real]`` + Start time (in seconds). -``(rad = 5.0) [real]`` - Radius of ROI (in degrees). +``tmax [real]`` + Stop time (in seconds). -``(npix = 200) [integer]`` +``npix [integer]`` Number of pixels for binned analysis. -``(binsz = 0.05) [real]`` +``binsz [real]`` Pixel size for binned analysis. +``(rad = 5.0) [real]`` + Radius of ROI (in degrees). + +``(pattern = single) [string]`` + Pattern for pointing simulation (single/four). + +``(offset = 1.5) [real]`` + Observation pattern offset (in degrees). + Standard parameters ------------------- @@ -86,6 +114,9 @@ Standard parameters ``(mode = ql) [string]`` Mode of automatic parameters (default is "ql", i.e. "query and learn"). +``(logfile = cstsdist.log) [string]`` + Log filename. + Related tools ------------- diff --git a/doc/source/reference_manual/index.rst b/doc/source/reference_manual/index.rst index eccacb8..9760168 100644 --- a/doc/source/reference_manual/index.rst +++ b/doc/source/reference_manual/index.rst @@ -38,7 +38,9 @@ cscripts cscaldb --- Lists available instrument response functions csobsdef --- Generates observation definition file + cslightcrv --- Computes lightcurve cspull --- Generates pull distribution cssens --- Computes CTA sensitivity + csspec --- Computes spectral points csresmap --- Generates residual map cstsdist --- Generates TS distribution diff --git a/doc/source/reference_manual/usage.rst b/doc/source/reference_manual/usage.rst index b82450e..32e08b3 100644 --- a/doc/source/reference_manual/usage.rst +++ b/doc/source/reference_manual/usage.rst @@ -26,7 +26,7 @@ Examples ``infile [file]`` Describes an automatic (queried) file-type parameter with no default value. -``irf = kb_E_50h_v3 [string]`` +``irf = South_50h [string]`` Describes an automatic (queried) string-type parameter with two value options. @@ -39,4 +39,4 @@ Examples To set hidden parameters at runtime, specify them explicitly at the command line; for example: - ``gtobssim start_time=900`` + ``ctobssim start_time=900`` diff --git a/doc/source/user_manual/enhancing.rst b/doc/source/user_manual/enhancing.rst index 7265e27..42169c4 100644 --- a/doc/source/user_manual/enhancing.rst +++ b/doc/source/user_manual/enhancing.rst @@ -14,5 +14,10 @@ The following C++ and Python examples can help get you started: Building your own cscripts -------------------------- +To be written ... + + Building your own ctools ------------------------ + +To be written ... diff --git a/doc/source/user_manual/expert.rst b/doc/source/user_manual/expert.rst index 2fec16f..61b6ee9 100644 --- a/doc/source/user_manual/expert.rst +++ b/doc/source/user_manual/expert.rst @@ -4,8 +4,16 @@ Behind the scenes CTA data structure ------------------ +To be written ... + + Instrument response functions ----------------------------- +To be written ... + + Maximum likelihood fitting --------------------------- \ No newline at end of file +-------------------------- + +To be written ... diff --git a/doc/source/user_manual/getting.rst b/doc/source/user_manual/getting.rst index f0561f6..87d8059 100644 --- a/doc/source/user_manual/getting.rst +++ b/doc/source/user_manual/getting.rst @@ -31,7 +31,7 @@ Installing gammalib ctools is built on top of gammalib, hence gammalib needs to be built, installed and configured before ctools can be installed. In case that ctools is already installed on your system you may skip reading this -section and continue with Section TBD that explains how to install ctools. +section and continue with the :ref:`sec_building_ctools` section. You will need the following to build the gammalib: @@ -59,7 +59,7 @@ in an appropriate location (for example ``$HOME/builds``), and type .. code-block:: bash - $ tar xvfz gammalib-1.0.0.tar.gz + $ tar xvfz gammalib-0.10.0.tar.gz (the ``$`` symbol indicates the console prompt and is not part of the command that you should type in). @@ -69,7 +69,7 @@ typing .. code-block:: bash - $ cd gammalib-1.0.0 + $ cd gammalib-0.10.0 $ ./configure $ make $ make check @@ -117,6 +117,8 @@ If you use C shell or a variant then add the following to your source $GAMMALIB/bin/gammalib-init.csh +.. _sec_building_ctools: + Building ctools --------------- @@ -125,7 +127,7 @@ an appropriate location (for example ``$HOME/builds``), and type .. code-block:: bash - $ tar xvfz ctools-1.0.0.tar.gz + $ tar xvfz ctools-0.9.0.tar.gz (the ``$`` symbol indicates the console prompt and is not part of the command that you should type in). @@ -134,7 +136,7 @@ Step in the directory and build the ctools by typing .. code-block:: bash - $ cd ctools-1.0.0 + $ cd ctools-0.9.0 $ ./configure $ make @@ -171,7 +173,7 @@ following output at the end of the unit testing: PASS: test_python.py make[4]: Nothing to be done for `all'. ============================================================================ - Testsuite summary for ctools 1.0.0 + Testsuite summary for ctools 0.9.0 ============================================================================ # TOTAL: 3 # PASS: 3 @@ -189,26 +191,33 @@ For older automake version, you should see *************** * Test ctools * *************** - Test ctobssim: .... ok + Test ctobssim: .. ok Test ctskymap: .. ok Test ctbin: .... ok - Test ctmodel: ...... ok - Test ctselect: .. ok - Test ctlike: ........ ok - Test cttsmap: .. ok Test ctexpcube: .... ok Test ctpsfcube: .... ok Test ctbkgcube: ...... ok + Test ctmodel: ...... ok + Test ctselect: .. ok + Test ctlike: ...... ok + Test cttsmap: .. ok Test ctcubemask: .. ok Test ctbutterfly: .. ok + Test ctulimit: .. ok PASS: test_ctools.sh ***************** * Test cscripts * ***************** + Test csobsdef: .. ok Test cspull: .. ok + Test cssens: .. ok Test cstsdist: .. ok Test csresmap: .. ok + Test csspec (unbinned): .. ok + Test csspec (binned): .. ok + Test cslightcrv (unbinned): .. ok + Test cslightcrv (binned): .. ok PASS: test_cscripts.sh *********************** @@ -227,6 +236,7 @@ For older automake version, you should see Test ctbkgcube functionality: ... ok Test ctcubemask functionality: ... ok Test ctbutterfly functionality: ... ok + Test ctulimit functionality: ... ok Test unbinned pipeline with FITS file saving: .... ok Test unbinned in-memory pipeline: .... ok PASS: test_python.py @@ -307,9 +317,8 @@ GammaLib unit tests fail Some users have reported failure of a large fraction of the GammaLib unit tests after after typing ``make check``. In all cases, this was related to -the absence of the directory where the shared ``libcfitsio`` library -resides in the library load path. To solve the issue, locate the directory -where the shared ``libcfitsio`` library resides and then type +not finding the ``libcfitsio`` library. To solve the issue, locate the +directory where the shared ``libcfitsio`` library resides and then type .. code-block:: bash diff --git a/doc/source/user_manual/getting_started/beyond_combine.rst b/doc/source/user_manual/getting_started/beyond_combine.rst index e2b3fdc..487eea8 100644 --- a/doc/source/user_manual/getting_started/beyond_combine.rst +++ b/doc/source/user_manual/getting_started/beyond_combine.rst @@ -20,12 +20,12 @@ nebula, each offset by 0.5 deg from the nebula in opposite directions: RA of pointing (degrees) (0-360) [83.63] Dec of pointing (degrees) (-90-90) [22.01] 21.51 Radius of FOV (degrees) (0-180) [5.0] - Start time (MET in s) (0) [0.0] - End time (MET in s) (0) [1800.0] - Lower energy limit (TeV) (0) [0.1] - Upper energy limit (TeV) (0) [100.0] - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Start time (MET in s) [0.0] + End time (MET in s) [1800.0] + Lower energy limit (TeV) [0.1] + Upper energy limit (TeV) [100.0] + Calibration database [prod2] + Instrument response function [South_50h] Model [$CTOOLS/share/models/crab.xml] Output event data file or observation definition file [events.fits] events1.fits @@ -35,12 +35,12 @@ nebula, each offset by 0.5 deg from the nebula in opposite directions: RA of pointing (degrees) (0-360) [83.63] Dec of pointing (degrees) (-90-90) [21.51] 22.51 Radius of FOV (degrees) (0-180) [5.0] - Start time (MET in s) (0) [0.0] - End time (MET in s) (0) [1800.0] - Lower energy limit (TeV) (0) [0.1] - Upper energy limit (TeV) (0) [100.0] - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Start time (MET in s) [0.0] + End time (MET in s) [1800.0] + Lower energy limit (TeV) [0.1] + Upper energy limit (TeV) [100.0] + Calibration database [prod2] + Instrument response function [South_50h] Model [$CTOOLS/share/models/crab.xml] Output event data file or observation definition file [events1.fits] events2.fits @@ -92,11 +92,11 @@ Now we are ready to do a joint maximum likelihood analysis using .. code-block:: bash $ ctlike - Event list, counts cube or observation definition file [events.fits] obs.xml - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Event list, counts cube or observation definition file [selected_events.fits] obs.xml + Calibration database [prod2] + Instrument response function [South_50h] Source model [$CTOOLS/share/models/crab.xml] - Source model output file [crab_results.xml] + Source model output file [crab_results.xml] Instead of providing an event list or a counts cube, we now provided the filename of the observation definition XML file (here ``obs.xml``) as input @@ -106,102 +106,96 @@ joint analysis, as indicated in the log file: .. code-block:: xml - 2015-02-04T20:33:26: +==============+ - 2015-02-04T20:33:26: | Observations | - 2015-02-04T20:33:26: +==============+ - 2015-02-04T20:33:26: === GObservations === - 2015-02-04T20:33:26: Number of observations ....: 2 - 2015-02-04T20:33:26: Number of predicted events : 0 - 2015-02-04T20:33:26: === GCTAObservation === - 2015-02-04T20:33:26: Name ......................: Crab - 2015-02-04T20:33:26: Identifier ................: 00001 - 2015-02-04T20:33:26: Instrument ................: CTA - 2015-02-04T20:33:26: Event file ................: events1.fits - 2015-02-04T20:33:26: Event type ................: EventList - 2015-02-04T20:33:26: Statistics ................: Poisson - 2015-02-04T20:33:26: Ontime ....................: 1800 s - 2015-02-04T20:33:26: Livetime ..................: 1710 s - 2015-02-04T20:33:26: Deadtime correction .......: 0.95 - 2015-02-04T20:33:26: User energy range .........: undefined - 2015-02-04T20:33:26: === GCTAPointing === - 2015-02-04T20:33:26: Pointing direction ........: (RA,Dec)=(83.63,21.51) + 2015-05-22T20:17:07: +==============+ + 2015-05-22T20:17:07: | Observations | + 2015-05-22T20:17:07: +==============+ + 2015-05-22T20:17:07: === GObservations === + 2015-05-22T20:17:07: Number of observations ....: 2 + 2015-05-22T20:17:07: Number of predicted events : 0 + 2015-05-22T20:17:07: === GCTAObservation === + 2015-05-22T20:17:07: Name ......................: + 2015-05-22T20:17:07: Identifier ................: 00001 + 2015-05-22T20:17:07: Instrument ................: CTA + 2015-05-22T20:17:07: Event file ................: events1.fits + 2015-05-22T20:17:07: Event type ................: EventList + 2015-05-22T20:17:07: Statistics ................: Poisson + 2015-05-22T20:17:07: Ontime ....................: 1800 s + 2015-05-22T20:17:07: Livetime ..................: 1710 s + 2015-05-22T20:17:07: Deadtime correction .......: 0.95 + 2015-05-22T20:17:07: User energy range .........: undefined + 2015-05-22T20:17:07: === GCTAPointing === + 2015-05-22T20:17:07: Pointing direction ........: (RA,Dec)=(83.63,21.51) ... - 2015-02-04T20:33:26: === GCTAObservation === - 2015-02-04T20:33:26: Name ......................: Crab - 2015-02-04T20:33:26: Identifier ................: 00002 - 2015-02-04T20:33:26: Instrument ................: CTA - 2015-02-04T20:33:26: Event file ................: events2.fits - 2015-02-04T20:33:26: Event type ................: EventList - 2015-02-04T20:33:26: Statistics ................: Poisson - 2015-02-04T20:33:26: Ontime ....................: 1800 s - 2015-02-04T20:33:26: Livetime ..................: 1710 s - 2015-02-04T20:33:26: Deadtime correction .......: 0.95 - 2015-02-04T20:33:26: User energy range .........: undefined - 2015-02-04T20:33:26: === GCTAPointing === - 2015-02-04T20:33:26: Pointing direction ........: (RA,Dec)=(83.63,22.51) + 2015-05-22T20:17:07: === GCTAObservation === + 2015-05-22T20:17:07: Name ......................: + 2015-05-22T20:17:07: Identifier ................: 00002 + 2015-05-22T20:17:07: Instrument ................: CTA + 2015-05-22T20:17:07: Event file ................: events2.fits + 2015-05-22T20:17:07: Event type ................: EventList + 2015-05-22T20:17:07: Statistics ................: Poisson + 2015-05-22T20:17:07: Ontime ....................: 1800 s + 2015-05-22T20:17:07: Livetime ..................: 1710 s + 2015-05-22T20:17:07: Deadtime correction .......: 0.95 + 2015-05-22T20:17:07: User energy range .........: undefined + 2015-05-22T20:17:07: === GCTAPointing === + 2015-05-22T20:17:07: Pointing direction ........: (RA,Dec)=(83.63,22.51) ... - 2015-02-04T20:33:26: +=================================+ - 2015-02-04T20:33:26: | Maximum likelihood optimisation | - 2015-02-04T20:33:26: +=================================+ - 2015-02-04T20:33:26: >Iteration 0: -logL=89099.788, Lambda=1.0e-03 - 2015-02-04T20:33:26: >Iteration 1: -logL=89094.435, Lambda=1.0e-03, delta=5.353, max(|grad|)=-4.388872 [Normalization:7] - 2015-02-04T20:33:26: >Iteration 2: -logL=89094.420, Lambda=1.0e-04, delta=0.015, max(|grad|)=-0.116432 [Index:3] - 2015-02-04T20:33:26: >Iteration 3: -logL=89094.420, Lambda=1.0e-05, delta=0.000, max(|grad|)=-0.003989 [Index:3] - 2015-02-04T20:33:26: - 2015-02-04T20:33:26: +=========================================+ - 2015-02-04T20:33:26: | Maximum likelihood optimization results | - 2015-02-04T20:33:26: +=========================================+ - 2015-02-04T20:33:26: === GOptimizerLM === - 2015-02-04T20:33:26: Optimized function value ..: 89094.420 - 2015-02-04T20:33:26: Absolute precision ........: 0.005 - 2015-02-04T20:33:26: Acceptable value decrease .: 2 - 2015-02-04T20:33:26: Optimization status .......: converged - 2015-02-04T20:33:26: Number of parameters ......: 9 - 2015-02-04T20:33:26: Number of free parameters .: 4 - 2015-02-04T20:33:26: Number of iterations ......: 3 - 2015-02-04T20:33:26: Lambda ....................: 1e-06 - 2015-02-04T20:33:26: Maximum log likelihood ....: -89094.420 - 2015-02-04T20:33:26: Observed events (Nobs) ...: 12260.000 - 2015-02-04T20:33:26: Predicted events (Npred) ..: 12260.000 (Nobs - Npred = 6.95764e-06) - 2015-02-04T20:33:26: === GModels === - 2015-02-04T20:33:26: Number of models ..........: 2 - 2015-02-04T20:33:26: Number of parameters ......: 9 - 2015-02-04T20:33:26: === GModelSky === - 2015-02-04T20:33:26: Name ......................: Crab - 2015-02-04T20:33:26: Instruments ...............: all - 2015-02-04T20:33:26: Instrument scale factors ..: unity - 2015-02-04T20:33:26: Observation identifiers ...: all - 2015-02-04T20:33:26: Model type ................: PointSource - 2015-02-04T20:33:26: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" - 2015-02-04T20:33:26: Number of parameters ......: 6 - 2015-02-04T20:33:26: Number of spatial par's ...: 2 - 2015-02-04T20:33:26: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) - 2015-02-04T20:33:26: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) - 2015-02-04T20:33:26: Number of spectral par's ..: 3 - 2015-02-04T20:33:26: Prefactor ................: 6.06322e-16 +/- 1.44948e-17 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) - 2015-02-04T20:33:26: Index ....................: -2.49814 +/- 0.0178524 [-0,-5] (free,scale=-1,gradient) - 2015-02-04T20:33:26: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) - 2015-02-04T20:33:26: Number of temporal par's ..: 1 - 2015-02-04T20:33:26: Constant .................: 1 (relative value) (fixed,scale=1,gradient) - 2015-02-04T20:33:26: === GCTAModelRadialAcceptance === - 2015-02-04T20:33:26: Name ......................: Background - 2015-02-04T20:33:26: Instruments ...............: CTA - 2015-02-04T20:33:26: Instrument scale factors ..: unity - 2015-02-04T20:33:26: Observation identifiers ...: all - 2015-02-04T20:33:26: Model type ................: "Gaussian" * "FileFunction" * "Constant" - 2015-02-04T20:33:26: Number of parameters ......: 3 - 2015-02-04T20:33:26: Number of radial par's ....: 1 - 2015-02-04T20:33:26: Sigma ....................: 3.0356 +/- 0.0215259 [0.01,10] deg2 (free,scale=1,gradient) - 2015-02-04T20:33:26: Number of spectral par's ..: 1 - 2015-02-04T20:33:26: Normalization ............: 0.99936 +/- 0.0122024 [0,1000] (free,scale=1,gradient) - 2015-02-04T20:33:26: Number of temporal par's ..: 1 - 2015-02-04T20:33:26: Constant .................: 1 (relative value) (fixed,scale=1,gradient) - 2015-02-04T20:33:26: - 2015-02-04T20:33:26: +==============+ - 2015-02-04T20:33:26: | Save results | - 2015-02-04T20:33:26: +==============+ - 2015-02-04T20:33:26: - 2015-02-04T20:33:26: Application "ctlike" terminated after 10 wall clock seconds, consuming 0.385432 seconds of CPU time. + 2015-05-22T20:17:07: +=================================+ + 2015-05-22T20:17:07: | Maximum likelihood optimisation | + 2015-05-22T20:17:07: +=================================+ + 2015-05-22T20:17:07: >Iteration 0: -logL=201836.657, Lambda=1.0e-03 + 2015-05-22T20:17:07: >Iteration 1: -logL=201829.438, Lambda=1.0e-03, delta=7.220, max(|grad|)=22.756507 [Index:7] + 2015-05-22T20:17:07: >Iteration 2: -logL=201829.432, Lambda=1.0e-04, delta=0.005, max(|grad|)=0.086395 [Index:3] + 2015-05-22T20:17:07: >Iteration 3: -logL=201829.432, Lambda=1.0e-05, delta=0.000, max(|grad|)=0.001287 [Index:3] + 2015-05-22T20:17:07: + 2015-05-22T20:17:07: +=========================================+ + 2015-05-22T20:17:07: | Maximum likelihood optimization results | + 2015-05-22T20:17:07: +=========================================+ + 2015-05-22T20:17:07: === GOptimizerLM === + 2015-05-22T20:17:07: Optimized function value ..: 201829.432 + 2015-05-22T20:17:07: Absolute precision ........: 0.005 + 2015-05-22T20:17:07: Acceptable value decrease .: 2 + 2015-05-22T20:17:07: Optimization status .......: converged + 2015-05-22T20:17:07: Number of parameters ......: 10 + 2015-05-22T20:17:07: Number of free parameters .: 4 + 2015-05-22T20:17:07: Number of iterations ......: 3 + 2015-05-22T20:17:07: Lambda ....................: 1e-06 + 2015-05-22T20:17:07: Maximum log likelihood ....: -201829.432 + 2015-05-22T20:17:07: Observed events (Nobs) ...: 31799.000 + 2015-05-22T20:17:07: Predicted events (Npred) ..: 31799.000 (Nobs - Npred = 2.67544e-06) + 2015-05-22T20:17:07: === GModels === + 2015-05-22T20:17:07: Number of models ..........: 2 + 2015-05-22T20:17:07: Number of parameters ......: 10 + 2015-05-22T20:17:07: === GModelSky === + 2015-05-22T20:17:07: Name ......................: Crab + 2015-05-22T20:17:07: Instruments ...............: all + 2015-05-22T20:17:07: Instrument scale factors ..: unity + 2015-05-22T20:17:07: Observation identifiers ...: all + 2015-05-22T20:17:07: Model type ................: PointSource + 2015-05-22T20:17:07: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" + 2015-05-22T20:17:07: Number of parameters ......: 6 + 2015-05-22T20:17:07: Number of spatial par's ...: 2 + 2015-05-22T20:17:07: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) + 2015-05-22T20:17:07: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) + 2015-05-22T20:17:07: Number of spectral par's ..: 3 + 2015-05-22T20:17:07: Prefactor ................: 5.8727e-16 +/- 8.04314e-18 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) + 2015-05-22T20:17:07: Index ....................: -2.49825 +/- 0.0118418 [-0,-5] (free,scale=-1,gradient) + 2015-05-22T20:17:07: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T20:17:07: Number of temporal par's ..: 1 + 2015-05-22T20:17:07: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) + 2015-05-22T20:17:07: === GCTAModelIrfBackground === + 2015-05-22T20:17:07: Name ......................: CTABackgroundModel + 2015-05-22T20:17:07: Instruments ...............: CTA + 2015-05-22T20:17:07: Instrument scale factors ..: unity + 2015-05-22T20:17:07: Observation identifiers ...: all + 2015-05-22T20:17:07: Model type ................: "PowerLaw" * "Constant" + 2015-05-22T20:17:07: Number of parameters ......: 4 + 2015-05-22T20:17:07: Number of spectral par's ..: 3 + 2015-05-22T20:17:07: Prefactor ................: 1.01608 +/- 0.0152751 [0.001,1000] ph/cm2/s/MeV (free,scale=1,gradient) + 2015-05-22T20:17:07: Index ....................: 0.0226023 +/- 0.0086794 [-5,5] (free,scale=1,gradient) + 2015-05-22T20:17:07: PivotEnergy ..............: 1e+06 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T20:17:07: Number of temporal par's ..: 1 + 2015-05-22T20:17:07: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) The log file indicates that the fit converged quickly, the spectral parameters of the Crab nebula have now been constrained using the events diff --git a/doc/source/user_manual/getting_started/beyond_irf.rst b/doc/source/user_manual/getting_started/beyond_irf.rst index 69dd500..2c9d9fa 100644 --- a/doc/source/user_manual/getting_started/beyond_irf.rst +++ b/doc/source/user_manual/getting_started/beyond_irf.rst @@ -3,33 +3,50 @@ Connecting observations to dedicated instrument response functions ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -.. note:: - - To execute the following examples on your machine you need to - install a specific calibration database. Download the file - :download:`caldb.tar.gz ` into a local working - directory, decompress and untar the folder, and set the calibration - database to this folder by typing: - - .. code-block:: bash - - $ export CALDB=$PWD/caldb - - Note that the response functions in the calibration database - are all identical to the ``cta_dummy_irf`` response, yet there - a multiple database and response entries so that the usage of - specific response functions can be emulated. - So far the same instrument response function has been used for all observations in our analysis examples. You may have recognised that we always specified the calibration database -``dummy`` and the instrument response function ``cta_dummy_irf`` that -are shipped with the ctools release. +``prod2`` and the instrument response function ``South_50h`` that +are shipped with ctools. When combining multiple observations in a joint analysis we may however need to specify dedicated instrument response functions for the different observations. -This can be done by adding the calibration information to the observation -definition XML file: + +Let's simulate two observations of the Crab nebula, one done with +the northern array and the other with the southern array: + +.. code-block:: bash + + $ ctobssim + RA of pointing (degrees) (0-360) [83.63] + Dec of pointing (degrees) (-90-90) [22.01] 21.51 + Radius of FOV (degrees) (0-180) [5.0] + Start time (MET in s) [0.0] + End time (MET in s) [1800.0] + Lower energy limit (TeV) [0.1] + Upper energy limit (TeV) [100.0] + Calibration database [prod2] + Instrument response function [South_50h] North_50h + Model [$CTOOLS/share/models/crab.xml] + Output event data file or observation definition file [events.fits] events1.fits + +.. code-block:: bash + + $ ctobssim + RA of pointing (degrees) (0-360) [83.63] + Dec of pointing (degrees) (-90-90) [22.01] 22.51 + Radius of FOV (degrees) (0-180) [5.0] + Start time (MET in s) [0.0] + End time (MET in s) [1800.0] + Lower energy limit (TeV) [0.1] + Upper energy limit (TeV) [100.0] + Calibration database [prod2] + Instrument response function [North_50h] South_50h + Model [$CTOOLS/share/models/crab.xml] + Output event data file or observation definition file [events1.fits] events2.fits + +Now we combine the information about these two observations in an +observation definition XML file: .. code-block:: xml @@ -37,11 +54,11 @@ definition XML file: - + - + @@ -55,41 +72,39 @@ option to get the output of the script on the console): $ cscaldb debug=yes Parfile cscaldb.par not found. Create default parfile. - 2015-02-05T14:26:50: +============+ - 2015-02-05T14:26:50: | Parameters | - 2015-02-05T14:26:50: +============+ - 2015-02-05T14:26:50: chatter ...................: 2 - 2015-02-05T14:26:50: clobber ...................: yes - 2015-02-05T14:26:50: debug .....................: yes - 2015-02-05T14:26:50: mode ......................: ql - 2015-02-05T14:26:50: - 2015-02-05T14:26:50: +==============+ - 2015-02-05T14:26:50: | Mission: cta | - 2015-02-05T14:26:50: +==============+ - 2015-02-05T14:26:50: === Response functions in database "dummy" === - 2015-02-05T14:26:50: cta_dummy_irf - 2015-02-05T14:26:50: cta_prod1_irf - 2015-02-05T14:26:50: cta_prod2_irf - 2015-02-05T14:26:50: - 2015-02-05T14:26:50: === Response functions in database "north" === - 2015-02-05T14:26:50: cta_north_irf - 2015-02-05T14:26:50: - 2015-02-05T14:26:50: === Response functions in database "south" === - 2015-02-05T14:26:50: cta_south_irf - -You will see that for the CTA observatory three databases exist. -The ``dummy`` database contains three response functions -(``cta_dummy_irf``, ``cta_prod1_irf``, ``cta_prod2_irf``) while the -``north`` and ``south`` databases contain a single response function. -You may now do a :ref:`ctlike` fit using the XML file with the specific -response definitions: + 2015-05-22T21:35:39: +============+ + 2015-05-22T21:35:39: | Parameters | + 2015-05-22T21:35:39: +============+ + 2015-05-22T21:35:39: chatter ...................: 2 + 2015-05-22T21:35:39: clobber ...................: yes + 2015-05-22T21:35:39: debug .....................: yes + 2015-05-22T21:35:39: mode ......................: ql + 2015-05-22T21:35:39: + 2015-05-22T21:35:39: +==============+ + 2015-05-22T21:35:39: | Mission: cta | + 2015-05-22T21:35:39: +==============+ + 2015-05-22T21:35:40: === Response functions in database "prod2" === + 2015-05-22T21:35:40: North_0.5h + 2015-05-22T21:35:40: North_50h + 2015-05-22T21:35:40: North_5h + 2015-05-22T21:35:40: South_0.5h + 2015-05-22T21:35:40: South_50h + 2015-05-22T21:35:40: South_5h + +You will see that ctools ships with one database for the CTA observatory. +This is the ``prod2`` database. +Within this database there are six response functions: +``North_0.5h``, ``North_5h``, ``North_50h``, +``South_0.5h``, ``South_5h``, and ``South_50h``. + +We now jointly fit both observations using :ref:`ctlike`: .. code-block:: bash $ ctlike - Event list, counts cube or observation definition file [events.fits] obs_irf.xml + Event list, counts cube or observation definition file [obs.xml] obs_irf.xml Source model [$CTOOLS/share/models/crab.xml] - Source model output file [crab_results.xml] + Source model output file [crab_results.xml] To see the usage of the individual response functions you may inspect the log file. You will notice that each observation now has a specific response @@ -98,69 +113,110 @@ both observations. .. code-block:: xml - 2015-02-05T14:48:46: +==============+ - 2015-02-05T14:48:46: | Observations | - 2015-02-05T14:48:46: +==============+ - 2015-02-05T14:48:46: === GObservations === - 2015-02-05T14:48:46: Number of observations ....: 2 - 2015-02-05T14:48:46: Number of predicted events : 0 - 2015-02-05T14:48:46: === GCTAObservation === - 2015-02-05T14:48:46: Name ......................: Crab - 2015-02-05T14:48:46: Identifier ................: 00001 - 2015-02-05T14:48:46: Instrument ................: CTA - 2015-02-05T14:48:46: Event file ................: events1.fits - 2015-02-05T14:48:46: Event type ................: EventList - 2015-02-05T14:48:46: Statistics ................: Poisson - 2015-02-05T14:48:46: Ontime ....................: 1800 s - 2015-02-05T14:48:46: Livetime ..................: 1710 s - 2015-02-05T14:48:46: Deadtime correction .......: 0.95 - 2015-02-05T14:48:46: User energy range .........: undefined - 2015-02-05T14:48:46: === GCTAPointing === - 2015-02-05T14:48:46: Pointing direction ........: (RA,Dec)=(83.63,21.51) - 2015-02-05T14:48:46: === GCTAResponseIrf === - 2015-02-05T14:48:46: Response name .............: cta_north_irf - 2015-02-05T14:48:46: Energy dispersion .........: Not used - 2015-02-05T14:48:46: Save energy range .........: undefined - 2015-02-05T14:48:46: === GCaldb === - 2015-02-05T14:48:46: Database root .............: /Users/jurgen/Desktop/tmp/beyond/caldb - 2015-02-05T14:48:46: Selected Mission ..........: CTA - 2015-02-05T14:48:46: Selected Instrument .......: NORTH - 2015-02-05T14:48:46: Calibration Index File ....: /Users/jurgen/Desktop/tmp/beyond/caldb/data/cta/north/caldb.indx - 2015-02-05T14:48:46: Number of entries .........: 4 - 2015-02-05T14:48:46: === GCTAAeffPerfTable === - 2015-02-05T14:48:46: Filename ..................: /Users/jurgen/Desktop/tmp/beyond/caldb/data/cta/north/bcf/cta_north_irf.dat - 2015-02-05T14:48:46: Number of energy bins .....: 20 - 2015-02-05T14:48:46: Log10(Energy) range .......: 0.0199526 - 125.893 TeV - 2015-02-05T14:48:46: Offset angle dependence ...: Fixed sigma=3 - ... - 2015-02-05T14:48:46: === GCTAObservation === - 2015-02-05T14:48:46: Name ......................: Crab - 2015-02-05T14:48:46: Identifier ................: 00002 - 2015-02-05T14:48:46: Instrument ................: CTA - 2015-02-05T14:48:46: Event file ................: events2.fits - 2015-02-05T14:48:46: Event type ................: EventList - 2015-02-05T14:48:46: Statistics ................: Poisson - 2015-02-05T14:48:46: Ontime ....................: 1800 s - 2015-02-05T14:48:46: Livetime ..................: 1710 s - 2015-02-05T14:48:46: Deadtime correction .......: 0.95 - 2015-02-05T14:48:46: User energy range .........: undefined - 2015-02-05T14:48:46: === GCTAPointing === - 2015-02-05T14:48:46: Pointing direction ........: (RA,Dec)=(83.63,22.51) - 2015-02-05T14:48:46: === GCTAResponseIrf === - 2015-02-05T14:48:46: Response name .............: cta_south_irf - 2015-02-05T14:48:46: Energy dispersion .........: Not used - 2015-02-05T14:48:46: Save energy range .........: undefined - 2015-02-05T14:48:46: === GCaldb === - 2015-02-05T14:48:46: Database root .............: /Users/jurgen/Desktop/tmp/beyond/caldb - 2015-02-05T14:48:46: Selected Mission ..........: CTA - 2015-02-05T14:48:46: Selected Instrument .......: SOUTH - 2015-02-05T14:48:46: Calibration Index File ....: /Users/jurgen/Desktop/tmp/beyond/caldb/data/cta/south/caldb.indx - 2015-02-05T14:48:46: Number of entries .........: 4 - 2015-02-05T14:48:46: === GCTAAeffPerfTable === - 2015-02-05T14:48:46: Filename ..................: /Users/jurgen/Desktop/tmp/beyond/caldb/data/cta/south/bcf/cta_south_irf.dat - 2015-02-05T14:48:46: Number of energy bins .....: 20 - 2015-02-05T14:48:46: Log10(Energy) range .......: 0.0199526 - 125.893 TeV - 2015-02-05T14:48:46: Offset angle dependence ...: Fixed sigma=3 + 2015-05-22T22:06:43: +==============+ + 2015-05-22T22:06:43: | Observations | + 2015-05-22T22:06:43: +==============+ + 2015-05-22T22:06:43: === GObservations === + 2015-05-22T22:06:43: Number of observations ....: 2 + 2015-05-22T22:06:43: Number of predicted events : 0 + 2015-05-22T22:06:43: === GCTAObservation === + 2015-05-22T22:06:43: Name ......................: + 2015-05-22T22:06:43: Identifier ................: 00001 + 2015-05-22T22:06:43: Instrument ................: CTA + 2015-05-22T22:06:43: Event file ................: events1.fits + 2015-05-22T22:06:43: Event type ................: EventList + 2015-05-22T22:06:43: Statistics ................: Poisson + 2015-05-22T22:06:43: Ontime ....................: 1800 s + 2015-05-22T22:06:43: Livetime ..................: 1710 s + 2015-05-22T22:06:43: Deadtime correction .......: 0.95 + 2015-05-22T22:06:43: User energy range .........: undefined + 2015-05-22T22:06:43: === GCTAPointing === + 2015-05-22T22:06:43: Pointing direction ........: (RA,Dec)=(83.63,21.51) + 2015-05-22T22:06:43: === GCTAResponseIrf === + 2015-05-22T22:06:43: Caldb mission .............: cta + 2015-05-22T22:06:43: Caldb instrument ..........: prod2 + 2015-05-22T22:06:43: Response name .............: North_50h + 2015-05-22T22:06:43: Energy dispersion .........: Not used + 2015-05-22T22:06:43: Save energy range .........: undefined + ... + 2015-05-22T22:06:43: === GCTAObservation === + 2015-05-22T22:06:43: Name ......................: + 2015-05-22T22:06:43: Identifier ................: 00002 + 2015-05-22T22:06:43: Instrument ................: CTA + 2015-05-22T22:06:43: Event file ................: events2.fits + 2015-05-22T22:06:43: Event type ................: EventList + 2015-05-22T22:06:43: Statistics ................: Poisson + 2015-05-22T22:06:43: Ontime ....................: 1800 s + 2015-05-22T22:06:43: Livetime ..................: 1710 s + 2015-05-22T22:06:43: Deadtime correction .......: 0.95 + 2015-05-22T22:06:43: User energy range .........: undefined + 2015-05-22T22:06:43: === GCTAPointing === + 2015-05-22T22:06:43: Pointing direction ........: (RA,Dec)=(83.63,22.51) + 2015-05-22T22:06:43: === GCTAResponseIrf === + 2015-05-22T22:06:43: Caldb mission .............: cta + 2015-05-22T22:06:43: Caldb instrument ..........: prod2 + 2015-05-22T22:06:43: Response name .............: South_50h + 2015-05-22T22:06:43: Energy dispersion .........: Not used + 2015-05-22T22:06:43: Save energy range .........: undefined + ... + 2015-05-22T22:06:43: +=================================+ + 2015-05-22T22:06:43: | Maximum likelihood optimisation | + 2015-05-22T22:06:43: +=================================+ + 2015-05-22T22:06:43: >Iteration 0: -logL=138039.472, Lambda=1.0e-03 + 2015-05-22T22:06:43: >Iteration 1: -logL=138035.501, Lambda=1.0e-03, delta=3.971, max(|grad|)=16.203761 [Index:7] + 2015-05-22T22:06:43: >Iteration 2: -logL=138035.496, Lambda=1.0e-04, delta=0.005, max(|grad|)=-0.053284 [Index:7] + 2015-05-22T22:06:43: >Iteration 3: -logL=138035.496, Lambda=1.0e-05, delta=0.000, max(|grad|)=0.001386 [Index:7] + 2015-05-22T22:06:44: + 2015-05-22T22:06:44: +=========================================+ + 2015-05-22T22:06:44: | Maximum likelihood optimization results | + 2015-05-22T22:06:44: +=========================================+ + 2015-05-22T22:06:44: === GOptimizerLM === + 2015-05-22T22:06:44: Optimized function value ..: 138035.496 + 2015-05-22T22:06:44: Absolute precision ........: 0.005 + 2015-05-22T22:06:44: Acceptable value decrease .: 2 + 2015-05-22T22:06:44: Optimization status .......: converged + 2015-05-22T22:06:44: Number of parameters ......: 10 + 2015-05-22T22:06:44: Number of free parameters .: 4 + 2015-05-22T22:06:44: Number of iterations ......: 3 + 2015-05-22T22:06:44: Lambda ....................: 1e-06 + 2015-05-22T22:06:44: Maximum log likelihood ....: -138035.496 + 2015-05-22T22:06:44: Observed events (Nobs) ...: 20814.000 + 2015-05-22T22:06:44: Predicted events (Npred) ..: 20814.000 (Nobs - Npred = 2.67698e-06) + 2015-05-22T22:06:44: === GModels === + 2015-05-22T22:06:44: Number of models ..........: 2 + 2015-05-22T22:06:44: Number of parameters ......: 10 + 2015-05-22T22:06:44: === GModelSky === + 2015-05-22T22:06:44: Name ......................: Crab + 2015-05-22T22:06:44: Instruments ...............: all + 2015-05-22T22:06:44: Instrument scale factors ..: unity + 2015-05-22T22:06:44: Observation identifiers ...: all + 2015-05-22T22:06:44: Model type ................: PointSource + 2015-05-22T22:06:44: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" + 2015-05-22T22:06:44: Number of parameters ......: 6 + 2015-05-22T22:06:44: Number of spatial par's ...: 2 + 2015-05-22T22:06:44: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) + 2015-05-22T22:06:44: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) + 2015-05-22T22:06:44: Number of spectral par's ..: 3 + 2015-05-22T22:06:44: Prefactor ................: 5.9184e-16 +/- 9.68924e-18 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) + 2015-05-22T22:06:44: Index ....................: -2.49569 +/- 0.0145376 [-0,-5] (free,scale=-1,gradient) + 2015-05-22T22:06:44: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T22:06:44: Number of temporal par's ..: 1 + 2015-05-22T22:06:44: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) + 2015-05-22T22:06:44: === GCTAModelIrfBackground === + 2015-05-22T22:06:44: Name ......................: CTABackgroundModel + 2015-05-22T22:06:44: Instruments ...............: CTA + 2015-05-22T22:06:44: Instrument scale factors ..: unity + 2015-05-22T22:06:44: Observation identifiers ...: all + 2015-05-22T22:06:44: Model type ................: "PowerLaw" * "Constant" + 2015-05-22T22:06:44: Number of parameters ......: 4 + 2015-05-22T22:06:44: Number of spectral par's ..: 3 + 2015-05-22T22:06:44: Prefactor ................: 1.02524 +/- 0.0182054 [0.001,1000] ph/cm2/s/MeV (free,scale=1,gradient) + 2015-05-22T22:06:44: Index ....................: 0.0229728 +/- 0.0104713 [-5,5] (free,scale=1,gradient) + 2015-05-22T22:06:44: PivotEnergy ..............: 1e+06 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T22:06:44: Number of temporal par's ..: 1 + 2015-05-22T22:06:44: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) + + A more fine grained control over the response function can be achieved by specifying individual filenames for the various response components. @@ -173,17 +229,17 @@ This is definitely expert mode, to be used with utmost care. - - - - + + + + - - - - + + + + @@ -199,11 +255,13 @@ file is given below: + + diff --git a/doc/source/user_manual/getting_started/beyond_model.rst b/doc/source/user_manual/getting_started/beyond_model.rst index 69678cd..0621daa 100644 --- a/doc/source/user_manual/getting_started/beyond_model.rst +++ b/doc/source/user_manual/getting_started/beyond_model.rst @@ -56,23 +56,21 @@ event list. - - - + + + + + - - - - - - + + + + + - - - - + Note that both background model components distinguish in their event rate; component ``Background_00002`` has a ten times larger background rate than @@ -112,21 +110,19 @@ This is illustrated in the model definition file below where component - - - + + + + + - - - - - - + + + + + - - - diff --git a/doc/source/user_manual/getting_started/beyond_residual.rst b/doc/source/user_manual/getting_started/beyond_residual.rst index 19deaad..9eb2924 100644 --- a/doc/source/user_manual/getting_started/beyond_residual.rst +++ b/doc/source/user_manual/getting_started/beyond_residual.rst @@ -16,15 +16,27 @@ the model value to obtained the fractional residuals Residual = \frac{Counts-Model}{Model} for all map pixels. -The :ref:`csresmap` script is used as follows: + +Suppose that you have done the following unbinned ``ctlike`` analysis: + +.. code-block:: bash + + $ ctlike + Event list, counts cube or observation definition file [events.fits] obs.xml + Calibration database [prod2] + Instrument response function [South_50h] + Source model [$CTOOLS/share/models/crab.xml] + Source model output file [crab_results.xml] + +The :ref:`csresmap` script is then used as follows: .. code-block:: bash $ csresmap Parfile csresmap.par not found. Create default parfile. Event list, counts cube, or observation definition file [events.fits] obs.xml - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Calibration database [prod2] + Instrument response function [South_50h] Source model [$CTOOLS/share/models/crab.xml] crab_results.xml Output residual map [resmap.fits] First coordinate of image center in degrees (RA or galactic l) [83.63] diff --git a/doc/source/user_manual/getting_started/beyond_stacked.rst b/doc/source/user_manual/getting_started/beyond_stacked.rst index c001e8b..4e7b9a4 100644 --- a/doc/source/user_manual/getting_started/beyond_stacked.rst +++ b/doc/source/user_manual/getting_started/beyond_stacked.rst @@ -15,10 +15,10 @@ into a single counts cube: .. code-block:: bash $ ctbin - Event list or observation definition file [events2.fits] obs.xml - First coordinate of image center in degrees (RA or galactic l) [83.63] - Second coordinate of image center in degrees (DEC or galactic b) [22.01] - Projection method e.g. AIT|AZP|CAR|MER|STG|TAN (AIT|AZP|CAR|MER|STG|TAN) [CAR] + Event list or observation definition file [events.fits] obs.xml + First coordinate of image center in degrees (RA or galactic l) (0-360) [83.63] + Second coordinate of image center in degrees (DEC or galactic b) (-90-90) [22.01] + Projection method (AIT|AZP|CAR|MER|MOL|STG|TAN) [CAR] Coordinate system (CEL - celestial, GAL - galactic) (CEL|GAL) [CEL] Image scale (in degrees/pixel) [0.02] Size of the X axis in pixels [200] @@ -27,15 +27,16 @@ into a single counts cube: Start value for first energy bin in TeV [0.1] Stop value for last energy bin in TeV [100.0] Number of energy bins [20] - Output counts cube [cntcube2.fits] cntcube.fits + Output counts cube [cntcube.fits] We now have a stacked counts cube ``cntcube.fits`` on disk. Before we can use that counts cube in a maximum likelihood analysis, we have to compute the instrument response and the background model that are needed to describe the stacked data. + For the former, we have to compute the total exposure for the stacked cube (i.e. the sum of the effective areas for each observation multiplied -by the corresponding lifetimes) and an effective point spread function +by the corresponding livetimes) and an effective point spread function (i.e. the point spread function of the different observations weighted by the corresponding exposures). To get both informations we use the :ref:`ctexpcube` and @@ -45,29 +46,29 @@ To get both informations we use the :ref:`ctexpcube` and $ ctexpcube Event list or observation definition file [NONE] obs.xml - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Calibration database [prod2] + Instrument response function [South_50h] Counts cube for exposure cube definition [NONE] cntcube.fits - Output exposure cube file [expcube.fits] + Output exposure cube file [expcube.fits] .. code-block:: bash $ ctpsfcube Event list or observation definition file [NONE] obs.xml - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Calibration database [prod2] + Instrument response function [South_50h] Counts cube for psf cube definition [NONE] - First coordinate of image center in degrees (RA or galactic l) [83.63] - Second coordinate of image center in degrees (DEC or galactic b) [22.01] - Projection method e.g. AIT|AZP|CAR|MER|MOL|STG|TAN (AIT|AZP|CAR|MER|MOL|STG|TAN) [CAR] + First coordinate of image center in degrees (RA or galactic l) (0-360) [83.63] + Second coordinate of image center in degrees (DEC or galactic b) (-90-90) [22.01] + Projection method (AIT|AZP|CAR|MER|MOL|STG|TAN) [CAR] Coordinate system (CEL - celestial, GAL - galactic) (CEL|GAL) [CEL] Image scale (in degrees/pixel) [1.0] Size of the X axis in pixels [10] Size of the Y axis in pixels [10] - Start value for first energy bin in TeV [0.1] - Stop value for last energy bin in TeV [100.0] + Lower energy limit (TeV) [0.1] + Upper energy limit (TeV) [100.0] Number of energy bins [20] - Output psf cube file [psfcube.fits] + Output psf cube file [psfcube.fits] We provide the ``obs.xml`` file on input to inform both tools which observations have been combined. @@ -93,17 +94,17 @@ background cube using the :ref:`ctbkgcube` tool: $ ctbkgcube Input event list or observation definition file [NONE] obs.xml - Calibration database [dummy] - Instrument response function [cta_dummy_irf] - Input (background) model XML file [NONE] $CTOOLS/share/models/crab.xml + Calibration database [prod2] + Instrument response function [South_50h] Counts cube for background cube definition [NONE] cntcube.fits + Input model XML file [NONE] $CTOOLS/share/models/crab.xml Output background cube file [bkgcube.fits] - Output (background) model XML file [NONE] model.xml + Output model XML file [NONE] model.xml The usage of :ref:`ctbkgcube` is very similar to that of :ref:`ctexpcube`, yet it takes the model XML file as an additional input parameter. -We here use the usual ``$CTOOLS/share/models/crab.xml`` Crab plus -background model file that is shipped with the ctools. +We here use the usual ``$CTOOLS/share/models/crab.xml`` model +file that is shipped with the ctools. :ref:`ctbkgcube` provides on output the background cube file ``bkgcube.fits`` and the model XML file ``model.xml`` that can be used for further analysis. @@ -125,25 +126,21 @@ modelling works: - + - - - The Crab source component is the same that is also present in ``$CTOOLS/share/models/crab.xml`` and is not modified. -The background component, however, has been replaced and now is -the ``ctbkgcube default background model``. -This model is of type ``CTACubeBackground`` which is a 3-dimensional -data cube that describes the expected background rate as function -of spatial position and energy. +The background component, however, has been replaced by a model of +type ``CTACubeBackground``. +This model is a 3-dimensional data cube that describes the expected +background rate as function of spatial position and energy. The data cube is multiplied by a power law spectrum that allows to adjust the normalization and slope of the background spectrum in the fit. This power law could be replaced by any spectral model that is found @@ -166,87 +163,82 @@ analysis using the :ref:`ctlike` tool: .. code-block:: bash $ ctlike - Event list, counts cube or observation definition file [events.fits] cntcube.fits - Exposure cube file [NONE] expcube.fits - PSF cube file [NONE] psfcube.fits + Event list, counts cube or observation definition file [obs.xml] cntcube.fits + Exposure cube file (only needed for stacked analysis) [NONE] expcube.fits + PSF cube file (only needed for stacked analysis) [NONE] psfcube.fits + Background cube file (only needed for stacked analysis) [NONE] bkgcube.fits Source model [$CTOOLS/share/models/crab.xml] model.xml - Source model output file [crab_results.xml] + Source model output file [crab_results.xml] :ref:`ctlike` recognises that a counts cube should be analysed and queries -for the exposure cube and PSF cube file names. -We specified the names of the files produced by the :ref:`ctexpcube` and -:ref:`ctpsfcube` tools and furthermore provided the ``model.xml`` file -that is generated by the :ref:`ctbkgcube` tool as source model. +for the exposure cube, the PSF cube, and the background cube file names. +We specified the names of the files produced by the :ref:`ctexpcube`, +the :ref:`ctpsfcube` and the :ref:`ctbkgcube` tools. +Furthermore we provided as model the ``model.xml`` file that has been +generated by the :ref:`ctbkgcube` tool. + The log file of the :ref:`ctlike` run is shown below. Note that the spectral model that is multiplied with the background -cube has a Prefactor of 1.06 +/- 0.02 and an Index of 0.004 +/- 0.009, +cube has a Prefactor of 1.09 +/- 0.02 and an Index of 0.03 +/- 0.01, indicating a very small correction to the actual spectrum of the background cube. Real life situations may of course require larger correction factors. .. code-block:: xml - 2015-02-04T23:00:25: +=================================+ - 2015-02-04T23:00:25: | Maximum likelihood optimisation | - 2015-02-04T23:00:25: +=================================+ - 2015-02-04T23:00:29: >Iteration 0: -logL=36748.112, Lambda=1.0e-03 - 2015-02-04T23:00:33: >Iteration 1: -logL=36734.170, Lambda=1.0e-03, delta=13.942, max(|grad|)=34.291911 [Index:8] - 2015-02-04T23:00:38: >Iteration 2: -logL=36734.127, Lambda=1.0e-04, delta=0.044, max(|grad|)=0.178088 [Index:8] - 2015-02-04T23:00:42: >Iteration 3: -logL=36734.127, Lambda=1.0e-05, delta=0.000, max(|grad|)=-0.001993 [Index:8] - 2015-02-04T23:00:46: - 2015-02-04T23:00:46: +=========================================+ - 2015-02-04T23:00:46: | Maximum likelihood optimization results | - 2015-02-04T23:00:46: +=========================================+ - 2015-02-04T23:00:46: === GOptimizerLM === - 2015-02-04T23:00:46: Optimized function value ..: 36734.127 - 2015-02-04T23:00:46: Absolute precision ........: 0.005 - 2015-02-04T23:00:46: Acceptable value decrease .: 2 - 2015-02-04T23:00:46: Optimization status .......: converged - 2015-02-04T23:00:46: Number of parameters ......: 11 - 2015-02-04T23:00:46: Number of free parameters .: 4 - 2015-02-04T23:00:46: Number of iterations ......: 3 - 2015-02-04T23:00:46: Lambda ....................: 1e-06 - 2015-02-04T23:00:46: Maximum log likelihood ....: -36734.127 - 2015-02-04T23:00:46: Observed events (Nobs) ...: 10685.000 - 2015-02-04T23:00:46: Predicted events (Npred) ..: 10685.000 (Nobs - Npred = 2.06522e-06) - 2015-02-04T23:00:46: === GModels === - 2015-02-04T23:00:46: Number of models ..........: 2 - 2015-02-04T23:00:46: Number of parameters ......: 11 - 2015-02-04T23:00:46: === GModelSky === - 2015-02-04T23:00:46: Name ......................: Crab - 2015-02-04T23:00:46: Instruments ...............: all - 2015-02-04T23:00:46: Instrument scale factors ..: unity - 2015-02-04T23:00:46: Observation identifiers ...: all - 2015-02-04T23:00:46: Model type ................: PointSource - 2015-02-04T23:00:46: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" - 2015-02-04T23:00:46: Number of parameters ......: 6 - 2015-02-04T23:00:46: Number of spatial par's ...: 2 - 2015-02-04T23:00:46: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) - 2015-02-04T23:00:46: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) - 2015-02-04T23:00:46: Number of spectral par's ..: 3 - 2015-02-04T23:00:46: Prefactor ................: 6.01471e-16 +/- 1.44183e-17 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) - 2015-02-04T23:00:46: Index ....................: -2.49533 +/- 0.0179769 [-0,-5] (free,scale=-1,gradient) - 2015-02-04T23:00:46: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) - 2015-02-04T23:00:46: Number of temporal par's ..: 1 - 2015-02-04T23:00:46: Constant .................: 1 (relative value) (fixed,scale=1,gradient) - 2015-02-04T23:00:46: === GCTAModelCubeBackground === - 2015-02-04T23:00:46: Name ......................: ctbkgcube default background model - 2015-02-04T23:00:46: Instruments ...............: all - 2015-02-04T23:00:46: Instrument scale factors ..: unity - 2015-02-04T23:00:46: Observation identifiers ...: all - 2015-02-04T23:00:46: Model type ................: "MapCubeFunction" * "PowerLaw" * "Constant" - 2015-02-04T23:00:46: Number of parameters ......: 5 - 2015-02-04T23:00:46: Number of spatial par's ...: 1 - 2015-02-04T23:00:46: Normalization ............: 1 [0.001,1000] (fixed,scale=1,gradient) - 2015-02-04T23:00:46: Number of spectral par's ..: 3 - 2015-02-04T23:00:46: Prefactor ................: 1.05876 +/- 0.0178132 [0,infty[ ph/cm2/s/MeV (free,scale=1,gradient) - 2015-02-04T23:00:46: Index ....................: 0.00396962 +/- 0.00881842 [-10,10] (free,scale=1,gradient) - 2015-02-04T23:00:46: PivotEnergy ..............: 1e+06 MeV (fixed,scale=1e+06,gradient) - 2015-02-04T23:00:46: Number of temporal par's ..: 1 - 2015-02-04T23:00:46: Constant .................: 1 (relative value) (fixed,scale=1,gradient) - 2015-02-04T23:00:46: - 2015-02-04T23:00:46: +==============+ - 2015-02-04T23:00:46: | Save results | - 2015-02-04T23:00:46: +==============+ - 2015-02-04T23:00:46: - 2015-02-04T23:00:46: Application "ctlike" terminated after 43 wall clock seconds, consuming 21.5624 seconds of CPU time. + 2015-05-22T21:10:09: +=================================+ + 2015-05-22T21:10:09: | Maximum likelihood optimisation | + 2015-05-22T21:10:09: +=================================+ + 2015-05-22T21:10:10: >Iteration 0: -logL=60663.798, Lambda=1.0e-03 + 2015-05-22T21:10:11: >Iteration 1: -logL=60642.413, Lambda=1.0e-03, delta=21.385, max(|grad|)=120.031102 [Index:7] + 2015-05-22T21:10:13: >Iteration 2: -logL=60642.233, Lambda=1.0e-04, delta=0.180, max(|grad|)=1.139187 [Index:7] + 2015-05-22T21:10:14: >Iteration 3: -logL=60642.233, Lambda=1.0e-05, delta=0.000, max(|grad|)=-0.001247 [Index:7] + 2015-05-22T21:10:16: + 2015-05-22T21:10:16: +=========================================+ + 2015-05-22T21:10:16: | Maximum likelihood optimization results | + 2015-05-22T21:10:16: +=========================================+ + 2015-05-22T21:10:16: === GOptimizerLM === + 2015-05-22T21:10:16: Optimized function value ..: 60642.233 + 2015-05-22T21:10:16: Absolute precision ........: 0.005 + 2015-05-22T21:10:16: Acceptable value decrease .: 2 + 2015-05-22T21:10:16: Optimization status .......: converged + 2015-05-22T21:10:16: Number of parameters ......: 10 + 2015-05-22T21:10:16: Number of free parameters .: 4 + 2015-05-22T21:10:16: Number of iterations ......: 3 + 2015-05-22T21:10:16: Lambda ....................: 1e-06 + 2015-05-22T21:10:16: Maximum log likelihood ....: -60642.233 + 2015-05-22T21:10:16: Observed events (Nobs) ...: 25963.000 + 2015-05-22T21:10:16: Predicted events (Npred) ..: 25963.000 (Nobs - Npred = 1.5749e-05) + 2015-05-22T21:10:16: === GModels === + 2015-05-22T21:10:16: Number of models ..........: 2 + 2015-05-22T21:10:16: Number of parameters ......: 10 + 2015-05-22T21:10:16: === GModelSky === + 2015-05-22T21:10:16: Name ......................: Crab + 2015-05-22T21:10:16: Instruments ...............: all + 2015-05-22T21:10:16: Instrument scale factors ..: unity + 2015-05-22T21:10:16: Observation identifiers ...: all + 2015-05-22T21:10:16: Model type ................: PointSource + 2015-05-22T21:10:16: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" + 2015-05-22T21:10:16: Number of parameters ......: 6 + 2015-05-22T21:10:16: Number of spatial par's ...: 2 + 2015-05-22T21:10:16: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) + 2015-05-22T21:10:16: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) + 2015-05-22T21:10:16: Number of spectral par's ..: 3 + 2015-05-22T21:10:16: Prefactor ................: 5.8499e-16 +/- 8.02289e-18 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) + 2015-05-22T21:10:16: Index ....................: -2.49909 +/- 0.0118976 [-0,-5] (free,scale=-1,gradient) + 2015-05-22T21:10:16: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T21:10:16: Number of temporal par's ..: 1 + 2015-05-22T21:10:16: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) + 2015-05-22T21:10:16: === GCTAModelCubeBackground === + 2015-05-22T21:10:16: Name ......................: BackgroundModel + 2015-05-22T21:10:16: Instruments ...............: CTA, HESS, MAGIC, VERITAS + 2015-05-22T21:10:16: Instrument scale factors ..: unity + 2015-05-22T21:10:16: Observation identifiers ...: all + 2015-05-22T21:10:16: Model type ................: "PowerLaw" * "Constant" + 2015-05-22T21:10:16: Number of parameters ......: 4 + 2015-05-22T21:10:16: Number of spectral par's ..: 3 + 2015-05-22T21:10:16: Prefactor ................: 1.08781 +/- 0.0212678 [0,infty[ ph/cm2/s/MeV (free,scale=1,gradient) + 2015-05-22T21:10:16: Index ....................: 0.0269681 +/- 0.0111532 [-10,10] (free,scale=1,gradient) + 2015-05-22T21:10:16: PivotEnergy ..............: 1e+06 MeV (fixed,scale=1e+06,gradient) + 2015-05-22T21:10:16: Number of temporal par's ..: 1 + 2015-05-22T21:10:16: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) diff --git a/doc/source/user_manual/getting_started/beyond_tsmap.rst b/doc/source/user_manual/getting_started/beyond_tsmap.rst index 4f9dc71..c34be7e 100644 --- a/doc/source/user_manual/getting_started/beyond_tsmap.rst +++ b/doc/source/user_manual/getting_started/beyond_tsmap.rst @@ -6,7 +6,7 @@ Generating a Test Statistic map In the above examples we were always considering that we knew exactly where the source is located, but in real life situations this may not necessarily be the case. -We thus need a mean to search for significant excess emission in our data. +We thus need a means to search for significant excess emission in our data. One possibility to accomplish this task is to compute the Test Statistic for a specific source at a grid of trial positions. The :ref:`cttsmap` tool will exactly do that job. @@ -32,25 +32,25 @@ nominal position of the Crab nebula with a grid spacing of 0.02 degrees. $ cttsmap Input event list, counts cube or observation definition file [events.fits] obs.xml - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Calibration database [prod2] + Instrument response function [South_50h] Source model [$CTOOLS/share/models/crab.xml] Test source [Crab] - First coordinate of image center in degrees (RA or galactic l) [83.63] - Second coordinate of image center in degrees (DEC or galactic b) [22.01] - Projection method e.g. AIT|AZP|CAR|MER|STG|TAN (AIT|AZP|CAR|MER|STG|TAN) [CAR] + First coordinate of image center in degrees (RA or galactic l) (0-360) [83.63] + Second coordinate of image center in degrees (DEC or galactic b) (-90-90) [22.01] + Projection method (AIT|AZP|CAR|MER|MOL|STG|TAN) [CAR] Coordinate system (CEL - celestial, GAL - galactic) (CEL|GAL) [CEL] Image scale (in degrees/pixel) [0.02] Size of the X axis in pixels [200] 10 Size of the Y axis in pixels [200] 10 - Output Test Statistic map [tsmap.fits] + Output Test Statistic map [tsmap.fits] :ref:`cttsmap` writes the Test Statistic map in the ``tsmap.fits`` file that contains one extension for the Test Statistic value and further extensions for the spectral parameters that have been fitted for the source at each position of the grid. The figure below show the Test Statistic map which reaches a maximum -value of 13782 near the centre of the map. +value of 37484 near the centre of the map. .. figure:: tsmap-crab.png :height: 400px diff --git a/doc/source/user_manual/getting_started/caldb.tar.gz b/doc/source/user_manual/getting_started/caldb.tar.gz deleted file mode 100644 index 507b2f5..0000000 --- a/doc/source/user_manual/getting_started/caldb.tar.gz +++ /dev/null diff --git a/doc/source/user_manual/getting_started/irf-aeff.png b/doc/source/user_manual/getting_started/irf-aeff.png new file mode 100644 index 0000000..eabbe69 --- /dev/null +++ b/doc/source/user_manual/getting_started/irf-aeff.png diff --git a/doc/source/user_manual/getting_started/irf-file.png b/doc/source/user_manual/getting_started/irf-file.png new file mode 100644 index 0000000..31f1599 --- /dev/null +++ b/doc/source/user_manual/getting_started/irf-file.png diff --git a/doc/source/user_manual/getting_started/models.rst b/doc/source/user_manual/getting_started/models.rst index bbe552c..981c837 100644 --- a/doc/source/user_manual/getting_started/models.rst +++ b/doc/source/user_manual/getting_started/models.rst @@ -319,22 +319,6 @@ CTA cube background .. code-block:: xml - - - - - - - ... - - - - .. code-block:: xml - - - - - ... diff --git a/doc/source/user_manual/getting_started/python.rst b/doc/source/user_manual/getting_started/python.rst index d830088..262cd32 100644 --- a/doc/source/user_manual/getting_started/python.rst +++ b/doc/source/user_manual/getting_started/python.rst @@ -20,7 +20,7 @@ generally not very useful. .. warning:: - The GammaLib module needs to be imported before the ctools + The GammaLib module needs to be imported **before** the ctools module so that GammaLib class types are handled correctly. So make sure that you **always import the GammaLib module before the ctools module.** @@ -42,8 +42,8 @@ way as if it were executed from the command line. >>> sim = ctools.ctobssim() >>> sim["inmodel"].filename("${CTOOLS}/share/models/crab.xml") >>> sim["outevents"].filename("events.fits") - >>> sim["caldb"].string("dummy") - >>> sim["irf"].string("cta_dummy_irf") + >>> sim["caldb"].string("prod2") + >>> sim["irf"].string("South_50h") >>> sim["ra"].real(83.63) >>> sim["dec"].real(22.01) >>> sim["rad"].real(5.0) @@ -95,13 +95,13 @@ in that observation you may type: >>> print(sim.obs()[0].events()) === GCTAEventList === - Number of events ..........: 12152 + Number of events ..........: 31928 Time interval .............: 51544.5 - 51544.5 days === GEbounds === Number of intervals .......: 1 Energy range ..............: 100 GeV - 100 TeV === GCTARoi === - ROI centre ................: RA=83.63, DEC=22.01 [0, 0] + ROI centre ................: RA=83.63, DEC=22.01 [0,0] ROI radius ................: 5 deg The ``obs()[0]`` operator returns the first observation in the observation @@ -114,11 +114,12 @@ To see what kind of object you actually got, use: >>> type(sim.obs()[0].events()) -The CTA event list is implement as the ``GCTAEventList`` class in the +The CTA event list is implement by the ``GCTAEventList`` class in the ``cta`` module of GammaLib. To visualise the individual events you can iterate over the events using a for loop. -This will show the simulated celestial coordinates (RA, DEC), energies and +This will show the simulated celestial coordinates (RA, DEC), the +coordinate in the camera system [DETX, DETY], energies and terrestrial times (TT) of all events. .. code-block:: python @@ -127,9 +128,9 @@ terrestrial times (TT) of all events. >>> for event in events: ... print(event) ... - Dir=RA=83.6477, DEC=22.0202 [0.000178879, 0.000286637] Energy=3.235 TeV Time=-3.15576e+08 s (TT) - Dir=RA=83.482, DEC=22.0189 [0.000155643, -0.00239471] Energy=141.949 GeV Time=-3.15576e+08 s (TT) - Dir=RA=83.6058, DEC=22.1586 [0.00259306, -0.000391919] Energy=316.376 GeV Time=-3.15576e+08 s (TT) + Dir=RA=83.5759, DEC=21.9757 [-0.000597839,-0.000875483] Energy=328.153 GeV Time=-3.15576e+08 s (TT) + Dir=RA=83.5775, DEC=22.0128 [4.88943e-05,-0.000849504] Energy=353.264 GeV Time=-3.15576e+08 s (TT) + Dir=RA=83.4302, DEC=21.931 [-0.00137616,-0.0032343] Energy=117.999 GeV Time=-3.15576e+08 s (TT) ... .. note:: @@ -150,13 +151,13 @@ terrestrial times (TT) of all events. >>> sim.run() >>> print(sim.obs()[0].events()) === GCTAEventList === - Number of events ..........: 6141 + Number of events ..........: 15964 Time interval .............: 51544.5 - 51544.5 days === GEbounds === Number of intervals .......: 1 Energy range ..............: 100 GeV - 100 TeV === GCTARoi === - ROI centre ................: RA=83.63, DEC=22.01 [0, 0] + ROI centre ................: RA=83.63, DEC=22.01 [0,0] ROI radius ................: 5 deg @@ -178,28 +179,30 @@ Where are the user parameters? :ref:`ctlike` doesn't in fact need any as all the relevant information is already contained in the observation container produced by the :ref:`ctobssim` class. -And you make have recognised that we constructed the :ref:`ctlike` +And you may have recognised that we constructed the :ref:`ctlike` instance by using the :ref:`ctobssim` observation container as constructor argument. -To check how the fit went you may inspect the optimiser class used by +To check how the fit went you can inspect the optimiser used by :ref:`ctlike`: .. code-block:: python >>> print(like.opt()) === GOptimizerLM === - Optimized function value ..: 44578.761 + Optimized function value ..: 101048.382 Absolute precision ........: 0.005 Acceptable value decrease .: 2 Optimization status .......: converged - Number of parameters ......: 9 + Number of parameters ......: 10 Number of free parameters .: 4 - Number of iterations ......: 3 - Lambda ....................: 1e-06 + Number of iterations ......: 2 + Lambda ....................: 1e-05 -Apparently, the fit converged after fitting 4 parameters in 3 iterations. -To inspect the fit results you may print the model container that is a +Apparently, the fit converged after 2 iterations. +Out of 10 parameters in the model 4 have been fitted (the others were kept +fixed). +To inspect the fit results you can print the model container that is a member of the observation container: .. code-block:: python @@ -207,7 +210,7 @@ member of the observation container: >>> print(like.obs().models()) === GModels === Number of models ..........: 2 - Number of parameters ......: 9 + Number of parameters ......: 10 === GModelSky === Name ......................: Crab Instruments ...............: all @@ -220,24 +223,24 @@ member of the observation container: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) Number of spectral par's ..: 3 - Prefactor ................: 6.13265e-16 +/- 2.05734e-17 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) - Index ....................: -2.50565 +/- 0.0250831 [-0,-5] (free,scale=-1,gradient) + Prefactor ................: 5.80565e-16 +/- 1.11147e-17 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) + Index ....................: -2.49266 +/- 0.0163476 [-0,-5] (free,scale=-1,gradient) PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) Number of temporal par's ..: 1 - Constant .................: 1 (relative value) (fixed,scale=1,gradient) - === GCTAModelRadialAcceptance === - Name ......................: Background + Normalization ............: 1 (relative value) (fixed,scale=1,gradient) + === GCTAModelIrfBackground === + Name ......................: CTABackgroundModel Instruments ...............: CTA Instrument scale factors ..: unity Observation identifiers ...: all - Model type ................: "Gaussian" * "FileFunction" * "Constant" - Number of parameters ......: 3 - Number of radial par's ....: 1 - Sigma ....................: 3.03693 +/- 0.0304896 [0.01,10] deg2 (free,scale=1,gradient) - Number of spectral par's ..: 1 - Normalization ............: 0.998667 +/- 0.0172585 [0,1000] (free,scale=1,gradient) + Model type ................: "PowerLaw" * "Constant" + Number of parameters ......: 4 + Number of spectral par's ..: 3 + Prefactor ................: 1.01701 +/- 0.0216563 [0.001,1000] ph/cm2/s/MeV (free,scale=1,gradient) + Index ....................: 0.0230864 +/- 0.0123006 [-5,5] (free,scale=1,gradient) + PivotEnergy ..............: 1e+06 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) Number of temporal par's ..: 1 - Constant .................: 1 (relative value) (fixed,scale=1,gradient) + Normalization ............: 1 (relative value) (fixed,scale=1,gradient) Suppose you want to repeat the fit by optimising also the position of the point source. @@ -250,8 +253,8 @@ This is easy from Python: >>> like.run() >>> print(like.obs().models()) ... - RA .......................: 83.633 +/- 0.00137216 [-360,360] deg (free,scale=1) - DEC ......................: 22.0144 +/- 0.00127247 [-90,90] deg (free,scale=1) + RA .......................: 83.6341 +/- 0.000958947 [-360,360] deg (free,scale=1) + DEC ......................: 22.0139 +/- 0.000870912 [-90,90] deg (free,scale=1) The ``like.obs().models()`` method provides the model container, using the ``["Crab"]`` operator we access the Crab model in that container and using @@ -293,12 +296,12 @@ the ``fix()`` method. >>> print(like.obs()) === GObservations === Number of observations ....: 1 - Number of predicted events : 6141 + Number of predicted events : 15964 is okay as the ``ctools.ctlike(sim.obs())`` constructor will create a copy of the observation container that lives within the :ref:`ctlike` instance. - To preserve an observation container after a ctools object went out + To preserve an observation container after a ctools object goes out of scope you have to create a local copy of the container using the ``copy()`` method: @@ -327,8 +330,8 @@ Here an example of how to use ``obsutils``: >>> import ctools >>> from ctools import obsutils >>> pattern = obsutils.set_obs_patterns("four", ra=83.63, dec=22.01, offset=1.0) - >>> obs = obsutils.set_obs_list(pattern, duration=1800, emin=0.1, emax=100.0, rad=5.0, caldb="dummy", irf="cta_dummy_irf") - >>> print(like.obs()) + >>> obs = obsutils.set_obs_list(pattern, duration=1800, emin=0.1, emax=100.0, rad=5.0, caldb="prod2", irf="South_50h") + >>> print(obs) === GObservations === Number of observations ....: 4 Number of predicted events : 0 @@ -339,7 +342,7 @@ Here an example of how to use ``obsutils``: >>> print(like.obs().models()) === GModels === Number of models ..........: 2 - Number of parameters ......: 9 + Number of parameters ......: 10 ... The module is imported using the ``from ctools import obsutils`` directive. diff --git a/doc/source/user_manual/getting_started/quickstart.rst b/doc/source/user_manual/getting_started/quickstart.rst index 8e4d528..65fa257 100644 --- a/doc/source/user_manual/getting_started/quickstart.rst +++ b/doc/source/user_manual/getting_started/quickstart.rst @@ -39,14 +39,14 @@ type :ref:`ctobssim` at the console prompt (which is denoted by ``$``). RA of pointing (degrees) (0-360) [83.63] Dec of pointing (degrees) (-90-90) [22.01] Radius of FOV (degrees) (0-180) [5.0] - Start time (MET in s) (0) [0.0] - End time (MET in s) (0) [1800.0] - Lower energy limit (TeV) (0) [0.1] - Upper energy limit (TeV) (0) [100.0] - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Start time (MET in s) [0.0] + End time (MET in s) [1800.0] + Lower energy limit (TeV) [0.1] + Upper energy limit (TeV) [100.0] + Calibration database [prod2] + Instrument response function [South_50h] Model [$CTOOLS/share/models/crab.xml] - Output event data file or observation definition file [events.fits] + Output event data file or observation definition file [events.fits] Each line represents a query for one parameter value. The line starts with a short description of the parameter, followed by @@ -62,8 +62,18 @@ You may have recognised that the environment variable ``$CTOOLS`` has been used in the path name of the model. ctools will automatically expand the environment variables in parameter inputs. -The CTA instrument properties (effective area, PSF width) are taken for -the moment from a dummy calibration database. +The CTA instrument properties (effective area, PSF width) are taken from +the prod2 database. The response for the southern array using the cuts +optimised for 50 hours of observing time are used. + +.. note:: + + ctools comes bundled with CTA response functions for the northern and + the southern array. The response functions are based on a Prod2 + analysis with cuts optimised for 0.5 hours, 5 hours and 50 hours of + observing time. The following Instrument Response Functions + (IRFs) are available: ``North_0.5h``, ``North_5h``, ``North_50h``, + ``South_0.5h``, ``South_5h``, and ``South_50h``. Events are simulated based on the instrument properties and based on a source and background model. Only events that fall within the specified @@ -90,14 +100,13 @@ The source and background model is defined by the XML file - - - + + + + + - - - - + The model consists of a source library that contains two components: @@ -107,14 +116,15 @@ The Crab nebula is modelled by a factorized sky model that has a spectral and a spatial component (tags ```` and ````, respectively). The spectrum is modelled by a power law, which is defined by three parameters: the ``Prefactor``, the ``Index`` and the ``Scale``. -The spatial model has two parameters: Right Ascension in degrees (RA), and -Declination in degrees (DEC). Each parameter has a value and a scale factor, +The spatial model has two parameters: Right Ascension in degrees (``RA``), and +Declination in degrees (``DEC``). Each parameter has a value and a scale factor, the real value of the parameter being the product ``value * scale``. Typically, -scale is chosen so that value is of the order of 1 (this is relevant for -model fitting). In addition, value is bound by a minimum (min) and -maximum (max) value, and a parameter may be free (``free="1"``) or fixed -(``free="0"``). The min, max, and free attributes are not relevant here for -the simulations, but they will be important for the model fitting later. +``scale`` is chosen so that ``value`` is of the order of 1 (this is relevant for +model fitting). In addition, ``value`` is bound by a minimum (``min``) and +maximum (``max``) value, and a parameter may be free (``free="1"``) or fixed +(``free="0"``). The ``min``, ``max``, and ``free`` attributes are not +relevant here for the simulations, but they will be important for the model +fitting later. The spectral intensity I(E) (in units of photons/cm2/s/MeV) of the power law is given by @@ -128,19 +138,20 @@ where the parameters in the XML definition have the following mappings: * :math:`\gamma` = ``Index`` * :math:`E_0` = ``Scale`` -Note that energies are given in MeV. This is a GammaLib convention that -can not be modified. **So make sure you always use MeV as energy unit in -an XML file.** +.. warning:: + + Energies are given in the XML file in MeV units. This is a GammaLib + convention that can not be modified. **So make sure you always use + MeV as energy unit in an XML file.** -The instrumental background of CTA is modelled by a factorized data model -that has a spectral and a radial component (tags ```` and -````, respectively). The spectral component describes the -on-axis background counting rate of CTA as function of energy in units of -counts/s/sr/MeV. The radial component describes the variation of the -background rate with offset angle squared, (i.e. square of the offset angle -with respect to the pointing direction) which is modelled here by a Gaussian. -The only parameter of the radial component is the width of the Gaussian Sigma, -which is here set to 3 degrees squared. +The instrumental background of CTA is modelled using the background +information provided in the IRF (``CTAIrfBackground``) multipled +by a power law. As it is defined here, the power law represents a +constant of 1, hence the background IRF will be used without any +modification. The power law will become active when fitting the data +later and allows a spectral adjustment of the background model that +may account for uncertainties in the background information provided +in the IRF. :ref:`ctobssim` has a couple of hidden parameters, the most important one being certainly ``seed``. ``seed`` is an integer that specifies the seed value @@ -167,25 +178,25 @@ from this file are shown here: .. code-block:: xml - 2015-02-04T15:04:56: +======================+ - 2015-02-04T15:04:56: | Simulate observation | - 2015-02-04T15:04:56: +======================+ - 2015-02-04T15:04:56: === Observation === - 2015-02-04T15:04:56: Simulation area ...........: 1.9635e+11 cm2 - 2015-02-04T15:04:56: Simulation cone ...........: RA=83.63 deg, Dec=22.01 deg, r=5.5 deg - 2015-02-04T15:04:56: Time interval .............: 0 - 1800 s - 2015-02-04T15:04:56: Photon energy range .......: 100 GeV - 100 TeV - 2015-02-04T15:04:56: Event energy range ........: 100 GeV - 100 TeV - 2015-02-04T15:04:56: MC source photons .........: 207547 [Crab] - 2015-02-04T15:04:56: MC source events ..........: 995 [Crab] - 2015-02-04T15:04:56: MC source events ..........: 995 (all source models) - 2015-02-04T15:04:56: MC background events ......: 5146 - 2015-02-04T15:04:56: MC events .................: 6141 (all models) + 2015-05-22T19:24:53: +======================+ + 2015-05-22T19:24:53: | Simulate observation | + 2015-05-22T19:24:53: +======================+ + 2015-05-22T19:24:53: === Observation === + 2015-05-22T19:24:53: Simulation area ...........: 1.9635e+11 cm2 + 2015-05-22T19:24:53: Simulation cone ...........: RA=83.63 deg, Dec=22.01 deg, r=5.5 deg + 2015-05-22T19:24:53: Time interval .............: 0 - 1800 s + 2015-05-22T19:24:53: Photon energy range .......: 100 GeV - 100 TeV + 2015-05-22T19:24:53: Event energy range ........: 100 GeV - 100 TeV + 2015-05-22T19:24:53: MC source photons .........: 207547 [Crab] + 2015-05-22T19:24:53: MC source events ..........: 2961 [Crab] + 2015-05-22T19:24:53: MC source events ..........: 2961 (all source models) + 2015-05-22T19:24:55: MC background events ......: 13003 + 2015-05-22T19:24:55: MC events .................: 15964 (all models) Each line starts with the UTC time at which the line has been written. In this run, 207547 Crab photons have been thrown over an area of 19.6 square -kilometres during a time interval of 1800 seconds. 995 of these photons have -been registered by CTA as events. In the same time interval, 5146 background +kilometres during a time interval of 1800 seconds. 2961 of these photons have +been registered by CTA as events. In the same time interval, 13003 background events have been registred by CTA. You may change the name of the log file using the hidden parameter @@ -233,9 +244,9 @@ control). $ ctbin Event list or observation definition file [events.fits] - First coordinate of image center in degrees (RA or galactic l) [83.63] - Second coordinate of image center in degrees (DEC or galactic b) [22.01] - Projection method e.g. AIT|AZP|CAR|MER|STG|TAN (AIT|AZP|CAR|MER|STG|TAN) [CAR] + First coordinate of image center in degrees (RA or galactic l) (0-360) [83.63] + Second coordinate of image center in degrees (DEC or galactic b) (-90-90) [22.01] + Projection method (AIT|AZP|CAR|MER|MOL|STG|TAN) [CAR] Coordinate system (CEL - celestial, GAL - galactic) (CEL|GAL) [CEL] Image scale (in degrees/pixel) [0.02] Size of the X axis in pixels [200] @@ -244,7 +255,7 @@ control). Start value for first energy bin in TeV [0.1] Stop value for last energy bin in TeV [100.0] Number of energy bins [20] - Output counts cube [cntcube.fits] + Output counts cube [cntcube.fits] The counts cube will be centred on the location of the Crab (Right Ascension 83.63 degrees, Declination 22.01 degrees) and will be aligned in celestial @@ -285,41 +296,18 @@ reproduced below: .. code-block:: xml - 2015-02-04T15:33:34: +====================+ - 2015-02-04T15:33:34: | Binned observation | - 2015-02-04T15:33:34: +====================+ - 2015-02-04T15:33:34: === GObservations === - 2015-02-04T15:33:34: Number of observations ....: 1 - 2015-02-04T15:33:34: Number of predicted events : 0 - 2015-02-04T15:33:34: === GCTAObservation === - 2015-02-04T15:33:34: Name ......................: - 2015-02-04T15:33:34: Identifier ................: - 2015-02-04T15:33:34: Instrument ................: CTA - 2015-02-04T15:33:34: Event file ................: - 2015-02-04T15:33:34: Event type ................: CountsCube - 2015-02-04T15:33:34: Statistics ................: Poisson - 2015-02-04T15:33:34: Ontime ....................: 1800 s - 2015-02-04T15:33:34: Livetime ..................: 1710 s - 2015-02-04T15:33:34: Deadtime correction .......: 0.95 - 2015-02-04T15:33:34: User energy range .........: undefined - 2015-02-04T15:33:34: === GCTAPointing === - 2015-02-04T15:33:34: Pointing direction ........: (RA,Dec)=(83.63,22.01) - 2015-02-04T15:33:34: Response function .........: undefined - 2015-02-04T15:33:34: === GCTAEventCube === - 2015-02-04T15:33:34: Number of events ..........: 5542 - 2015-02-04T15:33:34: Number of elements ........: 800000 - 2015-02-04T15:33:34: Number of pixels ..........: 40000 - 2015-02-04T15:33:34: Number of energy bins .....: 20 - 2015-02-04T15:33:34: Time interval .............: 0 - 1800 sec - 2015-02-04T15:33:34: - 2015-02-04T15:33:34: +==================+ - 2015-02-04T15:33:34: | Save observation | - 2015-02-04T15:33:34: +==================+ - 2015-02-04T15:33:34: - 2015-02-04T15:33:34: Application "ctbin" terminated after 14 wall clock seconds, consuming 0.332675 seconds of CPU time. - -From the 6141 events that have been simulated and stored in the -``events.fits`` file, 5542 lie within the cube boundaries and are thus put + 2015-05-22T19:40:30: +=================+ + 2015-05-22T19:40:30: | Bin observation | + 2015-05-22T19:40:30: +=================+ + 2015-05-22T19:40:30: === Observation === + 2015-05-22T19:40:30: Events in list ............: 15964 + 2015-05-22T19:40:30: Events in cube ............: 13360 + 2015-05-22T19:40:30: Event bins outside RoI ....: 0 + 2015-05-22T19:40:30: Events outside cube area ..: 2604 + 2015-05-22T19:40:30: Events outside energy bins : 0 + +From the 15964 events that have been simulated and stored in the +``events.fits`` file, 13360 lie within the cube boundaries and are thus put into the resulting counts cube. The counts cube is stored in a cartesian projection in a World Coordinate System (WCS) compliant format. @@ -340,12 +328,13 @@ and we do the fit by typing: Event list, counts cube or observation definition file [events.fits] cntcube.fits Exposure cube file (only needed for stacked analysis) [NONE] PSF cube file (only needed for stacked analysis) [NONE] - Calibration database [dummy] - Instrument response function [cta_dummy_irf] + Background cube file (only needed for stacked analysis) [NONE] + Calibration database [prod2] + Instrument response function [South_50h] Source model [$CTOOLS/share/models/crab.xml] Source model output file [crab_results.xml] -Fitting of the data is done in *binned* mode, which means that the events +The data are fitted in *binned* mode, which means that the events have been binned into a counts cube and the fit computes the log-likelihood function by summing over all 200 x 200 x 20 bins of the counts cube. There is an alternative method, the so called *unbinned* mode, where the events are @@ -356,8 +345,8 @@ One of the parameters of :ref:`ctlike` is a source model output file (we specified ``crab_results.xml`` in the example), and this file will be a copy of the source model input XML file where the parameter values have been replaced by the fit results. In addition, the statistical uncertainties -are added for each fitted parameter using the attribute error. Below we show -the XML result file that has been produced by the run: +are added for each fitted parameter using the attribute ``error``. +Below we show the XML result file that has been produced by the run: .. code-block:: xml @@ -365,8 +354,8 @@ the XML result file that has been produced by the run: - - + + @@ -374,20 +363,31 @@ the XML result file that has been produced by the run: - - - + + + + + - - - In this example, the ``Prefactor`` and ``Index`` of the spectral model for the -Crab as well as the ``Normalization`` and ``Sigma`` parameter of the radial -acceptance model have been fitted (all parameters having the attribute -``free="1"`` are fitted). +Crab as well as the ``Prefactor`` and ``Index`` of the background spectral +model have been fitted (all parameters having the attribute ``free="1"`` are +fitted). Now we see also the effect of having multiplied the background +model with a power law. In that way, the amplitude of the background as +well as it's spectral slope is adjusted by the fit. Obviously, in this +example the adjustment compensates only for the statistical fluctuations +of the background, but with real data, the adjustment may account also for +some of the systematic uncertainties. + +.. warning:: + + As good practice, the amplitude of the background model should always be + left as a free parameter of the fit. Otherwise, any uncertainty in the + background rate will immediately propagate into the flux estimate of the + source. To get more details about the model fitting you can inspect the log file. Below the last lines of the ctlike.log log file that has been produced by @@ -395,70 +395,63 @@ this run: .. code-block:: xml - 2015-02-04T15:50:43: +=================================+ - 2015-02-04T15:50:43: | Maximum likelihood optimisation | - 2015-02-04T15:50:43: +=================================+ - 2015-02-04T15:50:44: >Iteration 0: -logL=22752.553, Lambda=1.0e-03 - 2015-02-04T15:50:46: >Iteration 1: -logL=22750.640, Lambda=1.0e-03, delta=1.913, max(|grad|)=-0.941594 [Index:3] - 2015-02-04T15:50:47: >Iteration 2: -logL=22750.632, Lambda=1.0e-04, delta=0.008, max(|grad|)=-0.079270 [Index:3] - 2015-02-04T15:50:48: >Iteration 3: -logL=22750.632, Lambda=1.0e-05, delta=0.000, max(|grad|)=-0.003073 [Index:3] - 2015-02-04T15:50:49: - 2015-02-04T15:50:49: +=========================================+ - 2015-02-04T15:50:49: | Maximum likelihood optimization results | - 2015-02-04T15:50:49: +=========================================+ - 2015-02-04T15:50:49: === GOptimizerLM === - 2015-02-04T15:50:49: Optimized function value ..: 22750.632 - 2015-02-04T15:50:49: Absolute precision ........: 0.005 - 2015-02-04T15:50:49: Acceptable value decrease .: 2 - 2015-02-04T15:50:49: Optimization status .......: converged - 2015-02-04T15:50:49: Number of parameters ......: 9 - 2015-02-04T15:50:49: Number of free parameters .: 4 - 2015-02-04T15:50:49: Number of iterations ......: 3 - 2015-02-04T15:50:49: Lambda ....................: 1e-06 - 2015-02-04T15:50:49: Maximum log likelihood ....: -22750.632 - 2015-02-04T15:50:49: Observed events (Nobs) ...: 5542.000 - 2015-02-04T15:50:49: Predicted events (Npred) ..: 5542.000 (Nobs - Npred = 3.3498e-06) - 2015-02-04T15:50:49: === GModels === - 2015-02-04T15:50:49: Number of models ..........: 2 - 2015-02-04T15:50:49: Number of parameters ......: 9 - 2015-02-04T15:50:49: === GModelSky === - 2015-02-04T15:50:49: Name ......................: Crab - 2015-02-04T15:50:49: Instruments ...............: all - 2015-02-04T15:50:49: Instrument scale factors ..: unity - 2015-02-04T15:50:49: Observation identifiers ...: all - 2015-02-04T15:50:49: Model type ................: PointSource - 2015-02-04T15:50:49: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" - 2015-02-04T15:50:49: Number of parameters ......: 6 - 2015-02-04T15:50:49: Number of spatial par's ...: 2 - 2015-02-04T15:50:49: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) - 2015-02-04T15:50:49: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) - 2015-02-04T15:50:49: Number of spectral par's ..: 3 - 2015-02-04T15:50:49: Prefactor ................: 6.07928e-16 +/- 2.04582e-17 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) - 2015-02-04T15:50:49: Index ....................: -2.5009 +/- 0.0252057 [-0,-5] (free,scale=-1,gradient) - 2015-02-04T15:50:49: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) - 2015-02-04T15:50:49: Number of temporal par's ..: 1 - 2015-02-04T15:50:49: Constant .................: 1 (relative value) (fixed,scale=1,gradient) - 2015-02-04T15:50:49: === GCTAModelRadialAcceptance === - 2015-02-04T15:50:49: Name ......................: Background - 2015-02-04T15:50:49: Instruments ...............: CTA - 2015-02-04T15:50:49: Instrument scale factors ..: unity - 2015-02-04T15:50:49: Observation identifiers ...: all - 2015-02-04T15:50:49: Model type ................: "Gaussian" * "FileFunction" * "Constant" - 2015-02-04T15:50:49: Number of parameters ......: 3 - 2015-02-04T15:50:49: Number of radial par's ....: 1 - 2015-02-04T15:50:49: Sigma ....................: 3.02523 +/- 0.0594117 [0.01,10] deg2 (free,scale=1,gradient) - 2015-02-04T15:50:49: Number of spectral par's ..: 1 - 2015-02-04T15:50:49: Normalization ............: 0.990708 +/- 0.0192887 [0,1000] (free,scale=1,gradient) - 2015-02-04T15:50:49: Number of temporal par's ..: 1 - 2015-02-04T15:50:49: Constant .................: 1 (relative value) (fixed,scale=1,gradient) - 2015-02-04T15:50:49: - 2015-02-04T15:50:49: +==============+ - 2015-02-04T15:50:49: | Save results | - 2015-02-04T15:50:49: +==============+ - 2015-02-04T15:50:49: - 2015-02-04T15:50:49: Application "ctlike" terminated after 15 wall clock seconds, consuming 5.92686 seconds of CPU time. - -The maximum likelihood optimizer required 3 iterations to converge. This + 2015-05-22T19:45:15: +=================================+ + 2015-05-22T19:45:15: | Maximum likelihood optimisation | + 2015-05-22T19:45:15: +=================================+ + 2015-05-22T19:45:16: >Iteration 0: -logL=39910.748, Lambda=1.0e-03 + 2015-05-22T19:45:18: >Iteration 1: -logL=39908.788, Lambda=1.0e-03, delta=1.960, max(|grad|)=6.701856 [Index:7] + 2015-05-22T19:45:19: >Iteration 2: -logL=39908.787, Lambda=1.0e-04, delta=0.001, max(|grad|)=-0.057041 [Index:3] + 2015-05-22T19:45:21: + 2015-05-22T19:45:21: +=========================================+ + 2015-05-22T19:45:21: | Maximum likelihood optimization results | + 2015-05-22T19:45:21: +=========================================+ + 2015-05-22T19:45:21: === GOptimizerLM === + 2015-05-22T19:45:21: Optimized function value ..: 39908.787 + 2015-05-22T19:45:21: Absolute precision ........: 0.005 + 2015-05-22T19:45:21: Acceptable value decrease .: 2 + 2015-05-22T19:45:21: Optimization status .......: converged + 2015-05-22T19:45:21: Number of parameters ......: 10 + 2015-05-22T19:45:21: Number of free parameters .: 4 + 2015-05-22T19:45:21: Number of iterations ......: 2 + 2015-05-22T19:45:21: Lambda ....................: 1e-05 + 2015-05-22T19:45:21: Maximum log likelihood ....: -39908.787 + 2015-05-22T19:45:21: Observed events (Nobs) ...: 13360.000 + 2015-05-22T19:45:21: Predicted events (Npred) ..: 13359.998 (Nobs - Npred = 0.00180799) + 2015-05-22T19:45:21: === GModels === + 2015-05-22T19:45:21: Number of models ..........: 2 + 2015-05-22T19:45:21: Number of parameters ......: 10 + 2015-05-22T19:45:21: === GModelSky === + 2015-05-22T19:45:21: Name ......................: Crab + 2015-05-22T19:45:21: Instruments ...............: all + 2015-05-22T19:45:21: Instrument scale factors ..: unity + 2015-05-22T19:45:21: Observation identifiers ...: all + 2015-05-22T19:45:21: Model type ................: PointSource + 2015-05-22T19:45:21: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" + 2015-05-22T19:45:21: Number of parameters ......: 6 + 2015-05-22T19:45:21: Number of spatial par's ...: 2 + 2015-05-22T19:45:21: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) + 2015-05-22T19:45:21: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) + 2015-05-22T19:45:21: Number of spectral par's ..: 3 + 2015-05-22T19:45:21: Prefactor ................: 5.78197e-16 +/- 1.10889e-17 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) + 2015-05-22T19:45:21: Index ....................: -2.49174 +/- 0.0164369 [-0,-5] (free,scale=-1,gradient) + 2015-05-22T19:45:21: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T19:45:21: Number of temporal par's ..: 1 + 2015-05-22T19:45:21: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) + 2015-05-22T19:45:21: === GCTAModelIrfBackground === + 2015-05-22T19:45:21: Name ......................: CTABackgroundModel + 2015-05-22T19:45:21: Instruments ...............: CTA + 2015-05-22T19:45:21: Instrument scale factors ..: unity + 2015-05-22T19:45:21: Observation identifiers ...: all + 2015-05-22T19:45:21: Model type ................: "PowerLaw" * "Constant" + 2015-05-22T19:45:21: Number of parameters ......: 4 + 2015-05-22T19:45:21: Number of spectral par's ..: 3 + 2015-05-22T19:45:21: Prefactor ................: 1.02048 +/- 0.0280684 [0.001,1000] ph/cm2/s/MeV (free,scale=1,gradient) + 2015-05-22T19:45:21: Index ....................: 0.0197856 +/- 0.0156686 [-5,5] (free,scale=1,gradient) + 2015-05-22T19:45:21: PivotEnergy ..............: 1e+06 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T19:45:21: Number of temporal par's ..: 1 + 2015-05-22T19:45:21: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) + +The maximum likelihood optimizer required 2 iterations to converge. This is pretty fast, but recall that we used the same model file for the simulation and for fitting, hence the initial parameter values were already very close to the best fitting values. To see the impact of the initial parameters on @@ -466,7 +459,7 @@ the fit result, you may re-run :ref:`ctlike` using another copy of the model XML file where you change the value attributes of the parameters that should be fitted. You will see that the optimizer requires a couple of more iterations, but it should converge to the same solution (provided that the initial values -are not too far of the best fitting values). +are not too far from the best fitting values). .. note:: @@ -502,17 +495,17 @@ are not too far of the best fitting values). .. code-block:: xml - 2015-02-05T08:29:07: === GModelSky === - 2015-02-05T08:29:07: Name ......................: Crab - 2015-02-05T08:29:07: Instruments ...............: all - 2015-02-05T08:29:07: Test Statistic ............: 6875.35 + 2015-05-22T19:58:43: === GModelSky === + 2015-05-22T19:58:43: Name ......................: Crab + 2015-05-22T19:58:43: Instruments ...............: all + 2015-05-22T19:58:43: Test Statistic ............: 18662.6 The Test Statistic value will also be added as new attribute ``ts`` to the XML result file: .. code-block:: xml - + .. _sec_unbinned_cta: @@ -521,8 +514,8 @@ Doing an unbinned analysis ~~~~~~~~~~~~~~~~~~~~~~~~~~ As gamma-ray events are rare, the counts cubes generated by :ref:`ctbin` -will in general be sparse, having many empty pixels, in particular at -high energies. +will in general be sparsly populated, having many empty pixels, in +particular at high energies. An alternative analysis technique consists of working directly on the event list without binning the events in a counts cube. We will see the benefit of such an analysis later once you re-run :ref:`ctlike` in unbinned mode. @@ -553,10 +546,10 @@ following example shows how to run ctselect: RA for ROI centre (degrees) (0-360) [83.63] Dec for ROI centre (degrees) (-90-90) [22.01] Radius of ROI (degrees) (0-180) [3.0] - Start time (CTA MET in seconds) (0) [0.0] - End time (CTA MET in seconds) (0) [0.0] - Lower energy limit (TeV) (0) [0.1] - Upper energy limit (TeV) (0) [100.0] + Start time (CTA MET in seconds) [0.0] + End time (CTA MET in seconds) [0.0] + Lower energy limit (TeV) [0.1] + Upper energy limit (TeV) [100.0] Output event list or observation definition file [selected_events.fits] :ref:`ctselect` takes the input event list ``events.fits``, performs an @@ -585,16 +578,16 @@ part: .. code-block:: xml - 2015-02-04T17:21:41: +=================+ - 2015-02-04T17:21:41: | Event selection | - 2015-02-04T17:21:41: +=================+ - 2015-02-04T17:21:41: === Observation === - 2015-02-04T17:21:41: Selected energy range .....: 0.1 - 100 TeV - 2015-02-04T17:21:41: Requested ROI .............: Centre(RA,DEC)=(83.63, 22.01) deg, Radius=3 deg - 2015-02-04T17:21:41: ROI of data ...............: Centre(RA,DEC)=(83.63, 22.01) deg, Radius=5 deg - 2015-02-04T17:21:41: Selected ROI ..............: Centre(RA,DEC)=(83.63, 22.01) deg, Radius=3 deg - 2015-02-04T17:21:41: cfitsio selection .........: ENERGY >= 0.10000000 && ENERGY <= 100.00000000 && ANGSEP(83.630000,22.010000,RA,DEC) <= 3.000000 - 2015-02-04T17:21:41: FITS filename .............: /var/tmp/tmp.0.pTIaTL[EVENTS][ENERGY >= 0.10000000 && ENERGY <= 100.00000000 && ANGSEP(83.630000,22.010000,RA,DEC) <= 3.000000] + 2015-05-22T20:01:46: +=================+ + 2015-05-22T20:01:46: | Event selection | + 2015-05-22T20:01:46: +=================+ + 2015-05-22T20:01:46: === Observation === + 2015-05-22T20:01:47: Selected energy range .....: 0.1 - 100 TeV + 2015-05-22T20:01:47: Requested ROI .............: Centre(RA,DEC)=(83.63, 22.01) deg, Radius=3 deg + 2015-05-22T20:01:47: ROI of data ...............: Centre(RA,DEC)=(83.63, 22.01) deg, Radius=5 deg + 2015-05-22T20:01:47: Selected ROI ..............: Centre(RA,DEC)=(83.63, 22.01) deg, Radius=3 deg + 2015-05-22T20:01:47: cfitsio selection .........: ENERGY >= 0.10000000 && ENERGY <= 100.00000000 && ANGSEP(83.630000,22.010000,RA,DEC) <= 3.000000 + 2015-05-22T20:01:47: FITS filename .............: /var/tmp/tmp.0.rRgLpO[EVENTS][ENERGY >= 0.10000000 && ENERGY <= 100.00000000 && ANGSEP(83.630000,22.010000,RA,DEC) <= 3.000000] .. note:: @@ -608,10 +601,10 @@ part: :ref:`ctselect` will automatically adjust the selection parameters to guarantee full enclosure. To keep track of this adjustment, the :ref:`ctselect` log file quotes the requested - selection, and existing selections, and the selection that was finally + selection, any existing selections, and the selection that was finally applied. -.. note:: +.. warning:: :ref:`ctselect` may of course also be used for event selection prior to binned analysis, for example to select events for a given period in @@ -627,24 +620,25 @@ instead of the counts cube: .. code-block:: bash - $ ctlike - Event list, counts cube or observation definition file [cntmap.fits] selected_events.fits - Calibration database [dummy] - Instrument response function [cta_dummy_irf] - Source model [$CTOOLS/share/models/crab.xml] - Source model output file [crab_results.xml] + $ ctlike + Event list, counts cube or observation definition file [cntcube.fits] selected_events.fits + Calibration database [prod2] + Instrument response function [South_50h] + Source model [$CTOOLS/share/models/crab.xml] + Source model output file [crab_results.xml] You will recognise that :ref:`ctlike` runs much faster in unbinned mode compared to binned mode. This is understandable as the selected event list contains -only 6127 events, while the binned counts cube we used before had +only 15312 events, while the binned counts cube we used before had 200 x 200 x 20 = 800000 pixels. As unbinned maximum likelihood fitting loops over the events (while binned maximum likelihood loops over the pixels), there are much less operations to perform in unbinned than in binned mode (there is some additional overhead in unbinned mode that comes from integrating the models over the region of interest, yet this is negligible -compared to the operations needed when looping over the pixels). So as long -as you work with short event lists, unbinned mode is faster. +compared to the operations needed when looping over all pixels). So as long +as you work with small event lists, unbinned mode is faster (this +typically holds up to 100 hours of observing time). Unbinned :ref:`ctlike` should also be more precise as no binning is performed, hence there is no loss of information due to histogramming. @@ -658,68 +652,62 @@ the same events for both analyses. .. code-block:: xml - 2015-02-04T17:31:58: +=================================+ - 2015-02-04T17:31:58: | Maximum likelihood optimisation | - 2015-02-04T17:31:58: +=================================+ - 2015-02-04T17:31:58: >Iteration 0: -logL=44395.244, Lambda=1.0e-03 - 2015-02-04T17:31:58: Iteration 1: -logL=44396.223, Lambda=1.0e-03, delta=-0.979, max(|grad|)=9.644743 [Sigma:6] (stalled) - 2015-02-04T17:31:58: >Iteration 2: -logL=44396.162, Lambda=1.0e-02, delta=0.061, max(|grad|)=-0.309683 [Normalization:7] - 2015-02-04T17:31:59: >Iteration 3: -logL=44396.162, Lambda=1.0e-03, delta=0.000, max(|grad|)=-0.008931 [Index:3] - 2015-02-04T17:31:59: - 2015-02-04T17:31:59: +=========================================+ - 2015-02-04T17:31:59: | Maximum likelihood optimization results | - 2015-02-04T17:31:59: +=========================================+ - 2015-02-04T17:31:59: === GOptimizerLM === - 2015-02-04T17:31:59: Optimized function value ..: 44396.162 - 2015-02-04T17:31:59: Absolute precision ........: 0.005 - 2015-02-04T17:31:59: Acceptable value decrease .: 2 - 2015-02-04T17:31:59: Optimization status .......: converged - 2015-02-04T17:31:59: Number of parameters ......: 9 - 2015-02-04T17:31:59: Number of free parameters .: 4 - 2015-02-04T17:31:59: Number of iterations ......: 3 - 2015-02-04T17:31:59: Lambda ....................: 0.0001 - 2015-02-04T17:31:59: Maximum log likelihood ....: -44396.162 - 2015-02-04T17:31:59: Observed events (Nobs) ...: 6127.000 - 2015-02-04T17:31:59: Predicted events (Npred) ..: 6127.000 (Nobs - Npred = 0.000303534) - 2015-02-04T17:31:59: === GModels === - 2015-02-04T17:31:59: Number of models ..........: 2 - 2015-02-04T17:31:59: Number of parameters ......: 9 - 2015-02-04T17:31:59: === GModelSky === - 2015-02-04T17:31:59: Name ......................: Crab - 2015-02-04T17:31:59: Instruments ...............: all - 2015-02-04T17:31:59: Instrument scale factors ..: unity - 2015-02-04T17:31:59: Observation identifiers ...: all - 2015-02-04T17:31:59: Model type ................: PointSource - 2015-02-04T17:31:59: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" - 2015-02-04T17:31:59: Number of parameters ......: 6 - 2015-02-04T17:31:59: Number of spatial par's ...: 2 - 2015-02-04T17:31:59: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) - 2015-02-04T17:31:59: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) - 2015-02-04T17:31:59: Number of spectral par's ..: 3 - 2015-02-04T17:31:59: Prefactor ................: 6.13325e-16 +/- 2.05738e-17 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) - 2015-02-04T17:31:59: Index ....................: -2.5057 +/- 0.0250818 [-0,-5] (free,scale=-1,gradient) - 2015-02-04T17:31:59: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) - 2015-02-04T17:31:59: Number of temporal par's ..: 1 - 2015-02-04T17:31:59: Constant .................: 1 (relative value) (fixed,scale=1,gradient) - 2015-02-04T17:31:59: === GCTAModelRadialAcceptance === - 2015-02-04T17:31:59: Name ......................: Background - 2015-02-04T17:31:59: Instruments ...............: CTA - 2015-02-04T17:31:59: Instrument scale factors ..: unity - 2015-02-04T17:31:59: Observation identifiers ...: all - 2015-02-04T17:31:59: Model type ................: "Gaussian" * "FileFunction" * "Constant" - 2015-02-04T17:31:59: Number of parameters ......: 3 - 2015-02-04T17:31:59: Number of radial par's ....: 1 - 2015-02-04T17:31:59: Sigma ....................: 3.04429 +/- 0.0330227 [0.01,10] deg2 (free,scale=1,gradient) - 2015-02-04T17:31:59: Number of spectral par's ..: 1 - 2015-02-04T17:31:59: Normalization ............: 0.996767 +/- 0.0175227 [0,1000] (free,scale=1,gradient) - 2015-02-04T17:31:59: Number of temporal par's ..: 1 - 2015-02-04T17:31:59: Constant .................: 1 (relative value) (fixed,scale=1,gradient) - 2015-02-04T17:31:59: - 2015-02-04T17:31:59: +==============+ - 2015-02-04T17:31:59: | Save results | - 2015-02-04T17:31:59: +==============+ - 2015-02-04T17:31:59: - 2015-02-04T17:31:59: Application "ctlike" terminated after 8 wall clock seconds, consuming 0.21275 seconds of CPU time. + 2015-05-22T20:05:54: +=================================+ + 2015-05-22T20:05:54: | Maximum likelihood optimisation | + 2015-05-22T20:05:54: +=================================+ + 2015-05-22T20:05:54: >Iteration 0: -logL=93854.543, Lambda=1.0e-03 + 2015-05-22T20:05:54: >Iteration 1: -logL=93848.595, Lambda=1.0e-03, delta=5.948, max(|grad|)=22.480581 [Index:7] + 2015-05-22T20:05:54: >Iteration 2: -logL=93848.587, Lambda=1.0e-04, delta=0.008, max(|grad|)=-0.081846 [Index:3] + 2015-05-22T20:05:54: >Iteration 3: -logL=93848.587, Lambda=1.0e-05, delta=0.000, max(|grad|)=-0.003485 [Index:3] + 2015-05-22T20:05:54: + 2015-05-22T20:05:54: +=========================================+ + 2015-05-22T20:05:54: | Maximum likelihood optimization results | + 2015-05-22T20:05:54: +=========================================+ + 2015-05-22T20:05:54: === GOptimizerLM === + 2015-05-22T20:05:54: Optimized function value ..: 93848.587 + 2015-05-22T20:05:54: Absolute precision ........: 0.005 + 2015-05-22T20:05:54: Acceptable value decrease .: 2 + 2015-05-22T20:05:54: Optimization status .......: converged + 2015-05-22T20:05:54: Number of parameters ......: 10 + 2015-05-22T20:05:54: Number of free parameters .: 4 + 2015-05-22T20:05:54: Number of iterations ......: 3 + 2015-05-22T20:05:54: Lambda ....................: 1e-06 + 2015-05-22T20:05:54: Maximum log likelihood ....: -93848.587 + 2015-05-22T20:05:54: Observed events (Nobs) ...: 15312.000 + 2015-05-22T20:05:54: Predicted events (Npred) ..: 15312.000 (Nobs - Npred = 3.03823e-06) + 2015-05-22T20:05:54: === GModels === + 2015-05-22T20:05:54: Number of models ..........: 2 + 2015-05-22T20:05:54: Number of parameters ......: 10 + 2015-05-22T20:05:54: === GModelSky === + 2015-05-22T20:05:54: Name ......................: Crab + 2015-05-22T20:05:54: Instruments ...............: all + 2015-05-22T20:05:54: Instrument scale factors ..: unity + 2015-05-22T20:05:54: Observation identifiers ...: all + 2015-05-22T20:05:54: Model type ................: PointSource + 2015-05-22T20:05:54: Model components ..........: "SkyDirFunction" * "PowerLaw" * "Constant" + 2015-05-22T20:05:54: Number of parameters ......: 6 + 2015-05-22T20:05:54: Number of spatial par's ...: 2 + 2015-05-22T20:05:54: RA .......................: 83.6331 [-360,360] deg (fixed,scale=1) + 2015-05-22T20:05:54: DEC ......................: 22.0145 [-90,90] deg (fixed,scale=1) + 2015-05-22T20:05:54: Number of spectral par's ..: 3 + 2015-05-22T20:05:54: Prefactor ................: 5.80619e-16 +/- 1.11149e-17 [1e-23,1e-13] ph/cm2/s/MeV (free,scale=1e-16,gradient) + 2015-05-22T20:05:54: Index ....................: -2.49282 +/- 0.0163467 [-0,-5] (free,scale=-1,gradient) + 2015-05-22T20:05:54: PivotEnergy ..............: 300000 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T20:05:54: Number of temporal par's ..: 1 + 2015-05-22T20:05:54: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) + 2015-05-22T20:05:54: === GCTAModelIrfBackground === + 2015-05-22T20:05:54: Name ......................: CTABackgroundModel + 2015-05-22T20:05:54: Instruments ...............: CTA + 2015-05-22T20:05:54: Instrument scale factors ..: unity + 2015-05-22T20:05:54: Observation identifiers ...: all + 2015-05-22T20:05:54: Model type ................: "PowerLaw" * "Constant" + 2015-05-22T20:05:54: Number of parameters ......: 4 + 2015-05-22T20:05:54: Number of spectral par's ..: 3 + 2015-05-22T20:05:54: Prefactor ................: 1.03511 +/- 0.024311 [0.001,1000] ph/cm2/s/MeV (free,scale=1,gradient) + 2015-05-22T20:05:54: Index ....................: 0.0333176 +/- 0.0134386 [-5,5] (free,scale=1,gradient) + 2015-05-22T20:05:54: PivotEnergy ..............: 1e+06 [10000,1e+09] MeV (fixed,scale=1e+06,gradient) + 2015-05-22T20:05:54: Number of temporal par's ..: 1 + 2015-05-22T20:05:54: Normalization ............: 1 (relative value) (fixed,scale=1,gradient) .. _sec_butterfly_cta: @@ -739,14 +727,14 @@ line. .. code-block:: bash $ ctbutterfly - Input event list, cube or observation definition file [events.fits] - Calibration database [dummy] - Instrument response function [cta_dummy_irf] - Source model [$CTOOLS/share/models/crab.xml] crab_results.xml + Input event list, counts cube or observation definition file [events.fits] + Calibration database [prod2] + Instrument response function [South_50h] + Source model [$CTOOLS/share/models/crab.xml] Source of interest [Crab] Start value for first energy bin in TeV [0.1] Stop value for last energy bin in TeV [100.0] - Output ascii file [butterfly.txt] + Output ascii file [butterfly.txt] Now that you have computed the confidence band of the spectral fit and that you will have an ASCII file named ``butterfly.txt`` on disk you can diff --git a/doc/source/user_manual/getting_started/response.rst b/doc/source/user_manual/getting_started/response.rst index 6f3e892..8fcb40a 100644 --- a/doc/source/user_manual/getting_started/response.rst +++ b/doc/source/user_manual/getting_started/response.rst @@ -3,20 +3,6 @@ CTA Instrument Response Functions --------------------------------- -.. note :: - - Instrument response functions are formally not part of ctools as they - should be provided by the instrument teams. The GammaLib framework on - which ctools are built comes with a set of basic response functions, but - for getting the latest instrument response functions you should contact - the relevant instrument teams. CTA consortium members should - `download - `_ - the latest calibration database containing Prod1 and Prod2 instrument - response functions from the consortium Sharepoint site (requires - password). - - What are instrument response functions? ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ @@ -47,98 +33,64 @@ atmospheric conditions, etc.). All these quantities and hence the instrument response function may depend on time. -Data formats -~~~~~~~~~~~~ - -So far the data format of the CTA instrument response functions has not -yet been settled, and information about instrument response functions is -provided in various ways. Three types of data formats are supported: - -- :ref:`sec_cta_rsp_perftable` - -- :ref:`sec_cta_rsp_xspec` - -- :ref:`sec_cta_rsp_rsptable` - -All formats provide the instrument response as function of true (and -sometimes also measured) photon energy, typically from about 20 GeV to -about 125 TeV. -Performance tables provide the instrument response for on-axis sources. -ARF, RMF and PSF files provide the instrument response for a specific -source position (and region) within the field of view. -Response tables provide the instrument response as function of position in -the field of view. Response tables are thus the most universal form of -instrument response functions available, and we recommend using this form -for any analysis. - -.. note :: - - Instrument response functions are so far only provided for a fixed - zenith angle of 20 deg. Therefore, no zenith or azimuth angle dependence has - been implemented so far. - - -Installing the CTA calibration database -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -After `downloading -`_ -the latest calibration database (only possible for CTA consortium members), -the database is installed using - -.. code-block:: bash - - $ [sudo] tar -C $CALDB -zxvf cta-caldb-20150220.tar.gz - -or - -.. code-block:: bash - - $ [sudo] tar -C $CALDB -xvf cta-caldb-20150220.tar - -depending on whether the database has been retrieved as a gzipped file or -not. Depending on your access rights to the ``$CALDB`` directory, -installation of the calibration database may require root privileges -(type ``sudo`` in this case, otherwise omit this part of the command). - -The calibration database must be installed into the directory to which you -``CALDB`` environment variable points. By default, ctools sets this -enviroment variable to - -.. code-block:: bash - - $CTOOLS/share/caldb - -but it may be that due to some other analysis software on your system the -``CALDB`` environment variable points to another directory. If in doubt, type - -.. code-block:: bash - - echo $CALDB - -to find out to which directory your ``CALDB`` environment variable points. -You may always overwrite this setting using - -.. code-block:: bash - - export CALDB=/my/preferred/caldb/directory - -which you can add to your ``.bashrc`` file to set the directory -permanently. -ctools will use the ``CALDB`` environment variable to find out where the -calibration database is located. If needed, this mechanism can be -circumvented (see :ref:`sec_cta_rsp_abspath`). - - -Specifying the CTA Instrument Response Functions -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +CTA response functions +~~~~~~~~~~~~~~~~~~~~~~ + +The instrument response functions for CTA are factorised into +the effective area :math:`A_{\rm eff}(d, p, E, t)` (units :math:`cm^2`), +the point spread function :math:`PSF(p' | d, p, E, t)`, +and the energy dispersion :math:`E_{\rm disp}(E' | d, p, E, t)` +following: + +.. math:: + R(p', E', t' | d, p, E, t) = + A_{\rm eff}(d, p, E, t) \times + PSF(p' | d, p, E, t) \times + E_{\rm disp}(E' | d, p, E, t) + +ctools are shipped with response functions for the northern and southern +arrays, and variants are available that have been optimised for exposure +times of 0.5 hours, 5 hours and 50 hours. +In total, the following six instrument response functions are available: +``North_0.5h``, ``North_5h``, ``North_50h``, ``South_0.5h``, +``South_5h``, and ``South_50h``. + +Each response is stored in a single FITS file, and each component of +the response factorisation is stored in a binary table of that FITS +file. +In addition, the response files contain an additional table that +describes the background rate as function of energy and position in +the field of view. +An example of a CTA response file is shown below: + +.. figure:: irf-file.png + :width: 100% + +Each table in the response file is in a standardised format that is +the one that is also used for the Fermi/LAT telescope. +As an example, the effective area component of the response file +is shown below. +Response information is stored in a n-dimensional cube, and each axis +of this cube is described by the lower and upper edges of the axis bins. +In this example the effective area is stored as a 2D matrix with the +first axis being energy and the second axis being offaxis angle. +Effective area information is stored for true (``EFFAREA``) and +reconstructed (``EFFAREA_RECO``) energy. +Vector columns are used to store all information. + +.. figure:: irf-aeff.png + :width: 100% + + +Specifying CTA response functions +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ The specification of the CTA Instrument Response Functions depends on the way how ctools are used. Common to all methods is that the IRFs are defined by a response name and a calibration database name. - -There are different means to specify the CTA Instrument Response Functions -when using ctools, and the following section describe the +ctools makes use of HEASARC's CALDB format to index and store +IRFs, and specification of the database and response names is +sufficient to access the response. Specifying the response function as input parameters @@ -146,23 +98,22 @@ Specifying the response function as input parameters ctools that require instrument response functions have two parameters to specify the calibration database name and the response function name. -The following example shows a ``ctobssim`` run using the ``dummy`` -calibration database and the ``cta_dummy_irf`` response function: +The following example shows a ``ctobssim`` run using the ``prod2`` +calibration database and the ``South_50h`` response function: .. code-block:: bash $ ctobssim - Model [$CTOOLS/share/models/crab.xml] - Calibration database [dummy] - Instrument response function [cta_dummy_irf] RA of pointing (degrees) (0-360) [83.63] - Dec of pointing (degrees) (-90-90) [22.01] + Dec of pointing (degrees) (-90-90) [22.51] Radius of FOV (degrees) (0-180) [5.0] - Start time (MET in s) (0) [0.0] - End time (MET in s) (0) [1800.0] - Lower energy limit (TeV) (0) [0.1] - Upper energy limit (TeV) (0) [100.0] - Output event data file or observation definition file [events.fits] + Start time (MET in s) [0.0] + End time (MET in s) [1800.0] + Lower energy limit (TeV) [0.1] + Upper energy limit (TeV) [100.0] + Calibration database [prod2] + Instrument response function [South_50h] + Model [$CTOOLS/share/models/crab.xml] Running the other tools is equivalent. @@ -180,7 +131,7 @@ definition file: - + @@ -190,9 +141,9 @@ response name. You can then pass this file directly to, e.g., ``ctlike``: .. code-block:: bash $ ctlike - Event list, counts map or observation definition file [events.fits] obs_rsp.xml + Event list, counts cube or observation definition file [events.fits] obs_irf.xml Source model [$CTOOLS/share/models/crab.xml] - Source model output file [crab_results.xml] + Source model output file [crab_results.xml] Note that ``ctlike`` does not ask for the calibration database and response name as it found the relevant information in the XML file. @@ -211,10 +162,10 @@ specify them individually in the XML observation file as follows: - - - - + + + + @@ -229,169 +180,12 @@ and response name from within Python: import gammalib obs = gammalib.GCTAObservation() - caldb = gammalib.GCaldb("cta", "dummy") - irf = "cta_dummy_irf" + caldb = gammalib.GCaldb("cta", "prod2") + irf = "South_50h" obs.response(irf, caldb) The calibration database is set by creating a ``GCaldb`` object. The constructor takes as argument the mission (always ``cta``) and the -database name, in our case ``dummy``. The response function is then set -by passing the response name (here ``cta_dummy_irf``) and the calibration +database name, in our case ``prod2``. The response function is then set +by passing the response name (here ``South_50h``) and the calibration database object to the ``response`` method. - -Alternatively, you can specify a specific response file by using - -.. code-block:: python - - import gammalib - obs = gammalib.GCTAObservation() - caldb = gammalib.GCaldb("$CALDB/data/cta/dummy/bcf") - irf = "cta_dummy_irf.dat" - obs.response(irf, caldb) - -Here, the directory in which the calibration file resides is specified -as argument to the ``GCaldb`` constructor, and the filename is passed -as response function name to the ``response`` method. - - -What response functions are available? -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -To see what response functions are available on your system, type - -.. code-block:: bash - - $ cscaldb - -This creates the file ``cscaldb.log`` in your current working directory -that contains information about the available response functions. The -format of the file is: - -.. code-block:: bash - - 2014-02-20T17:15:21: +==============+ - 2014-02-20T17:15:21: | Mission: cta | - 2014-02-20T17:15:21: +==============+ - 2014-02-20T17:15:21: === Calibration: aar === - 2014-02-20T17:15:21: DESY20140105_50h - 2014-02-20T17:15:21: DESY20140105_50h_0deg - 2014-02-20T17:15:21: DESY20140105_50h_180deg - 2014-02-20T17:15:21: - 2014-02-20T17:15:21: === Calibration: aar500 === - 2014-02-20T17:15:21: DESY20140105_50h - 2014-02-20T17:15:21: DESY20140105_50h_0deg - 2014-02-20T17:15:21: DESY20140105_50h_180deg - -The name after ``Calibration`` is what we called earlier the calibration -database, and the names that are following each -``=== Calibration: xxx ===`` header are the response file names. - -To get the same information also onto the console, type - -.. code-block:: bash - - $ cscaldb debug=yes - - -Data format details -~~~~~~~~~~~~~~~~~~~ - -.. _sec_cta_rsp_perftable: - -Performance tables -^^^^^^^^^^^^^^^^^^ - -In the early days, the instrument performances derived from Monte-Carlo -simulations have been summarised in what we call here Performance -Tables, which are ASCII files that contain as function of energy the -on-axis performance parameters of CTA, such as effective area, point spread -function containment radius, energy resolution, background count rate and -differential sensitivity. - -Below an example of a CTA performance table:: - - log(E) Area r68 r80 ERes. BG Rate Diff Sens - -1.7 261.6 0.3621 0.4908 0.5134 0.0189924 6.88237e-11 - -1.5 5458.2 0.2712 0.3685 0.4129 0.1009715 1.72717e-11 - -1.3 15590.0 0.1662 0.2103 0.2721 0.0575623 6.16963e-12 - -1.1 26554.1 0.1253 0.1567 0.2611 0.0213008 2.89932e-12 - -0.9 52100.5 0.1048 0.1305 0.1987 0.0088729 1.39764e-12 - -0.7 66132.1 0.0827 0.1024 0.1698 0.0010976 6.03531e-13 - -0.5 108656.8 0.0703 0.0867 0.1506 0.0004843 3.98147e-13 - -0.3 129833.0 0.0585 0.0722 0.1338 0.0001575 3.23090e-13 - -0.1 284604.3 0.0531 0.0656 0.1008 0.0001367 2.20178e-13 - 0.1 263175.3 0.0410 0.0506 0.0831 0.0000210 1.87452e-13 - 0.3 778048.6 0.0470 0.0591 0.0842 0.0000692 1.53976e-13 - 0.5 929818.8 0.0391 0.0492 0.0650 0.0000146 1.18947e-13 - 0.7 1078450.0 0.0335 0.0415 0.0541 0.0000116 1.51927e-13 - 0.9 1448579.1 0.0317 0.0397 0.0516 0.0000047 1.42439e-13 - 1.1 1899905.0 0.0290 0.0372 0.0501 0.0000081 1.96670e-13 - 1.3 2476403.8 0.0285 0.0367 0.0538 0.0000059 2.20695e-13 - 1.5 2832570.6 0.0284 0.0372 0.0636 0.0000073 3.22523e-13 - 1.7 3534065.3 0.0290 0.0386 0.0731 0.0000135 4.84153e-13 - 1.9 3250103.4 0.0238 0.0308 0.0729 0.0000044 6.26265e-13 - 2.1 3916071.6 0.0260 0.0354 0.0908 0.0000023 7.69921e-13 - --------------------------------------------- - 1) log(E) = log10(E/TeV) - bin centre - 2) Eff Area - in square metres after background cut (no theta cut) - 3) Ang. Res - 68% containment radius of gamma-ray PSF post cuts - in degrees - 4) Ang. Res - 80% containment radius of gamma-ray PSF post cuts - in degrees - 5) Fractional Energy Resolution (rms) - 6) BG Rate - inside point-source selection region - post call cuts - in Hz - 7) Diff Sens - differential sensitivity for this bin expressed as E^2 dN/dE - - in erg cm^-2 s^-1 - for a 50 hours exposure - 5 sigma significance including - systematics and statistics and at least 10 photons. - - -.. _sec_cta_rsp_xspec: - -ARF, RMF and PSF files -^^^^^^^^^^^^^^^^^^^^^^ - -Instrument response information for the first CTA Data Challenge (1DC) has been -provided in a format that was heavily inspired by the -`RMF and ARF file formats -`_ -that have been introduced by -`HEASARC `_ -for spectral analysis of X-ray data. - -The Redistribution Matrix File (RMF) describes how an incoming photon with -a given true energy is redistributed in measured energy. In other words, it -describes the energy dispersion of the instrument. The RMF is organised as -a two-dimensional matrix, with the first axis being in true energies while -the second axis represents the measured energies. - -The Ancillary Response File (ARF) describes the sensitivity of the -instrument to photons of a given true energy. The ARF gives the effective -area of the detector system after applying an event selection cut -(theta cut). For computing the ARF, some knowledge of the Point Spread -Function (PSF) is needed, so that the fraction of photons that falls into -the event selection region for a given source can be properly estimated. -Once this is done, no further PSF information is needed for the analysis. - -ctools however relies on the full modelling of the instrument, including -the Point Spread Function, and hence, PSF information has also been -provided for 1DC. Two data formats have been used for this: a first that -is based on a simple one-dimensional vector, providing the width of a -2-dimensional Gaussian as function of energy; and a second that is based -on a three-component 2D Gaussian as function of energy and offset angle -in the camera system. While the former was implement by a simply FITS -table with two columns, the latter was implemented by -:ref:`sec_cta_rsp_rsptable`. - - -.. _sec_cta_rsp_rsptable: - -Response tables -^^^^^^^^^^^^^^^ - -The CTA response table class ``GCTAResponseTable`` provides a generic -handle for multi-dimensional response information. It is based on the -response format used for storing response information for the -*Fermi*/LAT telescope. In this format, all information is stored in -a single row of a FITS binary table. Each element of the row contains -a vector column, that describes the axes of the multi-dimensional response -cube and the response information. Note that this class may in the future -be promoted to the GammaLib core, as a similar class has been implemented -in the *Fermi*/LAT interface. diff --git a/doc/source/user_manual/getting_started/tsmap-crab.png b/doc/source/user_manual/getting_started/tsmap-crab.png index 1fa28b8..f1ef431 100644 --- a/doc/source/user_manual/getting_started/tsmap-crab.png +++ b/doc/source/user_manual/getting_started/tsmap-crab.png diff --git a/examples/README b/examples/README index 6cea825..a7fc211 100644 --- a/examples/README +++ b/examples/README @@ -9,6 +9,13 @@ benchmark_cta_analysis.py check_models.py Checks a variety of models using an unbinned analysis. +make_pointings.py + This script creates pointings for CTA surveys. For the moment the + Galactic Plane Survey (gps), the Extragalactic Survey (extgal), + the Galactic Centre Survey (gc) and the LMC survey (lmc) are + implemented. The script outputs and ASCII file that can be used by + csobsdef. + make_pull_at_sensitivity_limit.py This script creates pull distributions as function of energy for a test source that is at the 5 sigma sensitivity limit for diff --git a/examples/benchmark_cta_analysis.py b/examples/benchmark_cta_analysis.py index c073a84..452489e 100755 --- a/examples/benchmark_cta_analysis.py +++ b/examples/benchmark_cta_analysis.py @@ -39,8 +39,8 @@ def unbinned_pipeline(duration): """ # Set script parameters model_name = "${CTOOLS}/share/models/crab.xml" - caldb = "dummy" - irf = "cta_dummy_irf" + caldb = "prod2" + irf = "South_50h" ra = 83.63 dec = 22.01 rad_sim = 10.0 @@ -103,8 +103,8 @@ def binned_pipeline(duration): """ # Set script parameters model_name = "${CTOOLS}/share/models/crab.xml" - caldb = "dummy" - irf = "cta_dummy_irf" + caldb = "prod2" + irf = "South_50h" ra = 83.63 dec = 22.01 rad_sim = 10.0 @@ -167,17 +167,17 @@ def binned_pipeline(duration): return telapsed, tctlike -# ============================ # -# Cube-style analysis pipeline # -# ============================ # -def cube_pipeline(duration): +# ========================= # +# Stacked analysis pipeline # +# ========================= # +def stacked_pipeline(duration): """ Cube-style analysis pipeline. """ # Set script parameters model_name = "${CTOOLS}/share/models/crab.xml" - caldb = "dummy" - irf = "cta_dummy_irf" + caldb = "prod2" + irf = "South_50h" ra = 83.63 dec = 22.01 rad_sim = 10.0 @@ -260,17 +260,34 @@ def cube_pipeline(duration): psfcube["yref"].real(dec) psfcube.run() - # Set exposure and PSF cube for first CTA observation - obs = bin.obs() - cta = gammalib.GCTAObservation(obs[0]) - cta.response(expcube.expcube(), psfcube.psfcube()) - obs[0] = cta + # Create background cube + bkgcube = ctools.ctbkgcube(sim.obs()) + bkgcube["incube"].filename("NONE") + bkgcube["ebinalg"].string("LOG") + bkgcube["emin"].real(emin) + bkgcube["emax"].real(emax) + bkgcube["enumbins"].integer(enumbins) + bkgcube["nxpix"].integer(10) + bkgcube["nypix"].integer(10) + bkgcube["binsz"].real(1.0) + bkgcube["coordsys"].string(coordsys) + bkgcube["proj"].string(proj) + bkgcube["xref"].real(ra) + bkgcube["yref"].real(dec) + bkgcube.run() + + # Attach background model to observation container + bin.obs().models(bkgcube.models()) + + # Set Exposure and Psf cube for first CTA observation + # (ctbin will create an observation with a single container) + bin.obs()[0].response(expcube.expcube(), psfcube.psfcube(), bkgcube.bkgcube()) # Get ctlike start CPU time tctlike = time.clock() # Perform maximum likelihood fitting - like = ctools.ctlike(obs) + like = ctools.ctlike(bin.obs()) like.run() # Get stop CPU time @@ -292,16 +309,16 @@ if __name__ == '__main__': print("*************************************") print("* CTA analysis benchmark *") print("*************************************") - print(" Duration Unbinned Binned Cube-style ctlike-UB ctlike-B ctlike-CS") + print(" Duration Unbinned Binned Stacked ctlike-UB ctlike-B ctlike-S") # Initialize arrays a_duration = [] a_unbinned = [] a_binned = [] - a_cube = [] + a_stacked = [] c_unbinned = [] c_binned = [] - c_cube = [] + c_stacked = [] # Perform benchmarks duration = 1800.0 @@ -309,22 +326,22 @@ if __name__ == '__main__': # Perform analyses t_unbinned, ct_unbinned = unbinned_pipeline(duration) - t_binned, ct_binned = binned_pipeline(duration) - t_cube, ct_cube = cube_pipeline(duration) + t_binned, ct_binned = binned_pipeline(duration) + t_stacked, ct_stacked = stacked_pipeline(duration) # Collect results a_duration.append(duration/3600.0) a_unbinned.append(t_unbinned) a_binned.append(t_binned) - a_cube.append(t_cube) + a_stacked.append(t_stacked) c_unbinned.append(ct_unbinned) c_binned.append(ct_binned) - c_cube.append(ct_cube) + c_stacked.append(ct_stacked) # Print results print("%10.0f %10.4f %10.4f %10.4f %10.4f %10.4f %10.4f" % \ - (duration, t_unbinned, t_binned, t_cube, \ - ct_unbinned, ct_binned, ct_cube)) + (duration, t_unbinned, t_binned, t_stacked, \ + ct_unbinned, ct_binned, ct_stacked)) # Increment duration duration *= 2.0 @@ -335,10 +352,10 @@ if __name__ == '__main__': plt.title("CTA analysis benchmark") plt.loglog(a_duration, a_unbinned, 'ro-', label='unbinned') plt.loglog(a_duration, a_binned, 'bo-', label='binned') - plt.loglog(a_duration, a_cube, 'go-', label='cube-style') + plt.loglog(a_duration, a_stacked, 'go-', label='cube-style') plt.loglog(a_duration, c_unbinned, 'ro--') plt.loglog(a_duration, c_binned, 'bo--') - plt.loglog(a_duration, c_cube, 'go--') + plt.loglog(a_duration, c_stacked, 'go--') plt.xlabel("Duration (hours)") plt.ylabel("CPU time (seconds)") plt.legend(loc="lower right") diff --git a/examples/check_models.py b/examples/check_models.py index b4beaf2..bcc78be 100755 --- a/examples/check_models.py +++ b/examples/check_models.py @@ -41,8 +41,8 @@ def pipeline(model_name): FITS files on disk. All data is only hold in memory. """ # Set script parameters - caldb = "dummy" - irf = "cta_dummy_irf" + caldb = "prod2" + irf = "South_50h" ra = 83.63 dec = 22.01 rad_sim = 10.0 diff --git a/examples/make_pointings.py b/examples/make_pointings.py index 023959c..8ed3d79 100755 --- a/examples/make_pointings.py +++ b/examples/make_pointings.py @@ -1,6 +1,6 @@ #! /usr/bin/env python # ========================================================================== -# This script generated pointing patterns for CTA observations. +# This script generates pointing patterns for CTA observations. # # Usage: # ./make_pointings.py @@ -124,19 +124,18 @@ def set_patch(lmin=-30.0, lmax=30.0, bmin=-1.5, bmax=+1.5, \ obs_site = site # Set site IRF + caldb = "prod2" if obs_site == "North": - caldb = "tenerife" if lst: - irf = "DESY20140105_50h" + irf = "North_50h" else: - irf = "DESY20140105_50h_noLST" + irf = "North_50h" exposure_north += duration else: - caldb = "aar" if lst: - irf = "DESY20140105_50h" + irf = "South_50h" else: - irf = "DESY20140105_50h_noLST" + irf = "South_50h" exposure_south += duration # Set IRF information @@ -241,6 +240,59 @@ def set_gc(lst=True): return obsdef +# ============= # +# Setup LMC KSP # +# ============= # +def set_lmc(hours=250.0, lst=True): + """ + Setup LMC KSP. + """ + # Initialise observation definition + obsdef = [] + + # Set LMC centre + centre = gammalib.GSkyDir() + centre.radec_deg(80.0, -69.0) + + # Set offset angle and number of pointings + offset = 1.0 # degrees + n_pnt = 12 + + # Prepare computations + dphi = 360.0/n_pnt + duration = hours*3600.0/float(n_pnt) + + # Loop over pointings + for ipnt in range(n_pnt): + + # Compute pointing direction + pnt = centre.copy() + pnt.rotate_deg(ipnt*dphi, offset) + lon = pnt.l_deg() + lat = pnt.b_deg() + + # Set positions and duration + obs = {'lon': lon, 'lat': lat, 'duration': duration} + + # Add IRF + caldb = "prod2" + if lst: + irf = "South_50h" + else: + irf = "South_50h" + obs['caldb'] = caldb + obs['irf'] = irf + + # Append observation + obsdef.append(obs) + + # Dump statistics + print("Number of pointings: %d (%.2f sec)" % (n_pnt,duration)) + + # Return observation definition + return obsdef + + # ======================================= # # Write observation definition dictionary # # ======================================= # @@ -291,7 +343,6 @@ if __name__ == '__main__': need_help = False # Test for command line arguments - #print(sys.argv[0]) if (len(sys.argv) > 1): if sys.argv[1] == "-h": need_help = True @@ -304,13 +355,14 @@ if __name__ == '__main__': if need_help: print("Usage: make_pointing.py [OPTIONS]") print(" -h Display this usage message") - print(" gps Galactic plane scan (2 row scheme)") - print(" gps3 Galactic plane scan (3 row scheme)") + print(" gps Galactic plane survey (2 row scheme)") + print(" gps3 Galactic plane survey (3 row scheme)") print(" extgal Extragalactic survey") - print(" gc Galactic centre") + print(" gc Galactic centre survey") + print(" lmc LMC survey") sys.exit() - # Galactic plane scan + # Galactic plane survey if obsname == "gps": obsdef = set_gps(lst=True) write_obsdef("gps.dat", obsdef) @@ -328,6 +380,11 @@ if __name__ == '__main__': obsdef = set_gc(lst=True) write_obsdef("gc.dat", obsdef) + # LMC + elif obsname == "lmc": + obsdef = set_lmc(lst=True) + write_obsdef("lmc.dat", obsdef) + # Invalid pattern else: print("Unknown option \""+obsname+"\"") diff --git a/examples/make_pull_at_sensitivity_limit.py b/examples/make_pull_at_sensitivity_limit.py index e058379..fda1105 100755 --- a/examples/make_pull_at_sensitivity_limit.py +++ b/examples/make_pull_at_sensitivity_limit.py @@ -61,8 +61,8 @@ def create_pull(loge, emin, emax, models, ntrials=100, duration=180000.0, \ pull.models(models) pull["outfile"] = outfile pull["ntrials"] = ntrials - pull["caldb"] = "${CALDB}/data/cta/dummy/bcf" - pull["irf"] = "cta_dummy_irf" + pull["caldb"] = "prod2" + pull["irf"] = "South_50h" pull["ra"] = 83.6331 pull["dec"] = 22.0145 pull["emin"] = emin diff --git a/examples/make_spectrum.py b/examples/make_spectrum.py index e18bc9e..fc3668b 100755 --- a/examples/make_spectrum.py +++ b/examples/make_spectrum.py @@ -36,8 +36,8 @@ def make_spectrum(): """ # Set script parameters model_name = "${CTOOLS}/share/models/crab.xml" - caldb = "dummy" - irf = "cta_dummy_irf" + caldb = "prod2" + irf = "South_50h" ra = 83.63 dec = 22.01 rad_sim = 3.0 @@ -88,7 +88,7 @@ def plot_spectrum(spectrum): spectrum['flux']['value'], 'ro', label='Crab') plt.errorbar(spectrum['energy']['value'], \ spectrum['flux']['value'], \ - spectrum['flux']['ed_value'], fmt=None, ecolor='r') + spectrum['flux']['ed_value'], ecolor='r') # Put labels plt.xlabel("Energy ("+spectrum['energy']['unit']+")") diff --git a/examples/make_ts_distributions.py b/examples/make_ts_distributions.py index ceb6893..85c5338 100755 --- a/examples/make_ts_distributions.py +++ b/examples/make_ts_distributions.py @@ -61,21 +61,23 @@ def create_ts(loge, emin, emax, ntrials=100, duration=180000.0, \ # Setup cstsdist tool tsdist = cstsdist() - tsdist["outfile"] = outfile - tsdist["ntrials"] = ntrials - tsdist["caldb"] = "${CALDB}/data/cta/dummy/bcf" - tsdist["irf"] = "cta_dummy_irf" - tsdist["type"] = "point" - tsdist["index"] = -2.48 - tsdist["offset"] = 0.0 - tsdist["bkg"] = "${CTOOLS}/share/models/bkg_dummy.txt" - tsdist["emin"] = float(emin) - tsdist["emax"] = float(emax) - tsdist["enumbins"] = int(enumbins) - tsdist["duration"] = float(duration) - tsdist["rad"] = 5.0 - tsdist["npix"] = 200 - tsdist["binsz"] = 0.05 + tsdist["inmodel"].filename("$CTOOLS/share/models/crab.xml") + tsdist["srcname"].string("Crab") + tsdist["outfile"].filename(outfile) + tsdist["ntrials"].integer(ntrials) + tsdist["caldb"].string("prod2") + tsdist["irf"].string("South_50h") + tsdist["ra"].real(83.63) + tsdist["dec"].real(22.01) + tsdist["emin"].real(float(emin)) + tsdist["emax"].real(float(emax)) + tsdist["enumbins"].integer(int(enumbins)) + tsdist["tmin"].real(0.0) + tsdist["tmax"].real(float(duration)) + tsdist["rad"].real(5.0) + tsdist["npix"].integer(200) + tsdist["binsz"].real(0.05) + #tsdist["debug"].boolean(True) # Optionally open the log file if log: @@ -139,14 +141,10 @@ if __name__ == '__main__': enumbins = pars[1]['value'] duration = pars[2]['value'] max_threads = pars[3]['value'] - #print ntrials - #print enumbins - #print duration - #print max_threads # Loop over energy bands. The energy bands are those that are also # used for sensitivity computation. - for ieng in range(21): + for ieng in range(20): # Set energies loge = -1.7 + ieng * 0.2 diff --git a/examples/pipeline_binned_disk.py b/examples/pipeline_binned_disk.py index 5aba32e..35847f6 100755 --- a/examples/pipeline_binned_disk.py +++ b/examples/pipeline_binned_disk.py @@ -36,7 +36,7 @@ from ctools import obsutils def setup_observations(pattern="four", ra=83.63, dec=22.01, offset=1.5, \ emin=0.1, emax=100.0, rad=5.0, duration=1800.0, \ deadc=0.95, \ - caldb="dummy", irf="cta_dummy_irf"): + caldb="prod2", irf="South_50h"): """ Returns an observation container. @@ -96,7 +96,7 @@ def run_pipeline(obs, emin=0.1, emax=100.0, \ enumbins=20, nxpix=200, nypix=200, binsz=0.02, \ coordsys="CEL", proj="CAR", \ model="${CTOOLS}/share/models/crab.xml", \ - caldb="dummy", irf="cta_dummy_irf", \ + caldb="prod2", irf="South_50h", \ debug=False): """ Simulation and binned analysis pipeline. @@ -165,6 +165,7 @@ def run_pipeline(obs, emin=0.1, emax=100.0, \ like["outmodel"].filename("fit_results.xml") like["expcube"].filename("NONE") like["psfcube"].filename("NONE") + like["bkgcube"].filename("NONE") like["caldb"].string(caldb) like["irf"].string(irf) like["debug"].boolean(True) # Switch this always on for results in console diff --git a/examples/pipeline_binned_mem.py b/examples/pipeline_binned_mem.py index 5c586ab..563ecb6 100755 --- a/examples/pipeline_binned_mem.py +++ b/examples/pipeline_binned_mem.py @@ -36,7 +36,7 @@ from ctools import obsutils def setup_observations(pattern="four", ra=83.63, dec=22.01, offset=1.5, \ emin=0.1, emax=100.0, rad=5.0, duration=1800.0, \ deadc=0.95, \ - caldb="dummy", irf="cta_dummy_irf"): + caldb="prod2", irf="South_50h"): """ Returns an observation container. diff --git a/examples/pipeline_stacked_disk.py b/examples/pipeline_stacked_disk.py index 5a5adaa..32d2e20 100755 --- a/examples/pipeline_stacked_disk.py +++ b/examples/pipeline_stacked_disk.py @@ -36,7 +36,7 @@ from ctools import obsutils def setup_observations(pattern="four", ra=83.63, dec=22.01, offset=1.5, \ emin=0.1, emax=100.0, rad=5.0, duration=1800.0, \ deadc=0.95, \ - caldb="dummy", irf="cta_dummy_irf"): + caldb="prod2", irf="South_50h"): """ Returns an observation container. @@ -96,7 +96,7 @@ def run_pipeline(obs, ra=83.63, dec=22.01, emin=0.1, emax=100.0, \ enumbins=20, nxpix=200, nypix=200, binsz=0.02, \ coordsys="CEL", proj="CAR", \ model="${CTOOLS}/share/models/crab.xml", \ - caldb="dummy", irf="cta_dummy_irf", \ + caldb="prod2", irf="South_50h", \ debug=False): """ Simulation and stacked analysis pipeline. @@ -210,6 +210,7 @@ def run_pipeline(obs, ra=83.63, dec=22.01, emin=0.1, emax=100.0, \ like["outmodel"].filename("fit_results.xml") like["expcube"].filename("expcube.fits") like["psfcube"].filename("psfcube.fits") + like["bkgcube"].filename("bkgcube.fits") like["caldb"].string(caldb) like["irf"].string(irf) like["debug"].boolean(True) # Switch this always on for results in console diff --git a/examples/pipeline_stacked_mem.py b/examples/pipeline_stacked_mem.py index 1215969..1a694f5 100755 --- a/examples/pipeline_stacked_mem.py +++ b/examples/pipeline_stacked_mem.py @@ -36,7 +36,7 @@ from ctools import obsutils def setup_observations(pattern="four", ra=83.63, dec=22.01, offset=1.5, \ emin=0.1, emax=100.0, rad=5.0, duration=1800.0, \ deadc=0.95, \ - caldb="dummy", irf="cta_dummy_irf"): + caldb="prod2", irf="South_50h"): """ Returns an observation container. @@ -188,7 +188,7 @@ def run_pipeline(obs, ra=83.63, dec=22.01, emin=0.1, emax=100.0, \ # Set Exposure and Psf cube for first CTA observation # (ctbin will create an observation with a single container) - bin.obs()[0].response(expcube.expcube(), psfcube.psfcube()) + bin.obs()[0].response(expcube.expcube(), psfcube.psfcube(), bkgcube.bkgcube()) # Perform maximum likelihood fitting like = ctools.ctlike(bin.obs()) diff --git a/examples/pipeline_unbinned_disk.py b/examples/pipeline_unbinned_disk.py index 2375216..65fefe6 100755 --- a/examples/pipeline_unbinned_disk.py +++ b/examples/pipeline_unbinned_disk.py @@ -36,7 +36,7 @@ from ctools import obsutils def setup_observations(pattern="four", ra=83.63, dec=22.01, offset=1.5, \ emin=0.1, emax=100.0, rad=5.0, duration=1800.0, \ deadc=0.95, \ - caldb="dummy", irf="cta_dummy_irf"): + caldb="prod2", irf="South_50h"): """ Returns an observation container. @@ -96,7 +96,7 @@ def run_pipeline(obs, ra=83.63, dec=22.01, rad=3.0, \ emin=0.1, emax=100.0, \ tmin=0.0, tmax=0.0, \ model="${CTOOLS}/share/models/crab.xml", \ - caldb="dummy", irf="cta_dummy_irf", \ + caldb="prod2", irf="South_50h", \ debug=False): """ Simulation and unbinned analysis pipeline. diff --git a/examples/pipeline_unbinned_mem.py b/examples/pipeline_unbinned_mem.py index 875d318..db16193 100755 --- a/examples/pipeline_unbinned_mem.py +++ b/examples/pipeline_unbinned_mem.py @@ -36,7 +36,7 @@ from ctools import obsutils def setup_observations(pattern="four", ra=83.63, dec=22.01, offset=1.5, \ emin=0.1, emax=100.0, rad=5.0, duration=1800.0, \ deadc=0.95, \ - caldb="dummy", irf="cta_dummy_irf"): + caldb="prod2", irf="South_50h"): """ Returns an observation container. diff --git a/examples/show_response.py b/examples/show_response.py index f4f9918..bcd8632 100755 --- a/examples/show_response.py +++ b/examples/show_response.py @@ -167,6 +167,7 @@ def show_one_sensitivity(rsp, name, color="r", duration=180000.0, alpha=0.2, sig """ # Set constants r68_to_sigma = 0.6624305 + TeV2erg = 1.0e6 * gammalib.MeV2erg # Set to figure 3 plt.figure(3) @@ -189,8 +190,16 @@ def show_one_sensitivity(rsp, name, color="r", duration=180000.0, alpha=0.2, sig if Noff > 0: Non = Non_lima(sigma, Noff) src_counts = Non - bgd_counts - flux[i] = src_counts / (0.68*aeff * duration) * E[i]*1.0e6 * gammalib.MeV2erg - #print logE[i], flux[i] + if src_counts < 0.05*bgd_counts: + src_counts = 0.05*bgd_counts + if src_counts < 10: + src_counts = 10.0 + emin = gammalib.GEnergy(math.pow(10.0, logE[i]-0.1), "TeV") + emax = gammalib.GEnergy(math.pow(10.0, logE[i]+0.1), "TeV") + epivot = gammalib.GEnergy(math.pow(10.0, logE[i]), "TeV") + plaw = gammalib.GModelSpectralPlaw(1.0e-6, -2.6, epivot) + conv = TeV2erg*E[i]*E[i]/plaw.flux(emin, emax) + flux[i] = conv * src_counts / (duration * aeff*0.68) # Plot data plt.loglog(E, flux, color+'-', label=name) diff --git a/examples/show_sensitivity.py b/examples/show_sensitivity.py index 4ca60bb..28c6ccf 100755 --- a/examples/show_sensitivity.py +++ b/examples/show_sensitivity.py @@ -99,7 +99,7 @@ def show_sensitivity(sensitivity, filename): plt.grid() # Show differential sensitivity - plt.plot(sensitivity['energy'], sensitivity['eflux'], 'ro-') + plt.plot(sensitivity['energy'], sensitivity['sensitivity'], 'ro-') # Set labels plt.xlabel("Energy (TeV)") diff --git a/examples/simulate_events.py b/examples/simulate_events.py index 2f5b919..ff8801d 100755 --- a/examples/simulate_events.py +++ b/examples/simulate_events.py @@ -38,7 +38,7 @@ except: # ======================== # def createobs(ra=86.171648, dec=-1.4774586, rad=5.0, \ emin=0.1, emax=100.0, duration=360000.0, deadc=0.95, \ - irf="cta_dummy_irf", caldb="$CTOOLS/share/caldb/data/cta/dummy"): + irf="South_50h", caldb="prod2"): """ Create CTA observation. """ diff --git a/models/Makefile.am b/models/Makefile.am index 239f736..d00a11e 100644 --- a/models/Makefile.am +++ b/models/Makefile.am @@ -1,9 +1,9 @@ ## Process this file with automake to produce Makefile.in # Background rate files to distribute -bkgs = bkg_dummy.txt -bkgsdir = $(datadir)/models -bkgs_DATA = $(bkgs) +#bkgs = bkg_dummy.txt +#bkgsdir = $(datadir)/models +#bkgs_DATA = $(bkgs) # Models to distribute models = crab.xml \ @@ -16,4 +16,4 @@ modelsdir = $(datadir)/models models_DATA = $(models) # Extra files to be distributed in the tar file -EXTRA_DIST = $(bkgs) $(models) +EXTRA_DIST = $(models) diff --git a/models/bkg_dummy.txt b/models/bkg_dummy.txt deleted file mode 100644 index 3a65044..0000000 --- a/models/bkg_dummy.txt +++ /dev/null @@ -1,20 +0,0 @@ -19952.6231497 0.00888770093889 -31622.7766017 0.0528862764556 -50118.7233627 0.0584088588708 -79432.8234724 0.0245627698931 -125892.541179 0.00930817022553 -199526.231497 0.00117990856387 -316227.766017 0.000458229904465 -501187.233627 0.000135628482432 -794328.234724 8.99472876298e-05 -1258925.41179 1.46319988679e-05 -1995262.31497 2.23452132224e-05 -3162277.66017 4.28526605833e-06 -5011872.33627 3.02154407423e-06 -7943282.34724 8.46588074886e-07 -12589254.1179 1.05217831413e-06 -19952623.1497 4.95410035794e-07 -31622776.6017 3.77171043065e-07 -50118723.3627 4.05250267135e-07 -79432823.4724 1.31996926243e-07 -125892541.179 3.23120422483e-08 diff --git a/models/crab.xml b/models/crab.xml index 6efac43..1130f67 100644 --- a/models/crab.xml +++ b/models/crab.xml @@ -11,12 +11,11 @@ - - - + + + + + - - - - + diff --git a/models/disk.xml b/models/disk.xml index 2376938..cc74775 100644 --- a/models/disk.xml +++ b/models/disk.xml @@ -12,12 +12,11 @@ - - - + + + + + - - - - + diff --git a/models/gauss.xml b/models/gauss.xml index 6157fbd..d5058d0 100644 --- a/models/gauss.xml +++ b/models/gauss.xml @@ -12,12 +12,11 @@ - - - + + + + + - - - - + diff --git a/models/shell.xml b/models/shell.xml index f02ccaa..775c51b 100644 --- a/models/shell.xml +++ b/models/shell.xml @@ -13,12 +13,11 @@ - - - + + + + + - - - - + diff --git a/pyext/ctbkgcube.i b/pyext/ctbkgcube.i index c8631b0..1e321da 100644 --- a/pyext/ctbkgcube.i +++ b/pyext/ctbkgcube.i @@ -47,7 +47,7 @@ public: void clear(void); void run(void); void save(void); - const GCTACubeBackground& cube(void) const; + const GCTACubeBackground& bkgcube(void) const; const GModels& models(void) const; }; diff --git a/pyext/ctools/obsutils.py b/pyext/ctools/obsutils.py index 4e2181c..a9ab5f8 100755 --- a/pyext/ctools/obsutils.py +++ b/pyext/ctools/obsutils.py @@ -26,7 +26,7 @@ import math # ===================== # # Simulate observations # # ===================== # -def sim(obs, log=False, debug=False, edisp=False, seed=0, nbins=0, +def sim(obs, log=False, debug=False, chatter=2, edisp=False, seed=0, nbins=0, binsz=0.05, npix=200, proj="TAN", coord="GAL"): """ Simulate events for all observations in the container. @@ -55,6 +55,9 @@ def sim(obs, log=False, debug=False, edisp=False, seed=0, nbins=0, # Optionally switch-on debugging model if debug: sim["debug"].boolean(True) + + # Set chatter level + sim["chatter"].chatter = chatter # Run ctobssim application. This will loop over all observations in the # container and simulation the events for each observation. Note that @@ -101,6 +104,9 @@ def sim(obs, log=False, debug=False, edisp=False, seed=0, nbins=0, if debug: bin["debug"].boolean(True) + # Set chatter level + bin["chatter"].chatter = chatter + # Run ctbin application. This will loop over all observations in # the container and bin the events in counts maps bin.run() @@ -127,7 +133,7 @@ def sim(obs, log=False, debug=False, edisp=False, seed=0, nbins=0, # ================ # # Fit observations # # ================ # -def fit(obs, log=False, debug=False, edisp=False): +def fit(obs, log=False, debug=False, chatter=2, edisp=False): """ Perform maximum likelihood fitting of observations in the container. @@ -148,6 +154,9 @@ def fit(obs, log=False, debug=False, edisp=False): # Optionally switch-on debugging model if debug: like["debug"].boolean(True) + + # Set chatter level + like["chatter"].chatter = chatter # Optionally apply energy dispersion like["edisp"].boolean(edisp) @@ -310,7 +319,7 @@ def modmap(obs, eref=0.1, proj="TAN", coord="GAL", xval=0.0, yval=0.0, \ # ===================================== # def set(pntdir, tstart=0.0, duration=1800.0, deadc=0.95, \ emin=0.1, emax=100.0, rad=5.0, \ - irf="cta_dummy_irf", caldb="dummy"): + irf="South_50h", caldb="prod2"): """ Obsolete function, use set_obs instead. """ @@ -331,7 +340,7 @@ def set(pntdir, tstart=0.0, duration=1800.0, deadc=0.95, \ # ======================= # def set_obs(pntdir, tstart=0.0, duration=1800.0, deadc=0.95, \ emin=0.1, emax=100.0, rad=5.0, \ - irf="cta_dummy_irf", caldb="dummy", id="000000", instrument="CTA"): + irf="South_50h", caldb="prod2", id="000000", instrument="CTA"): """ Returns a single CTA observation containing an empty CTA event list. By looping over this function you can add CTA observations to the @@ -406,7 +415,7 @@ def set_obs(pntdir, tstart=0.0, duration=1800.0, deadc=0.95, \ # ============================ # def set_obs_list(obsdeflist, tstart=0.0, duration=1800.0, deadc=0.95, \ emin=0.1, emax=100.0, rad=5.0, \ - irf="cta_dummy_irf", caldb="dummy"): + irf="South_50h", caldb="prod2"): """ Returns an observation container filled with a list of CTA observations. The list is defined by the obsdeflist parameter which is a dictionnary @@ -606,9 +615,9 @@ def spectrum(obs, source, ebounds): # Clone observations and reset energy thresholds select = ctools.ctselect(obs) - select["ra"].real(-1.0) - select["dec"].real(-1.0) - select["rad"].real(-1.0) + select["ra"].value("UNDEF") + select["dec"].value("UNDEF") + select["rad"].value("UNDEF") select["tmin"].real(0.0) select["tmax"].real(0.0) select["emin"].real(ebounds.emin(i).TeV()) diff --git a/scripts/Makefile.am b/scripts/Makefile.am index 14de0e5..0bbc092 100644 --- a/scripts/Makefile.am +++ b/scripts/Makefile.am @@ -6,20 +6,19 @@ binscripts = cta_kb_bkgrates.py cta_root2irf.py cta_make_nodes.py \ # Scripts to be distributed in pythondir pythonscripts = cspull.py cssens.py cstsdist.py cscaldb.py csresmap.py cshessobs.py \ - csobsdef.py csspec.py \ - lsmodel.py \ - obsutils.py + csobsdef.py csspec.py cslightcrv.py \ + lsmodel.py # Scripts for which symbolic links will be created in bindir linkscripts = cspull cssens cstsdist cscaldb csresmap \ - csobsdef csspec cshessobs\ + csobsdef csspec cshessobs cslightcrv \ lsmodel # Distribute scripts EXTRA_DIST = $(binscripts) $(pythonscripts) binscriptsdir = $(bindir) binscripts_DATA = $(binscripts) -pythonscriptsdir = $(pythondir) +pythonscriptsdir = $(pythondir)/ctools pythonscripts_DATA = $(pythonscripts) # Add hook rule to create symbolic links for cscripts @@ -31,7 +30,7 @@ install-data-hook: @linklist='$(linkscripts)';\ for p in $$linklist; do \ rm -rf "$(DESTDIR)$(bindir)/$$p"; \ - ln -s "$(DESTDIR)$(pythondir)/$$p.py" "$(DESTDIR)$(bindir)/$$p"; \ - chmod +x "$(DESTDIR)$(pythondir)/$$p.py"; \ + ln -s "$(DESTDIR)$(pythondir)/ctools/$$p.py" "$(DESTDIR)$(bindir)/$$p"; \ + chmod +x "$(DESTDIR)$(pythondir)/ctools/$$p.py"; \ done diff --git a/scripts/cshessobs.py b/scripts/cshessobs.py index e3dabb0..9d0482e 100755 --- a/scripts/cshessobs.py +++ b/scripts/cshessobs.py @@ -44,6 +44,7 @@ class cshessobs(ctools.cscript): # Set name self.name = "cshessobs" self.version = "0.1.0" + self.datapath = "" # Check on existence of HESSFITS environment variable try: @@ -53,7 +54,6 @@ class cshessobs(ctools.cscript): "Please set the environment variable \"HESSFITS\" to use this script") # Initialise some members - self.datapath = "" self.inmodels = None self.outobs = "obs.xml" self.nodes = 1 @@ -450,7 +450,13 @@ class cshessobs(ctools.cscript): # Open fits file to determine the observation name fits = gammalib.GFits(eventfile) object_name = fits["EVENTS"].string("OBJECT") - trgrate = fits["EVENTS"].real("ZTRGRATE") + + # Retrieve trigger rate if available + trgrate = 0.0 + if fits["EVENTS"].has_card("ZTRGRATE"): + trgrate = fits["EVENTS"].real("ZTRGRATE") + + # Close FITS file fits.close() # Append observation to XML and set attributes diff --git a/scripts/cslightcrv.py b/scripts/cslightcrv.py new file mode 100755 index 0000000..2ebdcec --- /dev/null +++ b/scripts/cslightcrv.py @@ -0,0 +1,611 @@ +#! /usr/bin/env python +# ========================================================================== +# Light curve generation script. +# +# Copyright (C) 2014-2015 Michael Mayer +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see . +# +# ========================================================================== +import gammalib +import ctools +import sys + +# ============ # +# csspec class # +# ============ # +class cslightcrv(ctools.cscript): + """ + This class implements the creation of a light curve. It derives from + the ctools.cscript class which provides support for parameter files, + command line arguments, and logging. In that way the Python script + behaves just as a regular ctool. + """ + def __init__(self, *argv): + """ + Constructor. + """ + + # Set name + self.name = "cslightcrv" + self.version = "1.0.0" + + # Initialise some members + self.obs = None + + # Initialise some members + if len(argv) > 0 and isinstance(argv[0],gammalib.GObservations): + self.obs = argv[0] + argv = argv[1:] + else: + self.obs = gammalib.GObservations() + self.obs.clear() + self.m_outfile = "" + + # Make sure that parfile exists + file = self.parfile() + + # Initialise application + if len(argv) == 0: + ctools.cscript.__init__(self, self.name, self.version) + elif len(argv) ==1: + ctools.cscript.__init__(self, self.name, self.version, *argv) + else: + raise TypeError("Invalid number of arguments given.") + + # Set logger properties + self.log_header() + self.log.date(True) + + # Return + return + + def __del__(self): + """ + Destructor. + """ + # Write separator into logger + if self.logTerse(): + self.log("\n") + + # Return + return + + def parfile(self): + """ + Check if parfile exists. If parfile does not exist then create a + default parfile. This kluge avoids shipping the cscript with a parfile. + """ + # Set parfile name + parfile = self.name+".par" + + try: + pars = gammalib.GApplicationPars(parfile) + except: + # Signal if parfile was not found + sys.stdout.write("Parfile "+parfile+" not found. Create default parfile.\n") + + # Create default parfile + pars = gammalib.GApplicationPars() + pars.append(gammalib.GApplicationPar("inobs","f","a","events.fits","","","Event list, counts cube, or observation definition file")) + pars.append(gammalib.GApplicationPar("inmodel","f","a","$CTOOLS/share/models/crab.xml","","","Source model")) + pars.append(gammalib.GApplicationPar("srcname","s","a","Crab","","","Source name")) + pars.append(gammalib.GApplicationPar("outfile","f","a","lightcurve.fits","","","Output file name")) + pars.append(gammalib.GApplicationPar("expcube","f","a","NONE","","","Exposure cube file (only needed for stacked analysis)")) + pars.append(gammalib.GApplicationPar("psfcube","f","a","NONE","","","PSF cube file (only needed for stacked analysis)")) + pars.append(gammalib.GApplicationPar("bkgcube","s","a","NONE","","","Background cube file (only needed for stacked analysis)")) + pars.append(gammalib.GApplicationPar("caldb","s","a","prod2","","","Calibration database")) + pars.append(gammalib.GApplicationPar("irf","s","a","South_50h","","","Instrument response function")) + pars.append(gammalib.GApplicationPar("tbinalg","s","h","GTI","FILE|LIN|GTI","", "Algorithm for defining time bins")) + pars.append(gammalib.GApplicationPar("tmin","r","a","51544.5","","days","Lightcurve start time [MJD]")) + pars.append(gammalib.GApplicationPar("tmax","r","a","51544.6","","days","Lightcurve stop time [MJD]")) + pars.append(gammalib.GApplicationPar("tbins","i","a","5","","","Number of time bins")) + pars.append(gammalib.GApplicationPar("tbinfile","f","a","tbins.fits","","", "File defining the time binning")) + #pars.append(gammalib.GApplicationPar("binned","b","a","no","yes|no","","Use binned analysis in each time bin")) + pars.append(gammalib.GApplicationPar("enumbins","i","a","0","","","Number of energy bins per light curve bin (0=unbinned)")) + pars.append(gammalib.GApplicationPar("emin","r","a","0.1","","","Lower energy limit of events (TeV)")) + pars.append(gammalib.GApplicationPar("emax","r","a","100.0","","","Upper energy limit of events (TeV)")) + pars.append(gammalib.GApplicationPar("coordsys","s","a","CEL","CEL|GAL","","Coordinate System")) + pars.append(gammalib.GApplicationPar("proj","s","a","CAR","AIT|AZP|CAR|MER|MOL|STG|TAN","","Projection method")) + pars.append(gammalib.GApplicationPar("xref","r","a","83.63","0","360","First coordinate of image center in degrees (RA or galactic l)")) + pars.append(gammalib.GApplicationPar("yref","r","a","22.01","-90","90","Second coordinate of image center in degrees (DEC or galactic b)")) + pars.append(gammalib.GApplicationPar("nxpix","i","a","200","","","Size of the X axis in pixels")) + pars.append(gammalib.GApplicationPar("nypix","i","a","200","","","Size of the Y axis in pixels")) + pars.append(gammalib.GApplicationPar("binsz","r","a","0.02","","","Pixel size (deg/pixel)")) + pars.append(gammalib.GApplicationPar("calc_ts","b","h","yes","yes|no","","Compute TS value for each bin?")) + pars.append(gammalib.GApplicationPar("calc_ulim","b","h","yes","yes|no","","Compute upper limit for each bin?")) + pars.append(gammalib.GApplicationPar("fix_srcs","b","h","yes","yes|no","","Fix other sky model parameters?")) + pars.append(gammalib.GApplicationPar("fix_bkg","b","h","no","yes|no","","Fix background model parameters?")) + pars.append_standard() + pars.append(gammalib.GApplicationPar("logfile","f","h","cslightcrv.log","","","Log filename")) + pars.save(parfile) + + # Return + return + + def create_tbounds(self): + + # Create time bin container + self.m_tbins = gammalib.GGti() + + # check for binning algorithm + if self["tbinalg"].string() == "FILE": + try: + self.m_tbins.load(self["tbinfile"].filename()) + except: + csv = gammalib.GCsv(self["tbinfile"].filename()) + for i in range(csv.nrows()): + tmin = gammalib.GTime() + tmax = gammalib.GTime() + tmin.mjd(csv.real(i,0)) + tmax.mjd(csv.real(i,1)) + self.m_tbins.append(tmin,tmax) + elif self["tbinalg"].string() == "LIN": + # Use linear time binning + time_min = self["tmin"].real() + time_max = self["tmax"].real() + nbins = self["tbins"].integer() + step = (time_max - time_min) / float(nbins) + for i in range(nbins): + tmin = gammalib.GTime() + tmin.mjd(time_min + i*step)# ref) + tmax = gammalib.GTime() + tmax.mjd(time_min + (i+1)*step)#ref) + self.m_tbins.append(tmin,tmax) + elif self["tbinalg"].string() == "GTI": + # Use GTIs of observations + for obs in self.obs: + for i in range(obs.events().gti().size()): + self.m_tbins.append(obs.events().gti().tstart(i),obs.events().gti().tstop(i)) + else: + raise AttributeError("tbinalg=\""+self["tbinalg"].string()+"\" unkown. Must be one of \"FILE\", \"LIN\" or \"GTI\"") + + # Return + return + + def get_parameters(self): + """ + Get parameters from parfile and setup the observation. + """ + # Set observation if not done before + if self.obs == None or self.obs.size() == 0: + self.require_inobs("cslightcrv::get_parameters()") + self.obs = self.get_observations() + + # Set models if we have none + if self.obs.models().size() == 0: + self.obs.models(self["inmodel"].filename()) + + # Get source name + self.m_srcname = self["srcname"].string() + + # Get time boundaries + self.create_tbounds() + + # Unbinned or binned analysis? + self.m_ebins = self["enumbins"].integer() + if self.m_ebins == 0: + self.m_binned = False + else: + self.m_binned = True + + # Get energy range + self.m_emin = self["emin"].real() + self.m_emax = self["emax"].real() + + # Get binning flag + #self.m_binned = self["binned"].boolean() + if self.m_binned: + self.m_coordsys = self["coordsys"].string() + self.m_proj = self["proj"].string() + self.m_xref = self["xref"].real() + self.m_yref = self["yref"].real() + self.m_nxpix = self["nxpix"].integer() + self.m_nypix = self["nypix"].integer() + self.m_binsz = self["binsz"].real() + #self.m_ebins = self["enumbins"].integer() + #self.m_emin = self["emin"].real() + #self.m_emax = self["emax"].real() + + # Read other parameters + self.m_outfile = self["outfile"].filename() + + # Get other parameeters + self.m_calc_ulimit = self["calc_ulim"].boolean() + self.m_calc_ts = self["calc_ts"].boolean() + self.m_fix_bkg = self["fix_bkg"].boolean() + self.m_fix_srcs = self["fix_srcs"].boolean() + + # Set some fixed parameters + self.m_log = False # Logging in client tools + self.m_chatter = self["chatter"].integer() + self.m_clobber = self["clobber"].boolean() + self.m_debug = self["debug"].boolean() + + # Return + return + + def models(self, models): + """ + Set model. + """ + # Copy models + self.obs.models(models.clone()) + + # Return + return + + def execute(self): + """ + Execute the script. + """ + # Run the script + self.run() + + # Save residual map + self.fits.saveto(self.m_outfile, self.m_clobber) + + # Return + return + + def run(self): + """ + Run the script. + """ + # Switch screen logging on in debug mode + if self.logDebug(): + self.log.cout(True) + + # Get parameters + self.get_parameters() + + # Write input parameters into logger + if self.logTerse(): + self.log_parameters() + self.log("\n") + + # Write observation into logger + if self.logTerse(): + self.log("\n") + self.log.header1("Observation") + self.log(str(self.obs)) + self.log("\n") + + # Write header + if self.logTerse(): + self.log("\n") + self.log.header1("Adjust model parameters") + + # Adjust model parameters dependent on input user parameters + for model in self.obs.models(): + + # Set TS flag for all models to false. + # Source of interest will be set to true later + model.tscalc(False) + + # Log model name + if self.logExplicit(): + self.log.header3(model.name()) + + # Deal with the source of interest + if model.name() == self.m_srcname: + if self.m_calc_ts: + model.tscalc(True) + + elif self.m_fix_bkg and not model.classname() == "GModelSky": + for par in model: + if par.is_free() and self.logExplicit(): + self.log(" Fixing \""+par.name()+"\"\n") + par.fix() + + elif self.m_fix_srcs and model.classname() == "GModelSky": + for par in model: + if par.is_free() and self.logExplicit(): + self.log(" Fixing \""+par.name()+"\"\n") + par.fix() + + # Write header + if self.logTerse(): + self.log("\n") + self.log.header1("Generate lightcurve") + + # Initialise FITS Table with extension "LIGHTCURVE" + table = gammalib.GFitsBinTable(self.m_tbins.size()) + table.extname("LIGHTCURVE") + + # Add Header for compatibility with gammalib.GMWLSpectrum + table.card("INSTRUME", "CTA", "Name of Instrument") + table.card("TELESCOP", "CTA", "Name of Telescope") + + # Create FITS table columns + MJD = gammalib.GFitsTableDoubleCol("MJD", self.m_tbins.size()) + MJD.unit("days") + e_MJD = gammalib.GFitsTableDoubleCol("e_MJD", self.m_tbins.size()) + e_MJD.unit("days") + + # Create a FITS column for every free parameter + columns = [] + for par in self.obs.models()[self.m_srcname]: + if par.is_free(): + col = gammalib.GFitsTableDoubleCol(par.name(), self.m_tbins.size()) + col.unit(par.unit()) + columns.append(col) + e_col = gammalib.GFitsTableDoubleCol("e_"+par.name(), self.m_tbins.size()) + e_col.unit(par.unit()) + columns.append(e_col) + + # Create TS and upper limit columns + TSvalues = gammalib.GFitsTableDoubleCol("TS", self.m_tbins.size()) + ulim_values = gammalib.GFitsTableDoubleCol("UpperLimit", self.m_tbins.size()) + ulim_values.unit("ph/cm2/s") + + # Loop over energy bins + for i in range(self.m_tbins.size()): + + # Log information + if self.logTerse(): + self.log("\n") + self.log.header2("Time bin "+str(i)) + + # Get time boundaries + tmin = self.m_tbins.tstart(i) + tmax = self.m_tbins.tstop(i) + + # Compute time bin center and time width + tmean = (tmin + tmax) + tmean *= 0.5 + twidth = (tmax - tmin) + twidth *= 0.5 + + # Store time as MJD + MJD[i] = tmean.mjd() + e_MJD[i] = twidth.days() + + # Log information + if self.logExplicit(): + self.log.header3("Selecting events") + + # Select events + select = ctools.ctselect(self.obs) + select["emin"].real(self.m_emin) + select["emax"].real(self.m_emax) + select["tmin"].real(tmin.convert(select.time_reference())) + select["tmax"].real(tmax.convert(select.time_reference())) + select["rad"].value("UNDEFINED") + select["ra"].value("UNDEFINED") + select["dec"].value("UNDEFINED") + select.run() + + # Retrieve observation + obs = select.obs() + + # Binned analysis + if self.m_binned: + + # Header + if self.logTerse(): + self.log.header3("Binning events") + + # Bin events + bin = ctools.ctbin(select.obs()) + bin["usepnt"].boolean(False) + bin["ebinalg"].string("LOG") + bin["xref"].real(self.m_xref) + bin["yref"].real(self.m_yref) + bin["binsz"].real(self.m_binsz) + bin["nxpix"].integer(self.m_nxpix) + bin["nypix"].integer(self.m_nypix) + bin["enumbins"].integer(self.m_ebins) + bin["emin"].real(self.m_emin) + bin["emax"].real(self.m_emax) + bin["coordsys"].string(self.m_coordsys) + bin["proj"].string(self.m_proj) + bin.run() + + # Header + if self.logTerse(): + self.log.header3("Creating exposure cube") + + # Create exposure cube + expcube = ctools.ctexpcube(select.obs()) + expcube["incube"].filename("NONE") + expcube["usepnt"].boolean(False) + expcube["ebinalg"].string("LOG") + expcube["xref"].real(self.m_xref) + expcube["yref"].real(self.m_yref) + expcube["binsz"].real(self.m_binsz) + expcube["nxpix"].integer(self.m_nxpix) + expcube["nypix"].integer(self.m_nypix) + expcube["enumbins"].integer(self.m_ebins) + expcube["emin"].real(self.m_emin) + expcube["emax"].real(self.m_emax) + expcube["coordsys"].string(self.m_coordsys) + expcube["proj"].string(self.m_proj) + expcube.run() + + # Header + if self.logTerse(): + self.log.header3("Creating PSF cube") + + # Create psf cube + psfcube = ctools.ctpsfcube(select.obs()) + psfcube["incube"].filename("NONE") + psfcube["usepnt"].boolean(False) + psfcube["ebinalg"].string("LOG") + psfcube["xref"].real(self.m_xref) + psfcube["yref"].real(self.m_yref) + psfcube["binsz"].real(self.m_binsz) + psfcube["nxpix"].integer(self.m_nxpix) + psfcube["nypix"].integer(self.m_nypix) + psfcube["enumbins"].integer(self.m_ebins) + psfcube["emin"].real(self.m_emin) + psfcube["emax"].real(self.m_emax) + psfcube["coordsys"].string(self.m_coordsys) + psfcube["proj"].string(self.m_proj) + psfcube.run() + + # Header + if self.logTerse(): + self.log.header3("Creating background cube") + + # Create background cube + bkgcube = ctools.ctbkgcube(select.obs()) + bkgcube["incube"].filename("NONE") + bkgcube["usepnt"].boolean(False) + bkgcube["ebinalg"].string("LOG") + bkgcube["xref"].real(self.m_xref) + bkgcube["yref"].real(self.m_yref) + bkgcube["binsz"].real(self.m_binsz) + bkgcube["nxpix"].integer(self.m_nxpix) + bkgcube["nypix"].integer(self.m_nypix) + bkgcube["enumbins"].integer(self.m_ebins) + bkgcube["emin"].real(self.m_emin) + bkgcube["emax"].real(self.m_emax) + bkgcube["coordsys"].string(self.m_coordsys) + bkgcube["proj"].string(self.m_proj) + bkgcube.run() + + # Set new binned observation + obs = bin.obs() + + # Set precomputed binned response + obs[0].response(expcube.expcube(), psfcube.psfcube(), bkgcube.bkgcube()) + + # Get new models + models = bkgcube.models() + + # Fix background models if required + if self.m_fix_bkg: + for model in models: + if not model.classname() == "GModelSky": + for par in model: + par.fix() + + # Set new models to binned observation + obs.models(models) + + # Header + if self.logTerse(): + self.log.header3("Performing fit") + + # Likelihood + like = ctools.ctlike(obs) + like.run() + + # Skip bin if no event was present + if like.obs().logL() == 0.0: + + # Log information + if self.logTerse(): + self.log("No event in this time bin. Bin is skipped\n") + + # Set all values to 0 + for col in columns: + col[i] = 0.0 + TSvalues[i] = 0.0 + ulim_values[i] = 0.0 + continue + + # Get results + fitted_models = like.obs().models() + source = fitted_models[self.m_srcname] + + # Calculate Upper Limit + ulimit_value = -1.0 + if self.m_calc_ulimit: + + # Logging information + if self.logTerse(): + self.log.header3("Computing upper limit") + + # Create upper limit object + ulimit = ctools.ctulimit(like.obs()) + ulimit["srcname"].string(self.m_srcname) + ulimit["eref"].real(1.0) + + # Try to run upper limit and catch exceptions + try: + ulimit.run() + ulimit_value = ulimit.flux_ulimit() + except: + if self.logTerse(): + self.log("Upper limit calculation failed\n") + ulimit_value = -1.0 + + # Get TS value + TS = -1.0 + if self.m_calc_ts: + TS = source.ts() + + # Set values for storage + TSvalues[i] = TS + + # Set FITS column values + for col in columns: + if "e_" == col.name()[:2]: + col[i] = source.spectral()[col.name()[2:]].error() + else: + col[i] = source.spectral()[col.name()].value() + + # Store upper limit value if available + if ulimit_value > 0.0: + ulim_values[i] = ulimit_value + + # Log information + if self.logExplicit(): + self.log.header3("Results of bin "+str(i)+": MJD "+str(tmin.mjd())+"-"+str(tmax.mjd())) + for col in columns: + if "e_" == col.name()[:2]: + continue + value = source.spectral()[col.name()].value() + error = source.spectral()[col.name()].error() + unit = source.spectral()[col.name()].unit() + self.log(" > "+col.name()+": "+str(value)+" +- "+str(error)+" "+unit+"\n") + if self.m_calc_ts and TSvalues[i] > 0.0: + self.log(" > TS = "+str(TS)+" \n") + if self.m_calc_ulimit and ulim_values[i] > 0.0: + self.log(" > UL = "+str(ulim_values[i])+" [ph/cm2/s]") + self.log("\n") + + # Append filles columns to fits table + table.append(MJD) + table.append(e_MJD) + for col in columns: + table.append(col) + table.append(TSvalues) + table.append(ulim_values) + + # Create the FITS file now + self.fits = gammalib.GFits() + self.fits.append(table) + + # Return + return + + +# ======================== # +# Main routine entry point # +# ======================== # +if __name__ == '__main__': + """ + Generates light curve. + """ + # Create instance of application + app = cslightcrv(sys.argv) + + # Open logfile + app.logFileOpen() + + # Execute application + app.execute() diff --git a/scripts/cspull.py b/scripts/cspull.py index d8aa036..24c553b 100755 --- a/scripts/cspull.py +++ b/scripts/cspull.py @@ -99,20 +99,20 @@ class cspull(ctools.cscript): pars.append(gammalib.GApplicationPar("expcube","s","a","NONE","","","Exposure cube file (only needed for stacked analysis)")) pars.append(gammalib.GApplicationPar("psfcube","s","a","NONE","","","PSF cube file (only needed for stacked analysis)")) pars.append(gammalib.GApplicationPar("bkgcube","s","a","NONE","","","Background cube file (only needed for stacked analysis)")) - pars.append(gammalib.GApplicationPar("caldb","s","a","dummy","","","Calibration database")) - pars.append(gammalib.GApplicationPar("irf","s","a","cta_dummy_irf","","","Instrument response function")) + pars.append(gammalib.GApplicationPar("caldb","s","a","prod2","","","Calibration database")) + pars.append(gammalib.GApplicationPar("irf","s","a","South_50h","","","Instrument response function")) + pars.append(gammalib.GApplicationPar("deadc","r","h","0.95","0","1","Deadtime correction factor")) pars.append(gammalib.GApplicationPar("edisp","b","h","no","","","Apply energy dispersion?")) pars.append(gammalib.GApplicationPar("ntrials","i","a","10","","","Number of trials")) pars.append(gammalib.GApplicationPar("ra","r","a","83.6331","0","360","RA of pointing (deg)")) pars.append(gammalib.GApplicationPar("dec","r","a","22.0145","-90","90","Dec of pointing (deg)")) pars.append(gammalib.GApplicationPar("emin","r","a","0.1","","","Lower energy limit (TeV)")) pars.append(gammalib.GApplicationPar("emax","r","a","100.0","","","Upper energy limit (TeV)")) + pars.append(gammalib.GApplicationPar("enumbins","i","a","0","","","Number of energy bins (0=unbinned)")) pars.append(gammalib.GApplicationPar("tmin","r","h","0.0","","","Start time (MET in s)")) pars.append(gammalib.GApplicationPar("tmax","r","a","1800.0","","","Duration (in s)")) - pars.append(gammalib.GApplicationPar("enumbins","i","a","0","","","Number of energy bins (0=unbinned)")) pars.append(gammalib.GApplicationPar("npix","i","a","200","","","Number of pixels for binned")) pars.append(gammalib.GApplicationPar("binsz","r","a","0.05","","","Pixel size for binned (deg/pixel)")) - pars.append(gammalib.GApplicationPar("deadc","r","h","0.95","0","1","Deadtime correction factor")) pars.append(gammalib.GApplicationPar("rad","r","h","5.0","0","180","Radius of ROI (deg)")) pars.append(gammalib.GApplicationPar("pattern","s","h","single","","","Observation pattern (single/four)")) pars.append(gammalib.GApplicationPar("offset","r","h","1.5","","","Observation pattern offset (deg)")) diff --git a/scripts/csresmap.py b/scripts/csresmap.py index 6f85ba1..1ab36fe 100755 --- a/scripts/csresmap.py +++ b/scripts/csresmap.py @@ -47,11 +47,11 @@ class csresmap(ctools.cscript): self.resmap = None # Initialise some members - if isinstance(argv[0],gammalib.GObservations): + if len(argv) > 0 and isinstance(argv[0],gammalib.GObservations): self.obs = argv[0] - argv = argv[1:] + argv = argv[1:] else: - self.obs = gammalib.GObservations() + self.obs = gammalib.GObservations() self.obs.clear() self.outfile = "" @@ -103,8 +103,8 @@ class csresmap(ctools.cscript): pars.append(gammalib.GApplicationPar("inobs","f","a","events.fits","","","Event list, counts cube, or observation definition file")) pars.append(gammalib.GApplicationPar("inmodel","f","a","$CTOOLS/share/models/crab.xml","","","Source model")) pars.append(gammalib.GApplicationPar("outmap","f","a","resmap.fits","","","Output residual map")) - pars.append(gammalib.GApplicationPar("caldb","s","a","dummy","","","Calibration database")) - pars.append(gammalib.GApplicationPar("irf","s","a","cta_dummy_irf","","","Instrument response function")) + pars.append(gammalib.GApplicationPar("caldb","s","a","prod2","","","Calibration database")) + pars.append(gammalib.GApplicationPar("irf","s","a","South_50h","","","Instrument response function")) pars.append(gammalib.GApplicationPar("ebinalg","s","h","LOG","LIN|LOG|FILE","","Binning algorithm")) pars.append(gammalib.GApplicationPar("emin","r","h","0.1","","","Lower energy limit (TeV)")) pars.append(gammalib.GApplicationPar("emax","r","h","100.0","","","Upper energy limit (TeV)")) diff --git a/scripts/cssens.py b/scripts/cssens.py index 2103148..42eddee 100755 --- a/scripts/cssens.py +++ b/scripts/cssens.py @@ -101,8 +101,8 @@ class cssens(ctools.cscript): pars.append(gammalib.GApplicationPar("inmodel","f","a","$CTOOLS/share/models/crab.xml","","","Source model")) pars.append(gammalib.GApplicationPar("srcname","s","a","Crab","","","Source name")) pars.append(gammalib.GApplicationPar("offset","r","h","0.0","","","Source offset angle (deg)")) - pars.append(gammalib.GApplicationPar("caldb","s","a","dummy","","","Calibration database")) - pars.append(gammalib.GApplicationPar("irf","s","a","cta_dummy_irf","","","Instrument response function")) + pars.append(gammalib.GApplicationPar("caldb","s","a","prod2","","","Calibration database")) + pars.append(gammalib.GApplicationPar("irf","s","a","South_50h","","","Instrument response function")) pars.append(gammalib.GApplicationPar("deadc","r","h","0.95","0","1","Deadtime correction factor")) pars.append(gammalib.GApplicationPar("outfile","f","h","sensitivity.dat","","","Output file name")) pars.append(gammalib.GApplicationPar("duration","r","a","180000.0","","","Effective exposure time (s)")) @@ -200,7 +200,8 @@ class cssens(ctools.cscript): self.log("\n") # Initialise script - colnames = ['loge', 'emin', 'emax', 'crab', 'pflux', 'eflux', 'diffSens'] + colnames = ['loge', 'emin', 'emax', 'crab_flux', 'photon_flux', \ + 'energy_flux', 'sensitivity'] results = [] # Initialise models @@ -412,18 +413,10 @@ class cssens(ctools.cscript): # Set energy boundaries self.set_obs_ebounds(emin, emax) - # Determine energy boundaries from first observation in - # the container - #for run in obs: - # emin = run.events().ebounds().emin() - # emax = run.events().ebounds().emax() - # loge = math.log10(math.sqrt(emin.TeV()*emax.TeV())) - # erg_mean = math.pow(10.0, loge) * tev2erg - # erg_width = (emax.TeV()-emin.TeV()) * tev2erg - # break + # Determine energy boundaries from first observation in the container loge = math.log10(math.sqrt(emin.TeV()*emax.TeV())) - erg_mean = math.pow(10.0, loge) * tev2erg - erg_width = (emax.TeV()-emin.TeV()) * tev2erg + e_mean = math.pow(10.0, loge) + erg_mean = e_mean * tev2erg # Compute Crab unit (this is the factor with which the Prefactor needs # to be multiplied to get 1 Crab @@ -446,12 +439,12 @@ class cssens(ctools.cscript): self.log("\n") # Initialise loop - flux_value = [] - pflux_value = [] - eflux_value = [] - diffSens_value = [] - iter = 0 - test_cflux = 0.1 # This is the initial test flux in Crab units (100 mCrab) + crab_flux_value = [] + photon_flux_value = [] + energy_flux_value = [] + sensitivity_value = [] + iter = 0 + test_crab_flux = 0.1 # Initial test flux in Crab units (100 mCrab) # Loop until we break while True: @@ -463,13 +456,13 @@ class cssens(ctools.cscript): if self.logExplicit(): self.log.header2("Iteration "+str(iter)) - # Set test flux + # Set source model. crab_prefactor is the Prefactor that + # corresponds to 1 Crab src_model = full_model.copy() crab_prefactor = src_model[self.m_srcname]['Prefactor'].value() * crab_unit - src_model[self.m_srcname]['Prefactor'].value(crab_prefactor * test_cflux) + src_model[self.m_srcname]['Prefactor'].value(crab_prefactor * test_crab_flux) obs.models(src_model) - # Simulate events sim = obsutils.sim(obs, nbins=self.m_enumbins, seed=iter, \ binsz=self.m_binsz, npix=self.m_npix, \ @@ -572,48 +565,45 @@ class cssens(ctools.cscript): continue # Get fitted Crab, photon and energy fluxes - cflux = result_all[self.m_srcname]['Prefactor'].value() / crab_prefactor - cflux_err = result_all[self.m_srcname]['Prefactor'].error() / crab_prefactor - pflux = result_all[self.m_srcname].spectral().flux(emin, emax) - eflux = result_all[self.m_srcname].spectral().eflux(emin, emax) + crab_flux = result_all[self.m_srcname]['Prefactor'].value() / crab_prefactor + crab_flux_err = result_all[self.m_srcname]['Prefactor'].error() / crab_prefactor + photon_flux = result_all[self.m_srcname].spectral().flux(emin, emax) + energy_flux = result_all[self.m_srcname].spectral().eflux(emin, emax) - # Compute differential sensitivity - diffSens = pflux / erg_width * erg_mean*erg_mean + # Compute differential sensitivity in unit erg/cm2/s + energy = gammalib.GEnergy(e_mean, "TeV") + time = gammalib.GTime() + sensitivity = result_all[self.m_srcname].spectral().eval(energy, time) * \ + erg_mean*erg_mean * 1.0e6 # Compute flux correction factor based on average TS correct = 1.0 if ts > 0: correct = math.sqrt(self.m_ts_thres/ts) - #if self.m_use_ts: - # if ts > 0: - # correct = math.sqrt(self.m_ts_thres/ts) - #else: - # if cflux > 0 and cflux_err > 0: - # correct = math.sqrt(self.m_ts_thres)/(cflux/cflux_err) # Compute extrapolated fluxes - flux = correct * cflux - pflux = correct * pflux - eflux = correct * eflux - diffSens = correct * diffSens - flux_value.append(flux) - pflux_value.append(pflux) - eflux_value.append(eflux) - diffSens_value.append(diffSens) + crab_flux = correct * crab_flux + photon_flux = correct * photon_flux + energy_flux = correct * energy_flux + sensitivity = correct * sensitivity + crab_flux_value.append(crab_flux) + photon_flux_value.append(photon_flux) + energy_flux_value.append(energy_flux) + sensitivity_value.append(sensitivity) # Write background and test source fit results if self.logExplicit(): self.log.parformat("Photon flux") - self.log(pflux) + self.log(photon_flux) self.log(" ph/cm2/s\n") self.log.parformat("Energy flux") - self.log(eflux) + self.log(energy_flux) self.log(" erg/cm2/s\n") self.log.parformat("Crab flux") - self.log(cflux*1000.0) + self.log(crab_flux*1000.0) self.log(" mCrab\n") self.log.parformat("Differential sensitivity") - self.log(diffSens) + self.log(sensitivity) self.log(" erg/cm2/s\n") for model in result_all: self.log.parformat("Model") @@ -629,40 +619,40 @@ class cssens(ctools.cscript): self.log("corr=") self.log(correct) self.log(" ") - self.log(pflux) + self.log(photon_flux) self.log(" ph/cm2/s = ") - self.log(eflux) + self.log(energy_flux) self.log(" erg/cm2/s = ") - self.log(cflux*1000.0) + self.log(crab_flux*1000.0) self.log(" mCrab = ") - self.log(diffSens) + self.log(sensitivity) self.log(" erg/cm2/s\n") # Compute sliding average of extrapolated fitted prefactor, # photon and energy flux. This damps out fluctuations and # improves convergence - flux = 0.0 - pflux = 0.0 - eflux = 0.0 - diffSens = 0.0 - num = 0.0 + crab_flux = 0.0 + photon_flux = 0.0 + energy_flux = 0.0 + sensitivity = 0.0 + num = 0.0 for k in range(self.m_num_avg): - inx = len(flux_value) - k - 1 + inx = len(crab_flux_value) - k - 1 if inx >= 0: - flux += flux_value[inx] - pflux += pflux_value[inx] - eflux += eflux_value[inx] - diffSens += diffSens_value[inx] + crab_flux += crab_flux_value[inx] + photon_flux += photon_flux_value[inx] + energy_flux += energy_flux_value[inx] + sensitivity += sensitivity_value[inx] num += 1.0 - flux /= num - pflux /= num - eflux /= num - diffSens /= num + crab_flux /= num + photon_flux /= num + energy_flux /= num + sensitivity /= num # Compare average flux to last average if iter > self.m_num_avg: - if test_cflux > 0: - ratio = flux/test_cflux + if test_crab_flux > 0: + ratio = crab_flux/test_crab_flux # We have 2 convergence criteria: # 1. The average flux does not change @@ -678,7 +668,7 @@ class cssens(ctools.cscript): break # Use average for next iteration - test_cflux = flux + test_crab_flux = crab_flux # Exit loop if number of trials exhausted if (iter >= self.m_max_iter): @@ -693,16 +683,16 @@ class cssens(ctools.cscript): self.log(ts) self.log("\n") self.log.parformat("Photon flux") - self.log(pflux) + self.log(photon_flux) self.log(" ph/cm2/s\n") self.log.parformat("Energy flux") - self.log(eflux) + self.log(energy_flux) self.log(" erg/cm2/s\n") self.log.parformat("Crab flux") - self.log(cflux*1000.0) + self.log(crab_flux*1000.0) self.log(" mCrab\n") self.log.parformat("Differential sensitivity") - self.log(diffSens) + self.log(sensitivity) self.log(" erg/cm2/s\n") self.log.parformat("Number of simulated events") self.log(nevents) @@ -736,8 +726,9 @@ class cssens(ctools.cscript): # Store result result = {'loge': loge, 'emin': emin.TeV(), 'emax': emax.TeV(), \ - 'crab': flux, 'pflux': pflux, 'eflux': eflux, \ - 'diffSens': diffSens} + 'crab_flux': crab_flux, 'photon_flux': photon_flux, \ + 'energy_flux': energy_flux, \ + 'sensitivity': sensitivity} # Return result return result diff --git a/scripts/csspec.py b/scripts/csspec.py index 00e32c8..5386d74 100755 --- a/scripts/csspec.py +++ b/scripts/csspec.py @@ -21,10 +21,11 @@ import gammalib import ctools import sys +import tempfile -# ============== # -# cstsdist class # -# ============== # +# ============ # +# csspec class # +# ============ # class csspec(ctools.cscript): """ This class implements the creation of spectral points. It derives from @@ -42,14 +43,14 @@ class csspec(ctools.cscript): self.version = "1.0.0" # Initialise some members - self.obs = None + self.obs = None # Initialise some members - if isinstance(argv[0],gammalib.GObservations): + if len(argv) > 0 and isinstance(argv[0],gammalib.GObservations): self.obs = argv[0] - argv = argv[1:] + argv = argv[1:] else: - self.obs = gammalib.GObservations() + self.obs = gammalib.GObservations() self.obs.clear() self.m_outfile = "" @@ -104,12 +105,22 @@ class csspec(ctools.cscript): pars.append(gammalib.GApplicationPar("outfile","f","a","spectrum.fits","","","Output file name")) pars.append(gammalib.GApplicationPar("expcube","f","a","NONE","","","Exposure cube file (only needed for stacked analysis)")) pars.append(gammalib.GApplicationPar("psfcube","f","a","NONE","","","PSF cube file (only needed for stacked analysis)")) - pars.append(gammalib.GApplicationPar("caldb","s","a","dummy","","","Calibration database")) - pars.append(gammalib.GApplicationPar("irf","s","a","cta_dummy_irf","","","Instrument response function")) - pars.append(gammalib.GApplicationPar("emin","r","h","0.1","","","Lower energy limit (TeV)")) - pars.append(gammalib.GApplicationPar("emax","r","h","100.0","","","Upper energy limit (TeV)")) - pars.append(gammalib.GApplicationPar("enumbins","i","a","20","","","Number of energy bins")) - pars.append(gammalib.GApplicationPar("ebinalg","s","h","LOG","LIN|LOG|FILE","","Binning algorithm")) + pars.append(gammalib.GApplicationPar("bkgcube","s","a","NONE","","","Background cube file (only needed for stacked analysis)")) + pars.append(gammalib.GApplicationPar("caldb","s","a","prod2","","","Calibration database")) + pars.append(gammalib.GApplicationPar("irf","s","a","South_50h","","","Instrument response function")) + pars.append(gammalib.GApplicationPar("emin","r","h","0.1","","","Lower energy limit for spectral points(TeV)")) + pars.append(gammalib.GApplicationPar("emax","r","h","100.0","","","Upper energy limit for spectral points(TeV)")) + pars.append(gammalib.GApplicationPar("enumbins","i","a","20","","","Number of spectral points")) + pars.append(gammalib.GApplicationPar("ebinalg","s", "h","LOG","FILE|LIN|LOG","", "Algorithm for defining energy bins")) + pars.append(gammalib.GApplicationPar("binned","b","a","no","yes|no","","Use binned analysis in each energy bin")) + pars.append(gammalib.GApplicationPar("nebins","i","h","5","","","Number of energy bins per spectral point")) + pars.append(gammalib.GApplicationPar("coordsys","s","a","CEL","CEL|GAL","","Coordinate System")) + pars.append(gammalib.GApplicationPar("proj","s","a","CAR","AIT|AZP|CAR|MER|MOL|STG|TAN","","Projection method")) + pars.append(gammalib.GApplicationPar("xref","r","a","83.63","0","360","First coordinate of image center in degrees (RA or galactic l)")) + pars.append(gammalib.GApplicationPar("yref","r","a","22.01","-90","90","Second coordinate of image center in degrees (DEC or galactic b)")) + pars.append(gammalib.GApplicationPar("nxpix","i","a","200","","","Size of the X axis in pixels")) + pars.append(gammalib.GApplicationPar("nypix","i","a","200","","","Size of the Y axis in pixels")) + pars.append(gammalib.GApplicationPar("binsz","r","a","0.02","","","Pixel size (deg/pixel)")) pars.append(gammalib.GApplicationPar("calc_ts","b","h","yes","yes|no","","Compute TS value in each bin")) pars.append(gammalib.GApplicationPar("calc_ulim","b","h","yes","yes|no","","Compute upper limit in each bin")) pars.append(gammalib.GApplicationPar("fix_srcs","b","h","yes","yes|no","","Fix other skymodel parameters")) @@ -125,7 +136,6 @@ class csspec(ctools.cscript): """ Get parameters from parfile and setup the observation. """ - # Get parameters # Set observation if not done before if self.obs == None or self.obs.size() == 0: self.require_inobs("csspec::get_parameters()") @@ -138,9 +148,21 @@ class csspec(ctools.cscript): # Get source name self.m_srcname = self["srcname"].string() - # Get ebounds + # Get ebounds self.m_ebounds = self.create_ebounds() + # Get binning flag + self.m_binned = self["binned"].boolean() + if self.m_binned: + self.m_xref = self["xref"].real() + self.m_yref = self["yref"].real() + self.m_nxpix = self["nxpix"].integer() + self.m_nypix = self["nypix"].integer() + self.m_binsz = self["binsz"].real() + self.m_coordsys = self["coordsys"].string() + self.m_proj = self["proj"].string() + self.m_ebins = self["nebins"].integer() + # Read other parameters self.m_outfile = self["outfile"].filename() @@ -210,21 +232,39 @@ class csspec(ctools.cscript): self.log("\n") self.log.header1("Adjust model parameters") + # Adjust model parameters dependent on input user parameters for model in self.obs.models(): + + # Set TS flag for all models to false. + # Source of interest will be set to true later model.tscalc(False) + + # Log model name + if self.logExplicit(): + self.log.header3(model.name()) + + # Deal with the source of interest if model.name() == self.m_srcname: for par in model: + if par.is_free() and self.logExplicit(): + self.log(" Fixing \""+par.name()+"\"\n") par.fix() + if par.is_fixed() and self.logExplicit(): + self.log(" Freeing \""+par.name()+"\"\n") model.spectral()[0].free() if self.m_calc_ts: model.tscalc(True) - elif self.m_fix_bkg and not model.classname() == "GModelData": + elif self.m_fix_bkg and not model.classname() == "GModelSky": for par in model: + if par.is_free() and self.logExplicit(): + self.log(" Fixing \""+par.name()+"\"\n") par.fix() elif self.m_fix_srcs and model.classname() == "GModelSky": for par in model: + if par.is_free() and self.logExplicit(): + self.log(" Fixing \""+par.name()+"\"\n") par.fix() # Write header @@ -237,14 +277,16 @@ class csspec(ctools.cscript): table.extname("SPECTRUM") # Add Header for compatibility with gammalib.GMWLSpectrum - table.card("Instrument", "CTA", "Name of Instrument") - table.card("Telescope", "CTA", "Name of Telescope") + table.card("INSTRUME", "CTA", "Name of Instrument") + table.card("TELESCOP", "CTA", "Name of Telescope") # Create FITS table columns energy = gammalib.GFitsTableDoubleCol("Energy", self.m_ebounds.size()) energy.unit("TeV") - energy_err = gammalib.GFitsTableDoubleCol("e_Energy", self.m_ebounds.size()) - energy_err.unit("TeV") + energy_low = gammalib.GFitsTableDoubleCol("ed_Energy", self.m_ebounds.size()) + energy_low.unit("TeV") + energy_high = gammalib.GFitsTableDoubleCol("eu_Energy", self.m_ebounds.size()) + energy_high.unit("TeV") flux = gammalib.GFitsTableDoubleCol("Flux", self.m_ebounds.size()) flux.unit("erg/cm2/s") flux_err = gammalib.GFitsTableDoubleCol("e_Flux", self.m_ebounds.size()) @@ -252,16 +294,31 @@ class csspec(ctools.cscript): TSvalues = gammalib.GFitsTableDoubleCol("TS", self.m_ebounds.size()) ulim_values = gammalib.GFitsTableDoubleCol("UpperLimit", self.m_ebounds.size()) ulim_values.unit("erg/cm2/s") - + # Loop over energy bins for i in range(self.m_ebounds.size()): + # Log information + if self.logTerse(): + self.log("\n") + self.log.header2("Energy bin "+str(i)) + # Get energy boundaries emin = self.m_ebounds.emin(i) emax = self.m_ebounds.emax(i) - emean = self.m_ebounds.emean(i) elogmean = self.m_ebounds.elogmean(i) - elogmean2 = elogmean.MeV() * elogmean.MeV() + elogmean2 = elogmean.MeV() * elogmean.MeV() + + # Store energy as TeV + energy[i] = elogmean.TeV() + + # Store energy errors + energy_low[i] = (elogmean - emin).TeV() + energy_high[i] = (emax - elogmean).TeV() + + # Log information + if self.logExplicit(): + self.log.header3("Selecting events") # Select events select = ctools.ctselect(self.obs) @@ -272,23 +329,163 @@ class csspec(ctools.cscript): select["rad"].value("UNDEFINED") select["ra"].value("UNDEFINED") select["dec"].value("UNDEFINED") - select.run() - - # likelihood - like = ctools.ctlike(select.obs()) + select.run() + + # Retrieve observation + obs = select.obs() + + # Binned analysis + if self.m_binned: + + # Header + if self.logTerse(): + self.log.header3("Binning events") + + # Bin events + bin = ctools.ctbin(select.obs()) + bin["usepnt"].boolean(False) + bin["ebinalg"].string("LOG") + bin["xref"].real(self.m_xref) + bin["yref"].real(self.m_yref) + bin["binsz"].real(self.m_binsz) + bin["nxpix"].integer(self.m_nxpix) + bin["nypix"].integer(self.m_nypix) + bin["enumbins"].integer(self.m_ebins) + bin["emin"].real(emin.TeV()) + bin["emax"].real(emax.TeV()) + bin["coordsys"].string(self.m_coordsys) + bin["proj"].string(self.m_proj) + bin.run() + + # Header + if self.logTerse(): + self.log.header3("Creating exposure cube") + + # Create exposure cube + expcube = ctools.ctexpcube(select.obs()) + expcube["incube"].filename("NONE") + expcube["usepnt"].boolean(False) + expcube["ebinalg"].string("LOG") + expcube["xref"].real(self.m_xref) + expcube["yref"].real(self.m_yref) + expcube["binsz"].real(self.m_binsz) + expcube["nxpix"].integer(self.m_nxpix) + expcube["nypix"].integer(self.m_nypix) + expcube["enumbins"].integer(self.m_ebins) + expcube["emin"].real(emin.TeV()) + expcube["emax"].real(emax.TeV()) + expcube["coordsys"].string(self.m_coordsys) + expcube["proj"].string(self.m_proj) + expcube.run() + + # Header + if self.logTerse(): + self.log.header3("Creating PSF cube") + + # Create psf cube + psfcube = ctools.ctpsfcube(select.obs()) + psfcube["incube"].filename("NONE") + psfcube["usepnt"].boolean(False) + psfcube["ebinalg"].string("LOG") + psfcube["xref"].real(self.m_xref) + psfcube["yref"].real(self.m_yref) + psfcube["binsz"].real(self.m_binsz) + psfcube["nxpix"].integer(self.m_nxpix) + psfcube["nypix"].integer(self.m_nypix) + psfcube["enumbins"].integer(self.m_ebins) + psfcube["emin"].real(emin.TeV()) + psfcube["emax"].real(emax.TeV()) + psfcube["coordsys"].string(self.m_coordsys) + psfcube["proj"].string(self.m_proj) + psfcube.run() + + # Header + if self.logTerse(): + self.log.header3("Creating background cube") + + # Create background cube + bkgcube = ctools.ctbkgcube(select.obs()) + bkgcube["incube"].filename("NONE") + bkgcube["usepnt"].boolean(False) + bkgcube["ebinalg"].string("LOG") + bkgcube["xref"].real(self.m_xref) + bkgcube["yref"].real(self.m_yref) + bkgcube["binsz"].real(self.m_binsz) + bkgcube["nxpix"].integer(self.m_nxpix) + bkgcube["nypix"].integer(self.m_nypix) + bkgcube["enumbins"].integer(self.m_ebins) + bkgcube["emin"].real(emin.TeV()) + bkgcube["emax"].real(emax.TeV()) + bkgcube["coordsys"].string(self.m_coordsys) + bkgcube["proj"].string(self.m_proj) + bkgcube.run() + + # Set new binned observation + obs = bin.obs() + + # Set precomputed binned response + obs[0].response(expcube.expcube(), psfcube.psfcube(), bkgcube.bkgcube()) + + # Get new models + models = bkgcube.models() + + # Fix background models if required + if self.m_fix_bkg: + for model in models: + if not model.classname() == "GModelSky": + for par in model: + par.fix() + + # Set new models to binned observation + obs.models(models) + + # Header + if self.logTerse(): + self.log.header3("Performing fit") + + # Likelihood + like = ctools.ctlike(obs) like.run() + # Skip bin if no event was present + if like.obs().logL() == 0.0: + + # Log information + if self.logTerse(): + self.log("No event in this bin. Bin is skipped\n") + + # Set all values to 0 + flux[i] = 0.0 + flux_err[i] = 0.0 + TSvalues[i] = 0.0 + ulim_values[i] = 0.0 + continue + # Get results fitted_models = like.obs().models() source = fitted_models[self.m_srcname] - + # Calculate Upper Limit ulimit_value = -1.0 - #if self.m_calc_ulimit: - # ulimit = ctools.ctulimit(like.obs()) - # ulimit["eref"].real(elogmean.TeV()) - # ulimit.run() - # ulimit_value.ulimit.diff_ulimit() + if self.m_calc_ulimit: + + # Logging information + if self.logTerse(): + self.log.header3("Computing upper limit") + + # Create upper limit object + ulimit = ctools.ctulimit(like.obs()) + ulimit["srcname"].string(self.m_srcname) + ulimit["eref"].real(elogmean.TeV()) + + # Try to run upper limit and catch exceptions + try: + ulimit.run() + ulimit_value = ulimit.diff_ulimit() + except: + if self.logTerse(): + self.log("Upper limit calculation failed\n") + ulimit_value = -1.0 # Get TS value TS = -1.0 @@ -306,19 +503,12 @@ class csspec(ctools.cscript): # Set values for storage TSvalues[i] = TS - # Store energy as TeV - energy[i] = elogmean.TeV() - - # Store energy error - energy_err[i] = (emax - emean).TeV() - # Convert fluxes to nuFnu flux[i] = fitted_flux * elogmean2 * gammalib.MeV2erg flux_err[i] = e_flux * elogmean2 * gammalib.MeV2erg if ulimit_value > 0.0: ulim_values[i] = ulimit_value * elogmean2 * gammalib.MeV2erg - - + # Log information if self.logExplicit(): self.log("Bin "+str(i)+" ["+str(emin.TeV())+"-"+str(emax.TeV())+"] TeV: ") @@ -329,10 +519,11 @@ class csspec(ctools.cscript): if self.m_calc_ulimit and ulim_values[i] > 0.0: self.log(", UL = "+str(ulim_values[i])+" [erg/cm2/s]") self.log("\n") - + # Append filles columns to fits table table.append(energy) - table.append(energy_err) + table.append(energy_low) + table.append(energy_high) table.append(flux) table.append(flux_err) table.append(TSvalues) diff --git a/scripts/cstsdist.py b/scripts/cstsdist.py index 16331a3..dfd8547 100755 --- a/scripts/cstsdist.py +++ b/scripts/cstsdist.py @@ -95,27 +95,29 @@ class cstsdist(ctools.cscript): # Create default parfile pars = gammalib.GApplicationPars() pars.append(gammalib.GApplicationPar("inobs","f","h","NONE","","","Event list, counts cube, or observation definition file")) - pars.append(gammalib.GApplicationPar("outfile","f","h","ts.dat","","","Output file name")) + pars.append(gammalib.GApplicationPar("inmodel","f","a","$CTOOLS/share/models/crab.xml","","","Source model")) + pars.append(gammalib.GApplicationPar("srcname","s","a","Crab","","","Source name")) + pars.append(gammalib.GApplicationPar("outfile","f","a","ts.dat","","","Output file name")) pars.append(gammalib.GApplicationPar("expcube","s","a","NONE","","","Exposure cube file (only needed for stacked analysis)")) pars.append(gammalib.GApplicationPar("psfcube","s","a","NONE","","","PSF cube file (only needed for stacked analysis)")) - pars.append(gammalib.GApplicationPar("caldb","s","a","dummy","","","Calibration database")) - pars.append(gammalib.GApplicationPar("irf","s","a","cta_dummy_irf","","","Instrument response function")) - pars.append(gammalib.GApplicationPar("ra","r","h","83.63","0","360","RA of pointing (deg)")) - pars.append(gammalib.GApplicationPar("dec","r","h","22.01","-90","90","Dec of pointing (deg)")) + pars.append(gammalib.GApplicationPar("bkgcube","s","a","NONE","","","Background cube file (only needed for stacked analysis)")) + pars.append(gammalib.GApplicationPar("caldb","s","a","prod2","","","Calibration database")) + pars.append(gammalib.GApplicationPar("irf","s","a","South_50h","","","Instrument response function")) + pars.append(gammalib.GApplicationPar("deadc","r","h","0.95","","","Deadtime correction factor")) + pars.append(gammalib.GApplicationPar("edisp","b","h","no","","","Apply energy dispersion?")) + pars.append(gammalib.GApplicationPar("ntrials","i","a","10","","","Number of trials")) + pars.append(gammalib.GApplicationPar("ra","r","a","83.63","0","360","RA of pointing (deg)")) + pars.append(gammalib.GApplicationPar("dec","r","a","22.01","-90","90","Dec of pointing (deg)")) pars.append(gammalib.GApplicationPar("emin","r","a","0.1","","","Lower energy limit (TeV)")) pars.append(gammalib.GApplicationPar("emax","r","a","100.0","","","Upper energy limit (TeV)")) + pars.append(gammalib.GApplicationPar("enumbins","i","a","0","","","Number of energy bins (0=unbinned)")) pars.append(gammalib.GApplicationPar("tmin","r","h","0.0","","","Start time (MET in s)")) pars.append(gammalib.GApplicationPar("tmax","r","a","1800.0","","","Observation duration (in s)")) - pars.append(gammalib.GApplicationPar("enumbins","i","a","0","","","Number of energy bins (0=unbinned)")) - pars.append(gammalib.GApplicationPar("npix","i","h","200","","","Number of pixels for binned")) - pars.append(gammalib.GApplicationPar("binsz","r","h","0.05","","","Pixel size for binned (deg/pixel)")) - pars.append(gammalib.GApplicationPar("deadc","r","h","0.95","","","Deadtime correction factor")) + pars.append(gammalib.GApplicationPar("npix","i","a","200","","","Number of pixels for binned")) + pars.append(gammalib.GApplicationPar("binsz","r","a","0.05","","","Pixel size for binned (deg/pixel)")) pars.append(gammalib.GApplicationPar("rad","r","h","5.0","","","Radius of ROI (deg)")) - pars.append(gammalib.GApplicationPar("ntrials","i","a","10","","","Number of trials")) - pars.append(gammalib.GApplicationPar("type","s","a","point","","","Source model type (point/gauss/shell/disk)")) - pars.append(gammalib.GApplicationPar("index","r","h","-2.48","","","Spectral index")) - pars.append(gammalib.GApplicationPar("offset","r","a","0.0","","","Source offset angle (deg)")) - pars.append(gammalib.GApplicationPar("bkg","s","a","$CTOOLS/share/models/bkg_dummy.txt","","","Background model file function")) + pars.append(gammalib.GApplicationPar("pattern","s","h","single","","","Observation pattern (single/four)")) + pars.append(gammalib.GApplicationPar("offset","r","h","1.5","","","Observation pattern offset (deg)")) pars.append_standard() pars.append(gammalib.GApplicationPar("logfile","f","h","cstsdist.log","","","Log filename")) pars.save(parfile) @@ -131,6 +133,15 @@ class cstsdist(ctools.cscript): # Set observation if not done before if self.obs == None or self.obs.size() == 0: self.obs = self.get_observations() + + # Check for requested pattern and use above + # observation parameters to set wobble pattern + self.m_pattern = self["pattern"].string() + if self.m_pattern == "four": + self.obs = self.set_obs() + + # Get source name + self.m_srcname = self["srcname"].string() # Get number of energy bins self.m_enumbins = self["enumbins"].integer() @@ -143,36 +154,21 @@ class cstsdist(ctools.cscript): # Set dummy values (required by obsutils) self.m_npix = 0 self.m_binsz = 0.0 + + # Set models if we have none + if self.obs.models().size() == 0: + self.obs.models(self["inmodel"].filename()) # Get other parameters - self.m_outfile = self["outfile"].filename() - self.m_ntrials = self["ntrials"].integer() - self.m_type = self["type"].string() - self.m_index = self["index"].real() - self.m_offset = self["offset"].real() - self.m_bkg = self["bkg"].string() + self.m_outfile = self["outfile"].filename() + self.m_ntrials = self["ntrials"].integer() + self.m_edisp = self["edisp"].boolean() + self.m_offset = self["offset"].real() # Set some fixed parameters - self.m_log = False # Logging in client tools - self.m_debug = False # Debugging in client tools - - pnt = gammalib.GSkyDir() - pnt.radec_deg(self["ra"].real(),self["dec"].real()) - - # Initialise models. Note that we centre the point source at the - # center of our observation, so we're onaxis. - self.bkg_model = gammalib.GModels() - self.full_model = gammalib.GModels() - self.bkg_model.append(self.set_bkg_model()) - self.full_model.append(self.set_bkg_model()) - self.full_model.append(self.set_src_model(pnt.l_deg(), pnt.b_deg()+self.m_offset, \ - flux=0.010, \ - type=self.m_type, \ - index=self.m_index)) - - # Attach background model to observation container - self.obs.models(self.bkg_model) - + self.m_log = False # Logging in client tools + self.m_debug = self["debug"].boolean() # Debugging in client tools + # Return return @@ -211,6 +207,20 @@ class cstsdist(ctools.cscript): if self.logTerse(): self.log_parameters() self.log("\n") + + # Initialise models + full_model, bkg_model = self.set_models() + + # Write models into logger + if self.logTerse(): + self.log("\n") + self.log.header1("Models") + self.log.header2("Background model") + self.log(str(bkg_model)) + self.log("\n\n") + self.log.header2("Full model") + self.log(str(full_model)) + self.log("\n") # Write observation into logger if self.logTerse(): @@ -235,7 +245,7 @@ class cstsdist(ctools.cscript): for seed in range(self.m_ntrials): # Make a trial - result = self.trial(seed) + result = self.trial(seed, full_model, bkg_model) # Write out result immediately if seed == 0: @@ -251,97 +261,89 @@ class cstsdist(ctools.cscript): # Return return - def set_bkg_model(self, fitsigma=False): + def set_models(self, fitpos=False, fitspec=False): """ - Setup CTA background model. + Set full and background model. """ - # Define radial component - radial = gammalib.GCTAModelRadialGauss(3.0) - if fitsigma: - radial["Sigma"].free() - else: - radial["Sigma"].fix() - - # Define spectral component - spectrum = gammalib.GModelSpectralFunc(self.m_bkg, 1.0) + # Retrieve full model from observation container + full_model = self.obs.models().copy() + + # Get source model + model = full_model[self.m_srcname] - # Create background model - model = gammalib.GCTAModelRadialAcceptance(radial, spectrum) - model.name("Background") - model.instruments("CTA") - - # Return background model - return model - - def set_src_model(self, l, b, flux=1.0, index=-2.48, \ - type="point", sigma=1.0, radius=1.0, width=0.1, \ - fitpos=False, fitidx=False): - """ - Returns a single source with Crab-like spectrum. The source flux - can be scaled in Crab units. The Crab spectrum is based on MAGIC - observations (Albert et al. 2008, ApJ, 674, 1037). + # Check that model has a Prefactor + if not model.has_par("Prefactor"): + msg = "Model \""+self.m_srcname+"\" has no parameter \"Prefactor\"."+ \ + " Only spectral models with a \"Prefactor\" parameter are supported." + raise gammalib.GException.invalid_value("cssens", msg) - Parameters: - l - Galactic longitude of source location [deg] - b - Galactic latitude of source location [deg] - Keywords: - flux - Source flux [Crabs] - index - Spectral index - type - Source type ("point", "gauss", "disk", "shell") - sigma - Gaussian sigma (for type="gauss") - radius - Disk or shell inner radius [deg] (for type="disk" and type="shell") - width - Shell width [deg] (for type="shell") - fitpos - Fit position? (default: True) - fitidx - Fit index? (default: True) - """ - # Set source location - location = gammalib.GSkyDir() - location.lb_deg(l, b) - - # Set source spectrum - spectrum = gammalib.GModelSpectralPlaw(flux*5.7e-16, index, gammalib.GEnergy(0.3, "TeV")) - if fitidx: - spectrum["Index"].free() + # Fit or fix spatial parameters + if fitpos: + if model.has_par("RA"): + model["RA"].free() + if model.has_par("DEC"): + model["DEC"].free() + if model.has_par("Sigma"): + model["Sigma"].free() + if model.has_par("Radius"): + model["Radius"].free() + if model.has_par("Width"): + model["Width"].free() else: - spectrum["Index"].fix() - - # Set source - if type == "point": - spatial = gammalib.GModelSpatialPointSource(location) - if fitpos: - spatial[0].free() - spatial[1].free() - elif type == "gauss": - spatial = gammalib.GModelSpatialRadialGauss(location, sigma) - if fitpos: - spatial[0].free() - spatial[1].free() - elif type == "disk": - spatial = gammalib.GModelSpatialRadialDisk(location, radius) - if fitpos: - spatial[0].free() - spatial[1].free() - elif type == "shell": - spatial = gammalib.GModelSpatialRadialShell(location, radius, width) - if fitpos: - spatial[0].free() - spatial[1].free() + if model.has_par("RA"): + model["RA"].fix() + if model.has_par("DEC"): + model["DEC"].fix() + if model.has_par("Sigma"): + model["Sigma"].fix() + if model.has_par("Radius"): + model["Radius"].fix() + if model.has_par("Width"): + model["Width"].fix() + + # Fit or fix spectral parameters + if fitspec: + if model.has_par("Index"): + model["Index"].free() + if model.has_par("Cutoff"): + model["Cutoff"].free() else: - self.log("ERROR: Unknown source type '"+type+"'.\n") - return None - source = gammalib.GModelSky(spatial, spectrum) + if model.has_par("Index"): + model["Index"].fix() + if model.has_par("Cutoff"): + model["Cutoff"].fix() - # Set source name - source.name("Test") + # Create background model + bkg_model = full_model.copy() + bkg_model.remove(self.m_srcname) + + # Return models + return full_model, bkg_model + + def set_obs(self): + """ + Returns an observation container with a set of CTA observations. - # Turn TS value computation off - # since we compute it by hand later on - source.tscalc(False) - - # Return source - return source + Keywords: + """ + + # Setup observation definition list + obsdeflist = obsutils.set_obs_patterns(self.m_pattern, \ + ra=self["ra"].real(), dec=self["dec"].real(), \ + offset=self["offset"].real()) + + # Create list of observations + obs = obsutils.set_obs_list(obsdeflist, \ + tstart=self["tmin"].real(), duration=self["tmax"].real()-self["tmin"].real(), \ + deadc=self["deadc"].real(), \ + emin=self["emin"].real(), emax=self["emax"].real(), \ + rad=self["rad"].real(), \ + irf=self["irf"].string(), caldb=self["caldb"].string()) - def trial(self, seed): + # Return observation container + return obs + + def trial(self, seed, full_model, bkg_model): """ Create the TS for a single trial. @@ -373,9 +375,9 @@ class cstsdist(ctools.cscript): self.log("\n") # Fit background only - sim.models(self.bkg_model) + sim.models(bkg_model) like_bgm = obsutils.fit(sim, log=self.m_log, debug=self.m_debug) - result_bgm = like_bgm.obs().models() + result_bgm = like_bgm.obs().models().copy() LogL_bgm = like_bgm.opt().value() npred_bgm = like_bgm.obs().npred() @@ -396,9 +398,9 @@ class cstsdist(ctools.cscript): self.log(str(par)+"\n") # Fit background and test source - sim.models(self.full_model) + sim.models(full_model) like_all = obsutils.fit(sim, log=self.m_log, debug=self.m_debug) - result_all = like_all.obs().models() + result_all = like_all.obs().models().copy() LogL_all = like_all.opt().value() npred_all = like_all.obs().npred() ts = 2.0*(LogL_bgm-LogL_all) @@ -428,9 +430,9 @@ class cstsdist(ctools.cscript): self.log("TS=") self.log(ts) self.log(" Prefactor=") - self.log(result_all["Test"]["Prefactor"].value()) + self.log(result_all[self.m_srcname]["Prefactor"].value()) self.log("+/-") - self.log(result_all["Test"]["Prefactor"].error()) + self.log(result_all[self.m_srcname]["Prefactor"].error()) self.log("\n") # Initialise results diff --git a/scripts/obsutils.py b/scripts/obsutils.py deleted file mode 100644 index a0df8d0..0000000 --- a/scripts/obsutils.py +++ /dev/null @@ -1,5 +0,0 @@ -print("The obsutils are moved under the ctools module.") -print("Please update your script to import from ctools, i.e:") -print("from ctools import obsutils") - -from ctools.obsutils import * diff --git a/src/ctbin/ctbin.cpp b/src/ctbin/ctbin.cpp index 74b285f..7070f2f 100644 --- a/src/ctbin/ctbin.cpp +++ b/src/ctbin/ctbin.cpp @@ -455,6 +455,15 @@ void ctbin::fill_cube(GCTAObservation* obs) // Get the RoI const GCTARoi& roi = events->roi(); + // Check for RoI sanity + if (!roi.is_valid()) { + std::string msg = "No RoI information found in input observation " + "\""+obs->name()+"\". Run ctselect to specify " + "an RoI for this observation before running " + "ctbin."; + throw GException::invalid_value(G_FILL_CUBE, msg); + } + // Initialise binning statistics int num_outside_roi = 0; int num_outside_map = 0; diff --git a/src/ctbkgcube/ctbkgcube.hpp b/src/ctbkgcube/ctbkgcube.hpp index 9d64ef1..86a5093 100644 --- a/src/ctbkgcube/ctbkgcube.hpp +++ b/src/ctbkgcube/ctbkgcube.hpp @@ -59,7 +59,7 @@ public: void clear(void); void run(void); void save(void); - const GCTACubeBackground& cube(void) const; + const GCTACubeBackground& bkgcube(void) const; const GModels& models(void) const; protected: @@ -86,7 +86,7 @@ protected: * @return Background response cube. ***************************************************************************/ inline -const GCTACubeBackground& ctbkgcube::cube(void) const +const GCTACubeBackground& ctbkgcube::bkgcube(void) const { // Return background cube return (m_background); diff --git a/src/ctbkgcube/ctbkgcube.par b/src/ctbkgcube/ctbkgcube.par index 400642d..f2a5ee1 100644 --- a/src/ctbkgcube/ctbkgcube.par +++ b/src/ctbkgcube/ctbkgcube.par @@ -22,8 +22,8 @@ inmodel, f, a, "NONE",,, "Input model XML file" incube, f, a, "NONE",,, "Counts cube for background cube definition" outcube, f, a, "bkgcube.fits",,, "Output background cube file" outmodel, f, a, "NONE",,, "Output model XML file" -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" # # Energy binning parameters #========================== diff --git a/src/ctbutterfly/ctbutterfly.par b/src/ctbutterfly/ctbutterfly.par index 2d5e224..7432812 100644 --- a/src/ctbutterfly/ctbutterfly.par +++ b/src/ctbutterfly/ctbutterfly.par @@ -23,8 +23,8 @@ srcname, s, a, "Crab",,,"Source of interest" expcube, f, a, "NONE",,, "Exposure cube file (only needed for stacked analysis)" psfcube, f, a, "NONE",,, "PSF cube file (only needed for stacked analysis)" bkgcube, f, a, "NONE",,, "Background cube file (only needed for stacked analysis)" -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" outfile, f, a, "butterfly.txt",,, "Output ascii file" matrix, f, h, "NONE",,, "Input covariance Matrix FITS file" diff --git a/src/ctexpcube/ctexpcube.par b/src/ctexpcube/ctexpcube.par index d4381ef..bce8ab6 100644 --- a/src/ctexpcube/ctexpcube.par +++ b/src/ctexpcube/ctexpcube.par @@ -20,8 +20,8 @@ inobs, f, a, "NONE",,, "Event list or observation definition file" incube, f, a, "NONE",,, "Counts cube for exposure cube definition" outcube, f, a, "expcube.fits",,, "Output exposure cube file" -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" edisp, b, h, no,,, "Apply energy dispersion?" # # Energy binning parameters diff --git a/src/ctlike/ctlike.cpp b/src/ctlike/ctlike.cpp index 5766de3..5d397eb 100644 --- a/src/ctlike/ctlike.cpp +++ b/src/ctlike/ctlike.cpp @@ -401,6 +401,14 @@ void ctlike::get_parameters(void) m_outmodel = (*this)["outmodel"].filename(); } + // Set optimizer logger + if (logTerse()) { + static_cast(m_opt)->logger(&log); + } + else { + static_cast(m_opt)->logger(NULL); + } + // Return return; } @@ -411,22 +419,6 @@ void ctlike::get_parameters(void) ***************************************************************************/ void ctlike::optimize_lm(void) { - // Free any existing optimizer - if (m_opt != NULL) delete m_opt; - m_opt = NULL; - - // Allocate optimizer. The logger is only passed to the optimizer - // constructor if optimizer logging is requested. - GOptimizerLM* opt = (logTerse()) ? new GOptimizerLM(log) - : new GOptimizerLM(); - - // Assign optimizer - m_opt = opt; - - // Set optimizer parameters - opt->max_iter(m_max_iter); - opt->max_stalls(m_max_stall); - // Write Header for optimization and indent for optimizer logging if (logTerse()) { log << std::endl; @@ -435,7 +427,7 @@ void ctlike::optimize_lm(void) } // Perform LM optimization - m_obs.optimize(*opt); + m_obs.optimize(*m_opt); // Optionally refit if (m_refit) { @@ -449,15 +441,15 @@ void ctlike::optimize_lm(void) } // Optimise again - m_obs.optimize(*opt); + m_obs.optimize(*m_opt); } // Compute errors - m_obs.errors(*opt); + m_obs.errors(*m_opt); // Store maximum log likelihood value - m_logL = -(opt->value()); + m_logL = -(m_opt->value()); // Remove indent log.indent(0); @@ -473,15 +465,6 @@ void ctlike::optimize_lm(void) ***************************************************************************/ double ctlike::reoptimize_lm(void) { - // Allocate optimizer. The logger is only passed to the optimizer - // constructor if optimizer logging is requested. - GOptimizerLM* opt = (logTerse()) ? new GOptimizerLM(log) - : new GOptimizerLM(); - - // Set optimizer parameters - opt->max_iter(m_max_iter); - opt->max_stalls(m_max_stall); - // Write Header for optimization and indent for optimizer logging if (logTerse()) { log << std::endl; @@ -490,22 +473,22 @@ double ctlike::reoptimize_lm(void) } // Perform LM optimization - m_obs.optimize(*opt); + m_obs.optimize(*m_opt); // Optionally refit if (m_refit) { - m_obs.optimize(*opt); + m_obs.optimize(*m_opt); } // Store maximum log likelihood value - double logL = -(opt->value()); + double logL = -(m_opt->value()); // Write optimization results log.indent(0); if (logTerse()) { log << std::endl; log.header1("Maximum likelihood re-optimization results"); - log << *opt << std::endl; + log << *m_opt << std::endl; } // Return @@ -537,6 +520,16 @@ void ctlike::init_members(void) // Set logger properties log.date(true); + // Allocate LM optimizer + GOptimizerLM* opt = new GOptimizerLM(); + + // Set optimizer parameters + opt->max_iter(m_max_iter); + opt->max_stalls(m_max_stall); + + // Set optimizer pointer + m_opt = opt; + // Return return; } @@ -551,7 +544,7 @@ void ctlike::copy_members(const ctlike& app) { // Copy attributes m_refit = app.m_refit; - m_outmodel = app.m_outmodel; + m_outmodel = app.m_outmodel; m_obs = app.m_obs; m_max_iter = app.m_max_iter; m_max_stall = app.m_max_stall; diff --git a/src/ctlike/ctlike.par b/src/ctlike/ctlike.par index 9cf0136..5ae14f0 100644 --- a/src/ctlike/ctlike.par +++ b/src/ctlike/ctlike.par @@ -22,8 +22,8 @@ inmodel, f, a, "$CTOOLS/share/models/crab.xml",,, "Source model" expcube, f, a, "NONE",,, "Exposure cube file (only needed for stacked analysis)" psfcube, f, a, "NONE",,, "PSF cube file (only needed for stacked analysis)" bkgcube, f, a, "NONE",,, "Background cube file (only needed for stacked analysis)" -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" outmodel, f, a, "crab_results.xml",,, "Source model output file" stat, s, h, "POISSON",,, "Optimization statistics" edisp, b, h, no,,, "Apply energy dispersion?" diff --git a/src/ctmodel/ctmodel.par b/src/ctmodel/ctmodel.par index 9506397..f0f6265 100644 --- a/src/ctmodel/ctmodel.par +++ b/src/ctmodel/ctmodel.par @@ -28,8 +28,8 @@ inobs, f, a, "NONE",,, "Event list, counts cube or observation definition fil expcube, f, a, "NONE",,, "Exposure cube file (only needed for stacked analysis)" psfcube, f, a, "NONE",,, "PSF cube file (only needed for stacked analysis)" bkgcube, f, a, "NONE",,, "Background cube file (only needed for stacked analysis)" -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" ra, r, a, 83.63,0,360, "RA of pointing (degrees)" dec, r, a, 22.01,-90,90, "Dec of pointing (degrees)" rad, r, a, 5.0,0,180, "Radius of FOV (degrees)" diff --git a/src/ctobssim/ctobssim.cpp b/src/ctobssim/ctobssim.cpp index 0f2949c..dacb4bf 100644 --- a/src/ctobssim/ctobssim.cpp +++ b/src/ctobssim/ctobssim.cpp @@ -730,8 +730,8 @@ void ctobssim::simulate_source(GCTAObservation* obs, const GModels& models, GEnergy e_true_min = emin; GEnergy e_true_max = emax; if (rsp->use_edisp()) { - e_true_min = rsp->ebounds_src(e_true_min).emin(); - e_true_max = rsp->ebounds_src(e_true_max).emax(); + e_true_min = rsp->ebounds(e_true_min).emin(); + e_true_max = rsp->ebounds(e_true_max).emax(); } // Dump energy range @@ -762,7 +762,6 @@ void ctobssim::simulate_source(GCTAObservation* obs, const GModels& models, // number of simulated photons to m_max_photons. // The photon rate is estimated from the model flux // and used to set the duration of the time slice. - //double flux = model->spectral()->flux(emin, emax); double flux = get_model_flux(model, emin, emax, dir, rad); double rate = flux * m_area; @@ -966,7 +965,7 @@ void ctobssim::simulate_source(GCTAObservation* obs, const GModels& models, * * @param[in] model Sky model. * @param[in] emin Minimum energy. - * @param[in] emin Maximum energy. + * @param[in] emax Maximum energy. * @param[in] centre Centre of region for photon rate determination. * @param[in] radius Radius of region for photon rate determination. * @return Model flux (photons/cm2/sec). diff --git a/src/ctobssim/ctobssim.par b/src/ctobssim/ctobssim.par index 548e595..71359c0 100644 --- a/src/ctobssim/ctobssim.par +++ b/src/ctobssim/ctobssim.par @@ -24,8 +24,8 @@ prefix, s, h, "sim_events_",,, "Prefix for event lists in observation definit # # Observation parameters #======================= -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" # # Simulation parameters #====================== diff --git a/src/ctpsfcube/ctpsfcube.par b/src/ctpsfcube/ctpsfcube.par index 8f1d9a2..8002221 100644 --- a/src/ctpsfcube/ctpsfcube.par +++ b/src/ctpsfcube/ctpsfcube.par @@ -20,8 +20,8 @@ inobs, f, a, "NONE",,, "Event list or observation definition file" incube, f, a, "NONE",,, "Counts cube for psf cube definition" outcube, f, a, "psfcube.fits",,, "Output psf cube file" -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" edisp, b, h, no,,, "Apply energy dispersion?" # # Energy binning parameters diff --git a/src/ctselect/ctselect.cpp b/src/ctselect/ctselect.cpp index 735195d..200cc20 100644 --- a/src/ctselect/ctselect.cpp +++ b/src/ctselect/ctselect.cpp @@ -268,6 +268,16 @@ void ctselect::run(void) // Save event file name (for possible saving) m_infiles[i] = obs->eventfile(); + // Fall through in case that the event file is empty + if (obs->events()->size() == 0) { + if (logTerse()) { + log << " Warning: No events in event file \""; + log << m_infiles[i] << "\". Event selection skipped."; + log << std::endl; + } + continue; + } + // Get temporary file name #if G_USE_MKSTEMP char tpl[] = "ctselectXXXXXX"; @@ -837,7 +847,7 @@ void ctselect::select_events(GCTAObservation* obs, const std::string& filename) int nevents = file.table("EVENTS")->nrows(); // If the selected event list is empty or if removal of all events - // has been requesten then append an empty event list to the observation. + // has been requested then append an empty event list to the observation. if ((nevents < 1) || (remove_all)) { // Create empty event list @@ -1006,7 +1016,9 @@ GEbounds ctselect::set_ebounds(GCTAObservation* obs, const GEbounds& ebounds) co // Set selection energy boundaries GEbounds result; - result.append(GEnergy(emin, "TeV"), GEnergy(emax, "TeV")); + if (emax > emin) { + result.append(GEnergy(emin, "TeV"), GEnergy(emax, "TeV")); + } // Return result return result; diff --git a/src/cttsmap/cttsmap.cpp b/src/cttsmap/cttsmap.cpp index 4a17dc4..b30475e 100644 --- a/src/cttsmap/cttsmap.cpp +++ b/src/cttsmap/cttsmap.cpp @@ -242,7 +242,7 @@ void cttsmap::run(void) int binmax = (m_binmax == -1) ? m_tsmap.npix() : m_binmax; // Initialise optimizer - GOptimizerLM* opt = (logExplicit()) ? new GOptimizerLM(log) + GOptimizerLM* opt = (logExplicit()) ? new GOptimizerLM(&log) : new GOptimizerLM(); // Store initial models diff --git a/src/cttsmap/cttsmap.par b/src/cttsmap/cttsmap.par index ffe2699..9343ea4 100644 --- a/src/cttsmap/cttsmap.par +++ b/src/cttsmap/cttsmap.par @@ -23,8 +23,8 @@ srcname, s, a, "Crab",,, "Test source" expcube, f, a, "NONE",,, "Exposure cube file (only needed for stacked analysis)" psfcube, f, a, "NONE",,, "PSF cube file (only needed for stacked analysis)" bkgcube, f, a, "NONE",,, "Background cube file (only needed for stacked analysis)" -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" outmap, f, a, "tsmap.fits",,, "Output Test Statistic map" # diff --git a/src/ctulimit/ctulimit.par b/src/ctulimit/ctulimit.par index a577450..e135d2c 100644 --- a/src/ctulimit/ctulimit.par +++ b/src/ctulimit/ctulimit.par @@ -23,8 +23,8 @@ srcname, s, a, "Crab",,, "Source of interest" expcube, f, a, "NONE",,, "Exposure cube file (only needed for stacked analysis)" psfcube, f, a, "NONE",,, "PSF cube file (only needed for stacked analysis)" bkgcube, f, a, "NONE",,, "Background cube file (only needed for stacked analysis)" -caldb, s, a, "dummy",,, "Calibration database" -irf, s, a, "cta_dummy_irf",,, "Instrument response function" +caldb, s, a, "prod2",,, "Calibration database" +irf, s, a, "South_50h",,, "Instrument response function" # # Upper limit calculation parameters diff --git a/test/test_cscripts.sh.in b/test/test_cscripts.sh.in index eb326b1..5194b18 100755 --- a/test/test_cscripts.sh.in +++ b/test/test_cscripts.sh.in @@ -136,13 +136,14 @@ $ECHO " ok" $ECHO -n "Test cstsdist: " chmod +x @abs_top_srcdir@/scripts/cstsdist.py @abs_top_srcdir@/scripts/cstsdist.py \ + inmodel="data/crab.xml" \ + srcname="Crab" \ outfile="ts.dat" \ ntrials="1" \ caldb="irf" \ irf="cta_dummy_irf" \ - type="point" \ - offset="0.0" \ - bkg="data/bkg_dummy.txt" \ + ra=83.63 \ + dec=22.01 \ emin=0.1 \ emax=100.0 \ enumbins=0 \ @@ -160,6 +161,7 @@ else fi $ECHO " ok" + # # Test csresmap # ============= @@ -189,10 +191,11 @@ else fi $ECHO " ok" + # -# Test csspec -# ============= -$ECHO -n "Test csspec: " +# Test csspec (unbinned) +# ===================== +$ECHO -n "Test csspec (unbinned): " chmod +x @abs_top_srcdir@/scripts/csspec.py @abs_top_srcdir@/scripts/csspec.py \ inobs="data/crab_events.fits" \ @@ -203,6 +206,7 @@ chmod +x @abs_top_srcdir@/scripts/csspec.py srcname="Crab" \ emin=0.1 \ emax=100.0 \ + binned=no \ outfile="spectrum.fits" > csspec.log $ECHO -n "." if [ -s "spectrum.fits" ] @@ -215,3 +219,100 @@ fi $ECHO " ok" +# +# Test csspec (binned) +# ==================== +$ECHO -n "Test csspec (binned): " +chmod +x @abs_top_srcdir@/scripts/csspec.py +@abs_top_srcdir@/scripts/csspec.py \ + inobs="data/crab_events.fits" \ + inmodel="data/crab.xml" \ + caldb="irf" \ + irf="cta_dummy_irf" \ + enumbins=3 \ + srcname="Crab" \ + emin=0.1 \ + emax=100.0 \ + binned=yes \ + nxpix=10 \ + nypix=10 \ + binsz=0.1 \ + nebins=2 \ + coordsys="CEL" \ + xref=83.63 \ + yref=22.01 \ + proj="CAR" \ + outfile="spectrum.fits" > csspec.log +$ECHO -n "." +if [ -s "spectrum.fits" ] +then + $ECHO -n "." +else + $ECHO " spectrum.fits file is not valid" + exit 1 +fi +$ECHO " ok" + + +# +# Test cslightcrv (unbinned) +# ========================== +$ECHO -n "Test cslightcrv (unbinned): " +chmod +x @abs_top_srcdir@/scripts/cslightcrv.py +@abs_top_srcdir@/scripts/cslightcrv.py \ + inobs="data/crab_events.fits" \ + inmodel="data/crab.xml" \ + srcname="Crab" \ + caldb="irf" \ + irf="cta_dummy_irf" \ + tbinalg="LIN" \ + tmin=51544.5 \ + tmax=51544.53 \ + tbins=3 \ + enumbins=0 \ + emin=0.1 \ + emax=100.0 \ + outfile="lightcurve.fits" > cslightcrv.log +$ECHO -n "." +if [ -s "lightcurve.fits" ] +then + $ECHO -n "." +else + $ECHO " lightcurve.fits file is not valid" + exit 1 +fi +$ECHO " ok" + + +# +# Test cslightcrv (binned) +# ======================== +$ECHO -n "Test cslightcrv (binned): " +chmod +x @abs_top_srcdir@/scripts/cslightcrv.py +@abs_top_srcdir@/scripts/cslightcrv.py \ + inobs="data/crab_events.fits" \ + inmodel="data/crab.xml" \ + srcname="Crab" \ + caldb="irf" \ + irf="cta_dummy_irf" \ + tbinalg="GTI" \ + enumbins=2 \ + emin=0.1 \ + emax=100.0 \ + coordsys="CEL" \ + proj="CAR" \ + xref=83.63 \ + yref=22.01 \ + nxpix=10 \ + nypix=10 \ + binsz=0.1 \ + outfile="lightcurve.fits" > cslightcrv.log +$ECHO -n "." +if [ -s "lightcurve.fits" ] +then + $ECHO -n "." +else + $ECHO " lightcurve.fits file is not valid" + exit 1 +fi +$ECHO " ok" diff --git a/testall.sh b/testall.sh index c97710f..91f1682 100755 --- a/testall.sh +++ b/testall.sh @@ -33,7 +33,6 @@ cd examples # Create local environment rm -rf ctools -#mkdir -p ctools/share mkdir -p ctools/share/caldb ln -s $base/caldb ctools/share/caldb/cta ln -s $base/models ctools/share/models @@ -52,11 +51,11 @@ export CTOOLS=$PWD/ctools # Run makers ./make_survey.py -./make_ts_distributions.py 2 2 +./make_ts_distributions.py -n 2 -e 0 -d 1800 #./make_pull_at_sensitivity_limit.py # Remove local environment -rm -rf gammalib +rm -rf ctools # Step back to base directory cd $base