Veronika Vodeb / ctools

Commit a7ee33f5e61bcfebabe2b4c7efdf62cff3ba9bd7

Authored by Jürgen Knödlseder
1 parent ab827750

Update 1DC first steps for data release

Inline Side-by-side
Showing 10 changed files with 65 additions and 68 deletions
doc/source/users/tutorials/1dc/first_fitting.rst
  View file @a7ee33f
... ... @@ -48,34 +48,33 @@ converged properly, as illustrated in the example below:
48 48  
49 49 .. code-block:: bash
50 50  
51   - 2017-07-27T14:05:58: +=================================+
52   - 2017-07-27T14:05:58: | Maximum likelihood optimisation |
53   - 2017-07-27T14:05:58: +=================================+
54   - 2017-07-27T14:06:07: >Iteration 0: -logL=291743.621, Lambda=1.0e-03
55   - 2017-07-27T14:06:17: >Iteration 1: -logL=266150.955, Lambda=1.0e-03, delta=25592.666, step=1.0e+00, max(|grad|)=65223.588855 [Index:13]
56   - 2017-07-27T14:06:26: >Iteration 2: -logL=260665.430, Lambda=1.0e-04, delta=5485.525, step=1.0e+00, max(|grad|)=10907.804073 [Index:3]
57   - 2017-07-27T14:06:36: >Iteration 3: -logL=258904.835, Lambda=1.0e-05, delta=1760.595, step=1.0e+00, max(|grad|)=6694.957421 [Index:3]
58   - 2017-07-27T14:06:45: >Iteration 4: -logL=258545.054, Lambda=1.0e-06, delta=359.781, step=1.0e+00, max(|grad|)=2242.517259 [RA:0]
59   - 2017-07-27T14:06:55: >Iteration 5: -logL=258531.804, Lambda=1.0e-07, delta=13.250, step=1.0e+00, max(|grad|)=631.774929 [RA:0]
60   - 2017-07-27T14:07:05: >Iteration 6: -logL=258531.685, Lambda=1.0e-08, delta=0.120, step=1.0e+00, max(|grad|)=139.793278 [RA:0]
61   - 2017-07-27T14:07:14: >Iteration 7: -logL=258531.673, Lambda=1.0e-09, delta=0.012, step=1.0e+00, max(|grad|)=62.479910 [DEC:1]
62   - 2017-07-27T14:07:24: >Iteration 8: -logL=258531.670, Lambda=1.0e-10, delta=0.002, step=1.0e+00, max(|grad|)=29.031154 [DEC:1]
63   - 2017-07-27T14:07:33:
64   - 2017-07-27T14:07:33: +=========================================+
65   - 2017-07-27T14:07:33: | Maximum likelihood optimisation results |
66   - 2017-07-27T14:07:33: +=========================================+
67   - 2017-07-27T14:07:33: === GOptimizerLM ===
68   - 2017-07-27T14:07:33: Optimized function value ..: 258531.670
69   - 2017-07-27T14:07:33: Absolute precision ........: 0.005
70   - 2017-07-27T14:07:33: Acceptable value decrease .: 2
71   - 2017-07-27T14:07:33: Optimization status .......: converged
72   - 2017-07-27T14:07:33: Number of parameters ......: 16
73   - 2017-07-27T14:07:33: Number of free parameters .: 10
74   - 2017-07-27T14:07:33: Number of iterations ......: 8
75   - 2017-07-27T14:07:33: Lambda ....................: 1e-11
76   - 2017-07-27T14:07:33: Maximum log likelihood ....: -258531.670
77   - 2017-07-27T14:07:33: Observed events (Nobs) ...: 2069142.000
78   - 2017-07-27T14:07:33: Predicted events (Npred) ..: 2069141.997 (Nobs - Npred = 0.00287596974521875)
  51 + 2017-08-25T17:08:21: +=================================+
  52 + 2017-08-25T17:08:21: | Maximum likelihood optimisation |
  53 + 2017-08-25T17:08:21: +=================================+
  54 + 2017-08-25T17:08:29: >Iteration 0: -logL=291914.550, Lambda=1.0e-03
  55 + 2017-08-25T17:08:38: >Iteration 1: -logL=266273.754, Lambda=1.0e-03, delta=25640.797, step=1.0e+00, max(|grad|)=65025.077045 [Index:13]
  56 + 2017-08-25T17:08:47: >Iteration 2: -logL=260715.584, Lambda=1.0e-04, delta=5558.169, step=1.0e+00, max(|grad|)=11091.356780 [Index:3]
  57 + 2017-08-25T17:08:56: >Iteration 3: -logL=258904.982, Lambda=1.0e-05, delta=1810.602, step=1.0e+00, max(|grad|)=6846.470902 [Index:3]
  58 + 2017-08-25T17:09:05: >Iteration 4: -logL=258532.557, Lambda=1.0e-06, delta=372.425, step=1.0e+00, max(|grad|)=1815.217272 [RA:0]
  59 + 2017-08-25T17:09:14: >Iteration 5: -logL=258519.171, Lambda=1.0e-07, delta=13.386, step=1.0e+00, max(|grad|)=457.965339 [RA:0]
  60 + 2017-08-25T17:09:22: >Iteration 6: -logL=258519.093, Lambda=1.0e-08, delta=0.078, step=1.0e+00, max(|grad|)=106.109881 [RA:0]
  61 + 2017-08-25T17:09:31: >Iteration 7: -logL=258519.089, Lambda=1.0e-09, delta=0.004, step=1.0e+00, max(|grad|)=23.002701 [DEC:1]
  62 + 2017-08-25T17:09:40:
  63 + 2017-08-25T17:09:40: +=========================================+
  64 + 2017-08-25T17:09:40: | Maximum likelihood optimisation results |
  65 + 2017-08-25T17:09:40: +=========================================+
  66 + 2017-08-25T17:09:40: === GOptimizerLM ===
  67 + 2017-08-25T17:09:40: Optimized function value ..: 258519.089
  68 + 2017-08-25T17:09:40: Absolute precision ........: 0.005
  69 + 2017-08-25T17:09:40: Acceptable value decrease .: 2
  70 + 2017-08-25T17:09:40: Optimization status .......: converged
  71 + 2017-08-25T17:09:40: Number of parameters ......: 16
  72 + 2017-08-25T17:09:40: Number of free parameters .: 10
  73 + 2017-08-25T17:09:40: Number of iterations ......: 7
  74 + 2017-08-25T17:09:40: Lambda ....................: 1e-10
  75 + 2017-08-25T17:09:40: Maximum log likelihood ....: -258519.089
  76 + 2017-08-25T17:09:40: Observed events (Nobs) ...: 2069014.000
  77 + 2017-08-25T17:09:40: Predicted events (Npred) ..: 2069013.992 (Nobs - Npred = 0.00783161679282784)
79 78  
80 79 You may also convert the fitted model positions into a `ds9 <http://ds9.si.edu>`_
81 80 region file using the :ref:`csmodelinfo` script so that you can overlay the
... ...
doc/source/users/tutorials/1dc/first_improving.rst
  View file @a7ee33f
... ... @@ -23,13 +23,13 @@ You do this with the :ref:`csresmap` script by providing the output
23 23 Input PSF cube file (only needed for stacked analysis) [NONE] psfcube.fits
24 24 Input background cube file (only needed for stacked analysis) [NONE] bkgcube.fits
25 25 Input model definition XML file [$CTOOLS/share/models/crab.xml] stacked_results_cutoff.xml
26   - Residual map computation algorithm (SUB|SUBDIV|SUBDIVSQRT|SIGNIFICANCE) [SUBDIV] SUB
  26 + Residual map computation algorithm (SUB|SUBDIV|SUBDIVSQRT|SIGNIFICANCE) [SUBDIV] SIGNIFICANCE
27 27 Output residual map file [resmap.fits]
28 28  
29 29 This produces the file ``resmap.fits`` that contains a residual map that
30 30 you can display for example with `ds9 <http://ds9.si.edu>`_.
31 31 The figure below shows the map, with the fitted source positions overlayed
32   -as white circles.
  32 +as green circles.
33 33  
34 34 .. figure:: first_skymap_residual.png
35 35 :width: 400px
... ... @@ -90,11 +90,9 @@ as illustrated below:
90 90  
91 91 Repeating the fit with this model and producing a corresponding residual map
92 92 produces the map shown below. Now, the residuals near the two point sources
93   -are flatter and the diffuse emission has largely disappeared. The diffuse
94   -emission is in fact a bit oversubtracted, which is probably due to the
95   -additional source components visible in the residual map. It is left as an
96   -exercise to the User to include model components for these additional
97   -sources in the
  93 +are flat and the diffuse emission has disappeared. Some additional sources now
  94 +become clearly visible. It is left as an exercise to the User to include model
  95 +components for these additional sources in the
98 96 :ref:`model definition file <glossary_moddef>`
99 97 in order to reduce the fit residuals.
100 98 An example for such an exercise is shown
... ...
doc/source/users/tutorials/1dc/first_select_events.rst
  View file @a7ee33f
... ... @@ -53,7 +53,7 @@ displays a summary of the content of this new
53 53 2017-07-27T10:02:26: Unbinned observations .....: 57
54 54 2017-07-27T10:02:26: Binned observations .......: 0
55 55 2017-07-27T10:02:26: === Events ===
56   - 2017-07-27T10:02:26: Number of events ..........: 3084639
  56 + 2017-07-27T10:02:26: Number of events ..........: 3084595
57 57 2017-07-27T10:02:26: Number of bins ............: 0
58 58 2017-07-27T10:02:26: === Pointings ===
59 59 2017-07-27T10:02:26: Mean offset angle .........: Unknown
... ... @@ -72,7 +72,7 @@ displays a summary of the content of this new
72 72 There are still 57 observations in the
73 73 :ref:`observation definition file <glossary_obsdef>`
74 74 but now the events are restricted to the energy interval 100 GeV - 100 TeV. In
75   -total there are 3 084 639 events within this interval in the selected observations.
  75 +total there are 3 084 595 events within this interval in the selected observations.
76 76  
77 77 The content of ``obs_selected.xml`` will look similar to the content of
78 78 ``obs.xml`` with the original event list file names replaced by the names of
... ...
doc/source/users/tutorials/1dc/first_select_obs.rst
  View file @a7ee33f
... ... @@ -67,7 +67,7 @@ observations into the console:
67 67  
68 68 The output of :ref:`csobsinfo` is shown below. :ref:`csobsselect` selected
69 69 57 observations from the Galactic Plane Survey data containing a total of
70   -6 046 100 events.
  70 +6 045 130 events.
71 71  
72 72 .. code-block:: bash
73 73  
... ... @@ -78,7 +78,7 @@ The output of :ref:`csobsinfo` is shown below. :ref:`csobsselect` selected
78 78 2017-07-27T09:58:12: Unbinned observations .....: 57
79 79 2017-07-27T09:58:12: Binned observations .......: 0
80 80 2017-07-27T09:58:12: === Events ===
81   - 2017-07-27T09:58:12: Number of events ..........: 6046100
  81 + 2017-07-27T09:58:12: Number of events ..........: 6045130
82 82 2017-07-27T09:58:12: Number of bins ............: 0
83 83 2017-07-27T09:58:12: === Pointings ===
84 84 2017-07-27T09:58:12: Mean offset angle .........: Unknown
... ...
doc/source/users/tutorials/1dc/first_skymap_residual.png
View file @a7ee33f

213 KB | W: | H:

291 KB | W: | H:

  • 2-up
  • Swipe
  • Onion skin
doc/source/users/tutorials/1dc/first_skymap_residual_iem.png
View file @a7ee33f

307 KB | W: | H:

286 KB | W: | H:

  • 2-up
  • Swipe
  • Onion skin
doc/source/users/tutorials/1dc/first_spectrum_cutoff_stacked.png
View file @a7ee33f

54.8 KB | W: | H:

53.7 KB | W: | H:

  • 2-up
  • Swipe
  • Onion skin
doc/source/users/tutorials/1dc/first_spectrum_cutoff_unbinned.png
View file @a7ee33f

55.2 KB | W: | H:

53.6 KB | W: | H:

  • 2-up
  • Swipe
  • Onion skin
doc/source/users/tutorials/1dc/first_spectrum_stacked.png
View file @a7ee33f

47.2 KB | W: | H:

50.6 KB | W: | H:

  • 2-up
  • Swipe
  • Onion skin
doc/source/users/tutorials/1dc/first_unbinned.rst
  View file @a7ee33f
... ... @@ -47,35 +47,35 @@ converged properly, as illustrated in the example below:
47 47  
48 48 .. code-block:: bash
49 49  
50   - 2017-07-27T16:28:26: +=================================+
51   - 2017-07-27T16:28:26: | Maximum likelihood optimisation |
52   - 2017-07-27T16:28:26: +=================================+
53   - 2017-07-27T16:28:54: >Iteration 0: -logL=20949416.217, Lambda=1.0e-03
54   - 2017-07-27T16:29:21: >Iteration 1: -logL=20918674.227, Lambda=1.0e-03, delta=30741.990, step=1.0e+00, max(|grad|)=74249.049334 [Index:14]
55   - 2017-07-27T16:29:49: >Iteration 2: -logL=20913114.563, Lambda=1.0e-04, delta=5559.664, step=1.0e+00, max(|grad|)=6728.499004 [RA:0]
56   - 2017-07-27T16:30:16: >Iteration 3: -logL=20910994.152, Lambda=1.0e-05, delta=2120.411, step=1.0e+00, max(|grad|)=4949.846735 [RA:0]
57   - 2017-07-27T16:30:44: >Iteration 4: -logL=20910115.048, Lambda=1.0e-06, delta=879.104, step=1.0e+00, max(|grad|)=2889.871293 [RA:0]
58   - 2017-07-27T16:31:12: >Iteration 5: -logL=20909966.036, Lambda=1.0e-07, delta=149.012, step=1.0e+00, max(|grad|)=1190.543059 [RA:0]
59   - 2017-07-27T16:31:39: >Iteration 6: -logL=20909948.012, Lambda=1.0e-08, delta=18.024, step=1.0e+00, max(|grad|)=550.745751 [DEC:1]
60   - 2017-07-27T16:32:06: >Iteration 7: -logL=20909946.600, Lambda=1.0e-09, delta=1.412, step=1.0e+00, max(|grad|)=208.667347 [DEC:1]
61   - 2017-07-27T16:32:33: >Iteration 8: -logL=20909946.575, Lambda=1.0e-10, delta=0.025, step=1.0e+00, max(|grad|)=51.069713 [DEC:1]
62   - 2017-07-27T16:33:00: >Iteration 9: -logL=20909946.573, Lambda=1.0e-11, delta=0.002, step=1.0e+00, max(|grad|)=16.914402 [DEC:1]
63   - 2017-07-27T16:33:26:
64   - 2017-07-27T16:33:26: +=========================================+
65   - 2017-07-27T16:33:26: | Maximum likelihood optimisation results |
66   - 2017-07-27T16:33:26: +=========================================+
67   - 2017-07-27T16:33:26: === GOptimizerLM ===
68   - 2017-07-27T16:33:26: Optimized function value ..: 20909946.573
69   - 2017-07-27T16:33:26: Absolute precision ........: 0.005
70   - 2017-07-27T16:33:26: Acceptable value decrease .: 2
71   - 2017-07-27T16:33:26: Optimization status .......: converged
72   - 2017-07-27T16:33:26: Number of parameters ......: 17
73   - 2017-07-27T16:33:26: Number of free parameters .: 11
74   - 2017-07-27T16:33:26: Number of iterations ......: 9
75   - 2017-07-27T16:33:26: Lambda ....................: 1e-12
76   - 2017-07-27T16:33:26: Maximum log likelihood ....: -20909946.573
77   - 2017-07-27T16:33:26: Observed events (Nobs) ...: 3084639.000
78   - 2017-07-27T16:33:26: Predicted events (Npred) ..: 3084635.972 (Nobs - Npred = 3.0282306545414)
  50 + 2017-08-25T15:09:18: +=================================+
  51 + 2017-08-25T15:09:18: | Maximum likelihood optimisation |
  52 + 2017-08-25T15:09:18: +=================================+
  53 + 2017-08-25T15:09:48: >Iteration 0: -logL=20951221.333, Lambda=1.0e-03
  54 + 2017-08-25T15:10:14: >Iteration 1: -logL=20920374.352, Lambda=1.0e-03, delta=30846.981, step=1.0e+00, max(|grad|)=74106.669528 [Index:14]
  55 + 2017-08-25T15:10:41: >Iteration 2: -logL=20914723.637, Lambda=1.0e-04, delta=5650.715, step=1.0e+00, max(|grad|)=6059.304173 [Index:14]
  56 + 2017-08-25T15:11:07: >Iteration 3: -logL=20912552.166, Lambda=1.0e-05, delta=2171.471, step=1.0e+00, max(|grad|)=4361.007623 [RA:0]
  57 + 2017-08-25T15:11:33: >Iteration 4: -logL=20911666.571, Lambda=1.0e-06, delta=885.595, step=1.0e+00, max(|grad|)=2602.512475 [RA:0]
  58 + 2017-08-25T15:11:59: >Iteration 5: -logL=20911523.902, Lambda=1.0e-07, delta=142.669, step=1.0e+00, max(|grad|)=1076.703629 [RA:0]
  59 + 2017-08-25T15:12:26: >Iteration 6: -logL=20911508.855, Lambda=1.0e-08, delta=15.047, step=1.0e+00, max(|grad|)=333.013402 [RA:0]
  60 + 2017-08-25T15:12:52: >Iteration 7: -logL=20911507.544, Lambda=1.0e-09, delta=1.311, step=1.0e+00, max(|grad|)=93.512904 [RA:0]
  61 + 2017-08-25T15:13:18: >Iteration 8: -logL=20911507.529, Lambda=1.0e-10, delta=0.015, step=1.0e+00, max(|grad|)=24.977311 [RA:0]
  62 + 2017-08-25T15:13:45: >Iteration 9: -logL=20911507.529, Lambda=1.0e-11, delta=0.000, step=1.0e+00, max(|grad|)=6.442211 [RA:0]
  63 + 2017-08-25T15:14:12:
  64 + 2017-08-25T15:14:12: +=========================================+
  65 + 2017-08-25T15:14:12: | Maximum likelihood optimisation results |
  66 + 2017-08-25T15:14:12: +=========================================+
  67 + 2017-08-25T15:14:12: === GOptimizerLM ===
  68 + 2017-08-25T15:14:12: Optimized function value ..: 20911507.529
  69 + 2017-08-25T15:14:12: Absolute precision ........: 0.005
  70 + 2017-08-25T15:14:12: Acceptable value decrease .: 2
  71 + 2017-08-25T15:14:12: Optimization status .......: converged
  72 + 2017-08-25T15:14:12: Number of parameters ......: 17
  73 + 2017-08-25T15:14:12: Number of free parameters .: 11
  74 + 2017-08-25T15:14:12: Number of iterations ......: 9
  75 + 2017-08-25T15:14:12: Lambda ....................: 1e-12
  76 + 2017-08-25T15:14:12: Maximum log likelihood ....: -20911507.529
  77 + 2017-08-25T15:14:12: Observed events (Nobs) ...: 3084595.000
  78 + 2017-08-25T15:14:12: Predicted events (Npred) ..: 3084591.999 (Nobs - Npred = 3.00117048900574)
79 79  
80 80 Also the :ref:`ctbutterfly` tool and the :ref:`csspec` and :ref:`csresmap`
81 81 scripts can be run into unbinned mode by providing the
... ...