Likelihood Analysis Tool
Support Contact: Daniel Kocevski (daniel.kocevski@nasa.gov)


Waiting 201 seconds before starting...
Proceeding.

Importing modules...
Traceback (most recent call last):
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 21, in <module>
    import astropy.io.fits as astro_fits
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/__init__.py", line 116, in <module>
    _check_numpy()
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/__init__.py", line 105, in _check_numpy
    requirement_met = minversion(numpy, __minimum_numpy_version__)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/utils/introspection.py", line 156, in minversion
    from pkg_resources import parse_version
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pkg_resources/__init__.py", line 3126, in <module>
    @_call_aside
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pkg_resources/__init__.py", line 3110, in _call_aside
    f(*args, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pkg_resources/__init__.py", line 3154, in _initialize_master_working_set
    for dist in working_set
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pkg_resources/__init__.py", line 3154, in <genexpr>
    for dist in working_set
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2658, in activate
    fixup_namespace_packages(self.location)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2198, in fixup_namespace_packages
    subpath = _handle_ns(package, path_item)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2104, in _handle_ns
    loader = importer.find_module(packageName)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/pkgutil.py", line 186, in find_module
    file, filename, etc = imp.find_module(subname, path)
KeyboardInterrupt
ssfully updated.
Done.

Creating custom output directory:
/scratch/kocevski/902981

Creating custom pfile directory:
/scratch/kocevski/902981/pfiles/

Retrieving the FT1 file...

Issuing command:
/afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT1 --filter 'nMetStop>=444096001.0 && nMetStart<444355201.0' /Data/Flight/Reprocess/P305

Issuing command:
/afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT1 --filter 'nMetStart>564945418 && nMetStop>=444096001.0 && nMetStart<444355201.0' /Data/Flight/Level1/LPA

Retrieving 46 files...
Done.


Merging files...

/bin/sh: fmerge: command not found
/bin/sh: fmerge: command not found
[Errno 2] No such file or directory: '/scratch/kocevski/902981/ft1_4FGL_J0345.2-2353_daily_bin790.fits'
Traceback (most recent call last):
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 2835, in sourceAnalysis
    dataAvailibility_ft1 = dataCatalogQuery(FT1_options, verbose=verbose)
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 1938, in dataCatalogQuery
    FTmerge.ft1merge(dataCatalogFiles_local, mergedFile, verbose=verbose)
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/FTmerge.py", line 73, in ft1merge
    foo = pyfits.open(outfile)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 148, in fitsopen
    lazy_load_hdus, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 402, in fromfile
    lazy_load_hdus=lazy_load_hdus, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 1006, in _readfrom
    fileobj = _File(fileobj, mode=mode, memmap=memmap, cache=cache)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/utils/decorators.py", line 508, in wrapper
    return function(*args, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/file.py", line 150, in __init__
    self._open_filename(fileobj, mode, overwrite)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/file.py", line 506, in _open_filename
    self._file = fileobj_open(self.name, IO_FITS_MODES[mode])
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/util.py", line 395, in fileobj_open
    return open(filename, mode)
IOError: [Errno 2] No such file or directory: '/scratch/kocevski/902981/ft1_4FGL_J0345.2-2353_daily_bin790.fits'


Retrieving the FT1 file...

Issuing command:
/afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT2 --filter 'nMetStop>=444096001.0 && nMetStart<444355201.0' /Data/Flight/Level1/LPA

Retrieving 46 files...
Done.


Merging files...
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fcopy: command not found
/bin/sh: fmerge: command not found
[Errno 2] No such file or directory: '/scratch/kocevski/902981/ft2_4FGL_J0345.2-2353_daily_bin790.fits'
Traceback (most recent call last):
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 2861, in sourceAnalysis
    dataAvailibility_ft2 = dataCatalogQuery(FT2_options, verbose=verbose)
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 1943, in dataCatalogQuery
    FTmerge.ft2merge(dataCatalogFiles_local, mergedFile, verbose=verbose)
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/FTmerge.py", line 153, in ft2merge
    updateTimeKeywords(outfile, tstart, tstop)
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/FTmerge.py", line 48, in updateTimeKeywords
    foo = pyfits.open(fitsfile)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 148, in fitsopen
    lazy_load_hdus, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 402, in fromfile
    lazy_load_hdus=lazy_load_hdus, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 1006, in _readfrom
    fileobj = _File(fileobj, mode=mode, memmap=memmap, cache=cache)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/utils/decorators.py", line 508, in wrapper
    return function(*args, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/file.py", line 150, in __init__
    self._open_filename(fileobj, mode, overwrite)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/file.py", line 506, in _open_filename
    self._file = fileobj_open(self.name, IO_FITS_MODES[mode])
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/util.py", line 395, in fileobj_open
    return open(filename, mode)
IOError: [Errno 2] No such file or directory: '/scratch/kocevski/902981/ft2_4FGL_J0345.2-2353_daily_bin790.fits'


UPDATE lightcurve_data_v2 SET job_status='DONE', comment='No available data', time_epoch_completed='1629387344.65', time_completed='2021-08-19 08:35:44.645013', job_id='902981' WHERE bin_id='790' AND source_name='4FGL J0345.2-2353' AND cadence='daily';

Database successfully updated.

Error: could not find cmap file: /scratch/kocevski/902981/cmap_HighResolution_444096001_444355201_4FGL_J0345.2-2353_daily_bin790.fits
Continuing... 

Cleaning up...

** Nuclear option initiated! **
rmdir /scratch/kocevski/902981


Analysis Complete.


Thu Aug 19 08:35:44 PDT 2021


------------------------------------------------------------
Sender: LSF System <lsf@bullet0030>
Subject: Job 902981: <4FGL_J0345.2-2353_daily_bin790> in cluster <slac> Done

Job <4FGL_J0345.2-2353_daily_bin790> was submitted from host <rhel6-64d> by user <kocevski> in cluster <slac> at Thu Aug 19 08:32:45 2021
Job was executed on host(s) <bullet0030>, in queue <medium>, as user <kocevski> in cluster <slac> at Thu Aug 19 08:33:00 2021
</u/ki/kocevski> was used as the home directory.
</u/ki/kocevski> was used as the working directory.
Started at Thu Aug 19 08:33:00 2021
Terminated at Thu Aug 19 08:35:46 2021
Results reported at Thu Aug 19 08:35:46 2021

Your job looked like:

------------------------------------------------------------
# LSBATCH: User input
/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py 4FGL_J0345.2-2353_daily_bin790 56.3187 -23.885 444096001 444355201 irfs=P8R3_SOURCE_V2 zmax=90 ROI=12 association=4FGL_J0345.2-2353 fixedModel=True performFreeIndexFit=True freeVariableSources=True nuke=True repositoryJob=True verbose=False
------------------------------------------------------------

Successfully completed.

Resource usage summary:

    CPU time :                                   32.43 sec.
    Max Memory :                                 142 MB
    Average Memory :                             56.57 MB
    Total Requested Memory :                     -
    Delta Memory :                               -
    Max Swap :                                   -
    Max Processes :                              5
    Max Threads :                                19
    Run time :                                   164 sec.
    Turnaround time :                            181 sec.

The output (if any) is above this job summary.


------------------------------------------------------------
Sender: LSF System <lsf@bullet0071>
Subject: Job 903635: <4FGL_J0345.2-2353_daily_bin790> in cluster <slac> Exited

Job <4FGL_J0345.2-2353_daily_bin790> was submitted from host <rhel6-64a> by user <kocevski> in cluster <slac> at Thu Aug 19 08:33:12 2021
Job was executed on host(s) <bullet0071>, in queue <medium>, as user <kocevski> in cluster <slac> at Thu Aug 19 08:33:31 2021
</u/ki/kocevski> was used as the home directory.
</u/ki/kocevski> was used as the working directory.
Started at Thu Aug 19 08:33:31 2021
Terminated at Thu Aug 19 08:39:05 2021
Results reported at Thu Aug 19 08:39:05 2021

Your job looked like:

------------------------------------------------------------
# LSBATCH: User input
/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py 4FGL_J0345.2-2353_daily_bin790 56.3187 -23.885 444096001 444355201 irfs=P8R3_SOURCE_V2 zmax=90 ROI=12 association=4FGL_J0345.2-2353 fixedModel=True performFreeIndexFit=True freeVariableSources=True nuke=True repositoryJob=True verbose=False
------------------------------------------------------------

TERM_ADMIN: job killed by root or an administrator.
Exited with exit code 1.

Resource usage summary:

    CPU time :                                   2.02 sec.
    Max Memory :                                 23 MB
    Average Memory :                             12.82 MB
    Total Requested Memory :                     -
    Delta Memory :                               -
    Max Swap :                                   -
    Max Processes :                              3
    Max Threads :                                19
    Run time :                                   333 sec.
    Turnaround time :                            353 sec.

The output (if any) is above this job summary.


------------------------------------------------------------
Sender: LSF System <lsf@bullet0083>
Subject: Job 903921: <4FGL_J0345.2-2353_daily_bin790> in cluster <slac> Exited

Job <4FGL_J0345.2-2353_daily_bin790> was submitted from host <rhel6-64n> by user <kocevski> in cluster <slac> at Thu Aug 19 08:33:29 2021
Job was executed on host(s) <bullet0083>, in queue <medium>, as user <kocevski> in cluster <slac> at Thu Aug 19 08:33:47 2021
</u/ki/kocevski> was used as the home directory.
</u/ki/kocevski> was used as the working directory.
Started at Thu Aug 19 08:33:47 2021
Terminated at Thu Aug 19 08:39:13 2021
Results reported at Thu Aug 19 08:39:13 2021

Your job looked like:

------------------------------------------------------------
# LSBATCH: User input
/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py 4FGL_J0345.2-2353_daily_bin790 56.3187 -23.885 444096001 444355201 irfs=P8R3_SOURCE_V2 zmax=90 ROI=12 association=4FGL_J0345.2-2353 fixedModel=True performFreeIndexFit=True freeVariableSources=True nuke=True repositoryJob=True verbose=False
------------------------------------------------------------

TERM_ADMIN: job killed by root or an administrator.
Exited with exit code 1.

Resource usage summary:

    CPU time :                                   12.41 sec.
    Max Memory :                                 21 MB
    Average Memory :                             9.83 MB
    Total Requested Memory :                     -
    Delta Memory :                               -
    Max Swap :                                   -
    Max Processes :                              3
    Max Threads :                                19
    Run time :                                   326 sec.
    Turnaround time :                            344 sec.

The output (if any) is above this job summary.