aklog: Couldn't determine realm of user:aklog: unknown RPC error (-1765328189)  while getting realm
/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pyfits/__init__.py:22: PyFITSDeprecationWarning: PyFITS is deprecated, please use astropy.io.fits
  PyFITSDeprecationWarning)  # noqa

Likelihood Analysis Tool
Support Contact: Daniel Kocevski (daniel.kocevski@nasa.gov)


Waiting 58 seconds before starting...
Proceeding.

Importing modules...
This is make3FGLxml version 01r0.
The default diffuse model files and names are for pass 8 and assume you have v10r00p05 of the Fermi Science Tools or higher.
This is make4FGLxml version 01r04.
The default diffuse model files and names are for pass 8 and 4FGL and assume you have v11r5p3 of the Fermi Science Tools or higher.

WARNING: version mismatch between CFITSIO header (v3.43) and linked library (v3.41).

/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/matplotlib/cbook/deprecation.py:106: MatplotlibDeprecationWarning: The mpl_toolkits.axes_grid module was deprecated in version 2.1. Use mpl_toolkits.axes_grid1 and mpl_toolkits.axisartist provies the same functionality instead.
  warnings.warn(message, mplDeprecation, stacklevel=1)

WARNING: version mismatch between CFITSIO header (v3.43) and linked library (v3.41).

Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301937622_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301942989_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301948861_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301954589_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301960317_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301966046_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301971774_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301975410_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301981700_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301987791_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301993822_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0301999817_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302005799_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302011775_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302017743_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302023526_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302026094_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302028786_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302034786_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302040515_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302046243_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302051972_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302057700_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302061525_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302067718_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302073792_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302079812_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302085803_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302091783_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302097758_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302103715_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302109363_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302114984_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302120712_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302126440_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302132169_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302137897_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302143626_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302147584_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302153730_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302159791_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302165800_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302171787_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302177766_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302183742_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302189670_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302195190_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302200909_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302206638_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302212366_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302218095_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302223823_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302227004_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302233621_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302239738_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302245787_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302251787_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302257772_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302263750_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302269725_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302275596_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302280995_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302286835_v305.fit
Last server error 3011 ('No servers are available to read the file.')
Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0302292563_v305.fit
shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
rmdir: failed to remove `/scratch/kocevski/585478': No such file or directory
shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
Done.


Performing analysis on: 4FGL_J1303.0+2434_weekly_bin104
RA = 195.757, Dec = 24.5821
tmin = 301881601, tmax = 302486401
emin = 100.0, emax = 100000.0
irfs = P8R3_SOURCE_V2
ROI = 12
zmax = 90

Fitting strategies:
Fix sources to their catalog values = True
Leave variable source normalizations free = True
Perform pre-fit where ALL sources are frozen to catalog values = False
Perform secondary fit with a free spectral index = True
Remove all catalog sources = False
Remove weak (TS < 2) catalog sources = False
Freeze Galactic component = False

Likelihood fit parameters:
Statistic: UNBINNED
Optimizer: MINUIT

Catalog: 4FGL

Repository Job = True

LAT data Source:
Data catalog

Updating database...

UPDATE lightcurve_data_v2 SET job_id='585478', job_status='RUN', time_executed='2021-07-19 20:41:42.477377', time_epoch_executed='1626752502.48' WHERE source_name='4FGL J1303.0+2434' and cadence='weekly' and bin_id='104'

Database successfully updated.
Done.

Creating custom output directory:
/scratch/kocevski/585478

Creating custom pfile directory:
/scratch/kocevski/585478/pfiles/

Retrieving the FT1 file...

Issuing command:
/afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT1 --filter 'nMetStop>=301881601.0 && nMetStart<302486401.0' /Data/Flight/Reprocess/P305

Issuing command:
/afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT1 --filter 'nMetStart>564945418 && nMetStop>=301881601.0 && nMetStart<302486401.0' /Data/Flight/Level1/LPA

Retrieving 108 files...
Done.


Merging files...

[Errno 2] No such file or directory: '/scratch/kocevski/585478/gll_ph_p305_r0301937622_v305.fit'
Traceback (most recent call last):
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 2835, in sourceAnalysis
    dataAvailibility_ft1 = dataCatalogQuery(FT1_options, verbose=verbose)
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 1938, in dataCatalogQuery
    FTmerge.ft1merge(dataCatalogFiles_local, mergedFile, verbose=verbose)
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/FTmerge.py", line 59, in ft1merge
    tstart, tstop = _getTimeKeywords(infiles)
  File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/FTmerge.py", line 40, in _getTimeKeywords
    header = pyfits.open(item)[extnum].header
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 148, in fitsopen
    lazy_load_hdus, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 402, in fromfile
    lazy_load_hdus=lazy_load_hdus, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 1006, in _readfrom
    fileobj = _File(fileobj, mode=mode, memmap=memmap, cache=cache)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/utils/decorators.py", line 508, in wrapper
    return function(*args, **kwargs)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/file.py", line 150, in __init__
    self._open_filename(fileobj, mode, overwrite)
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/file.py", line 506, in _open_filename
    self._file = fileobj_open(self.name, IO_FITS_MODES[mode])
  File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/util.py", line 395, in fileobj_open
    return open(filename, mode)
IOError: [Errno 2] No such file or directory: '/scratch/kocevski/585478/gll_ph_p305_r0301937622_v305.fit'


Retrieving the FT1 file...

Issuing command:
/afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT2 --filter 'nMetStop>=301881601.0 && nMetStart<302486401.0' /Data/Flight/Level1/LPA

Retrieving 108 files...
Done.


Merging files...

Merged file saved to:
/scratch/kocevski/585478/ft2_4FGL_J1303.0+2434_weekly_bin104.fits


UPDATE lightcurve_data_v2 SET job_status='DONE', comment='No available data', time_epoch_completed='1626753285.94', time_completed='2021-07-19 20:54:45.937095', job_id='585478' WHERE bin_id='104' AND source_name='4FGL J1303.0+2434' AND cadence='weekly';

Database successfully updated.

Error: could not find cmap file: /scratch/kocevski/585478/cmap_HighResolution_301881601_302486401_4FGL_J1303.0+2434_weekly_bin104.fits
Continuing... 

Cleaning up...

** Nuclear option initiated! **
rmdir /scratch/kocevski/585478


Analysis Complete.


Mon Jul 19 20:54:46 PDT 2021


------------------------------------------------------------
Sender: LSF System <lsf@bullet0172>
Subject: Job 585478: <4FGL_J1303.0+2434_weekly_bin104> in cluster <slac> Done

Job <4FGL_J1303.0+2434_weekly_bin104> was submitted from host <rhel6-64j> by user <kocevski> in cluster <slac> at Mon Jul 19 20:40:24 2021
Job was executed on host(s) <bullet0172>, in queue <medium>, as user <kocevski> in cluster <slac> at Mon Jul 19 20:40:34 2021
</u/ki/kocevski> was used as the home directory.
</u/ki/kocevski> was used as the working directory.
Started at Mon Jul 19 20:40:34 2021
Terminated at Mon Jul 19 20:54:46 2021
Results reported at Mon Jul 19 20:54:46 2021

Your job looked like:

------------------------------------------------------------
# LSBATCH: User input
/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py 4FGL_J1303.0+2434_weekly_bin104 195.757 24.5821 301881601 302486401 irfs=P8R3_SOURCE_V2 zmax=90 ROI=12 association=4FGL_J1303.0+2434 fixedModel=True performFreeIndexFit=True freeVariableSources=True nuke=True repositoryJob=True verbose=False
------------------------------------------------------------

Successfully completed.

Resource usage summary:

    CPU time :                                   24.00 sec.
    Max Memory :                                 108 MB
    Average Memory :                             98.62 MB
    Total Requested Memory :                     -
    Delta Memory :                               -
    Max Swap :                                   -
    Max Processes :                              4
    Max Threads :                                9
    Run time :                                   852 sec.
    Turnaround time :                            862 sec.

The output (if any) is above this job summary.