aklog: Couldn't determine realm of user:aklog: unknown RPC error (-1765328189) while getting realm /nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/pyfits/__init__.py:22: PyFITSDeprecationWarning: PyFITS is deprecated, please use astropy.io.fits PyFITSDeprecationWarning) # noqa Likelihood Analysis Tool Support Contact: Daniel Kocevski (daniel.kocevski@nasa.gov) Waiting 128 seconds before starting... Proceeding. Importing modules... This is make3FGLxml version 01r0. The default diffuse model files and names are for pass 8 and assume you have v10r00p05 of the Fermi Science Tools or higher. This is make4FGLxml version 01r04. The default diffuse model files and names are for pass 8 and 4FGL and assume you have v11r5p3 of the Fermi Science Tools or higher. WARNING: version mismatch between CFITSIO header (v3.43) and linked library (v3.41). /nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/matplotlib/cbook/deprecation.py:106: MatplotlibDeprecationWarning: The mpl_toolkits.axes_grid module was deprecated in version 2.1. Use mpl_toolkits.axes_grid1 and mpl_toolkits.axisartist provies the same functionality instead. warnings.warn(message, mplDeprecation, stacklevel=1) WARNING: version mismatch between CFITSIO header (v3.43) and linked library (v3.41). Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361752786_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361758510_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361764235_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361769959_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361773079_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361779741_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361785856_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361791901_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361797897_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361803877_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361809850_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361815820_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361821693_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361827102_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361832922_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361838646_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361844370_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361850094_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361855818_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361859354_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361865698_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361877823_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361883814_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361889792_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361895764_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361901733_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361907542_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361912843_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361918782_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361924506_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361930228_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361935952_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361941676_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361945423_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361951646_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361957721_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361963742_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361969729_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361975706_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361981677_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0361987634_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362004639_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362010363_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362016087_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362021813_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362025366_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362026202_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362028302_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362031434_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362032322_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362034422_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362037594_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362043652_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362049661_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362055645_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362061620_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362067590_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362073537_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362079117_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362084774_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362090498_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362096222_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362107670_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362141560_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362147534_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362153504_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362159403_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362164867_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362170633_v305.fit Last server error 3011 ('No servers are available to read the file.') Error accessing path/file for root://glast-rdr.slac.stanford.edu//glast/Data/Flight/Reprocess/P305/ft1/gll_ph_p305_r0362176357_v305.fit shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory rmdir: failed to remove `/scratch/kocevski/586922': No such file or directory shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory Done. Performing analysis on: 4FGL_J1303.0+2434_weekly_bin203 RA = 195.757, Dec = 24.5821 tmin = 361756801, tmax = 362361601 emin = 100.0, emax = 100000.0 irfs = P8R3_SOURCE_V2 ROI = 12 zmax = 90 Fitting strategies: Fix sources to their catalog values = True Leave variable source normalizations free = True Perform pre-fit where ALL sources are frozen to catalog values = False Perform secondary fit with a free spectral index = True Remove all catalog sources = False Remove weak (TS < 2) catalog sources = False Freeze Galactic component = False Likelihood fit parameters: Statistic: UNBINNED Optimizer: MINUIT Catalog: 4FGL Repository Job = True LAT data Source: Data catalog Updating database... UPDATE lightcurve_data_v2 SET job_id='586922', job_status='RUN', time_executed='2021-07-19 20:48:27.035236', time_epoch_executed='1626752907.04' WHERE source_name='4FGL J1303.0+2434' and cadence='weekly' and bin_id='203' Database successfully updated. Done. Creating custom output directory: /scratch/kocevski/586922 Creating custom pfile directory: /scratch/kocevski/586922/pfiles/ Retrieving the FT1 file... Issuing command: /afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT1 --filter 'nMetStop>=361756801.0 && nMetStart<362361601.0' /Data/Flight/Reprocess/P305 Issuing command: /afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT1 --filter 'nMetStart>564945418 && nMetStop>=361756801.0 && nMetStart<362361601.0' /Data/Flight/Level1/LPA Retrieving 111 files... Done. Merging files... [Errno 2] No such file or directory: '/scratch/kocevski/586922/gll_ph_p305_r0361752786_v305.fit' Traceback (most recent call last): File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 2835, in sourceAnalysis dataAvailibility_ft1 = dataCatalogQuery(FT1_options, verbose=verbose) File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py", line 1938, in dataCatalogQuery FTmerge.ft1merge(dataCatalogFiles_local, mergedFile, verbose=verbose) File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/FTmerge.py", line 59, in ft1merge tstart, tstop = _getTimeKeywords(infiles) File "/nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/FTmerge.py", line 36, in _getTimeKeywords header = pyfits.open(infiles[0])[extnum].header File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 148, in fitsopen lazy_load_hdus, **kwargs) File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 402, in fromfile lazy_load_hdus=lazy_load_hdus, **kwargs) File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 1006, in _readfrom fileobj = _File(fileobj, mode=mode, memmap=memmap, cache=cache) File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/utils/decorators.py", line 508, in wrapper return function(*args, **kwargs) File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/file.py", line 150, in __init__ self._open_filename(fileobj, mode, overwrite) File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/file.py", line 506, in _open_filename self._file = fileobj_open(self.name, IO_FITS_MODES[mode]) File "/nfs/farm/g/glast/g/LCRepository/bin/miniconda2/envs/fermitools_v1.0.5/lib/python2.7/site-packages/astropy/io/fits/util.py", line 395, in fileobj_open return open(filename, mode) IOError: [Errno 2] No such file or directory: '/scratch/kocevski/586922/gll_ph_p305_r0361752786_v305.fit' Retrieving the FT1 file... Issuing command: /afs/slac.stanford.edu/g/glast/ground/bin/datacat find --group FT2 --filter 'nMetStop>=361756801.0 && nMetStart<362361601.0' /Data/Flight/Level1/LPA Retrieving 111 files... Done. Merging files... Merged file saved to: /scratch/kocevski/586922/ft2_4FGL_J1303.0+2434_weekly_bin203.fits UPDATE lightcurve_data_v2 SET job_status='DONE', comment='No available data', time_epoch_completed='1626753451.69', time_completed='2021-07-19 20:57:31.692386', job_id='586922' WHERE bin_id='203' AND source_name='4FGL J1303.0+2434' AND cadence='weekly'; Database successfully updated. Error: could not find cmap file: /scratch/kocevski/586922/cmap_HighResolution_361756801_362361601_4FGL_J1303.0+2434_weekly_bin203.fits Continuing... Cleaning up... ** Nuclear option initiated! ** rmdir /scratch/kocevski/586922 Analysis Complete. Mon Jul 19 20:57:31 PDT 2021 ------------------------------------------------------------ Sender: LSF System Subject: Job 586922: <4FGL_J1303.0+2434_weekly_bin203> in cluster Done Job <4FGL_J1303.0+2434_weekly_bin203> was submitted from host by user in cluster at Mon Jul 19 20:45:42 2021 Job was executed on host(s) , in queue , as user in cluster at Mon Jul 19 20:46:10 2021 was used as the home directory. was used as the working directory. Started at Mon Jul 19 20:46:10 2021 Terminated at Mon Jul 19 20:57:32 2021 Results reported at Mon Jul 19 20:57:32 2021 Your job looked like: ------------------------------------------------------------ # LSBATCH: User input /nfs/farm/g/glast/g/LCRepository/Likelihood/Scripts/LikelihoodAnalysis.py 4FGL_J1303.0+2434_weekly_bin203 195.757 24.5821 361756801 362361601 irfs=P8R3_SOURCE_V2 zmax=90 ROI=12 association=4FGL_J1303.0+2434 fixedModel=True performFreeIndexFit=True freeVariableSources=True nuke=True repositoryJob=True verbose=False ------------------------------------------------------------ Successfully completed. Resource usage summary: CPU time : 25.00 sec. Max Memory : 107 MB Average Memory : 86.24 MB Total Requested Memory : - Delta Memory : - Max Swap : 39 MB Max Processes : 7 Max Threads : 9 Run time : 684 sec. Turnaround time : 710 sec. The output (if any) is above this job summary.