************************************************************* Omega3P ACE3P Codes Source Date: Mon Mar 6 23:26:49 2023 -0800 ACE3P Codes Source Branch: master ACE3P Codes Source Tag: 503652f41066a31de4a9b7088dd1fd7572ada43a Support Lib Source Date: Fri Dec 2 09:43:53 2022 -0800 Support Lib Source Branch: master Support Lib Source Tag: 2f7bd8bf8ec6eb3646dc05e32622a4475531a105 Compilation Date: Mon 06 Mar 2023 11:38:55 PM PST ************************************************************* Copyright 2023, Stanford University Authors make no representations or warranties, expressed or implied. By way of example, but not limitation, authors make no representatinos or warranties of merchantibility or fitness for any particular purpose or that the use of the software componentns of documentation will not infringe any patents, copyrights, trademarks or other rights. The Authors shall not be held liable for any liability nor for any direct, indirect or consequential damages with respect to any claim by users or any third party on account of or arising from the use of this software. ************************************************************* Advanced Computations Department SLAC National Accelerator Laboratory https://slacportal.slac.stanford.edu/sites/ard_public/acd/Pages/Default.aspx Contact: ace3p@slac.stanford.edu Thank you for citing ACE3P when publishing related results. ************************************************************* Starting master process on nid005939 Number of MPI processes: 16 Number of compute nodes: 1 Number of processes per node: 16 Data precision: 64 bits Compiler: 11.2.0 20210728 (Cray Inc.) Boundary conditions: 0 = INTERIOR 1 = MAGNETIC 2 = MAGNETIC 3 = MAGNETIC 4 = EXTERIOR 5 = MAGNETIC 6 = EXTERIOR Read Mesh: /pscratch/sd/c/cho/cw23/pic3p/LCLSGun-DriveField.ncdf Time for reading the model: 0.0570645580000928 Using curved quadratic tetrahedrons Setting global vector finite element basis order to p=1 Partitioning Method: parmetis Setup: Max: 0.003, Sum: 0.041, Balance: 1.001 Matching: Max: 0.003, Sum: 0.051, Balance: 1.001 Contraction: Max: 0.002, Sum: 0.032, Balance: 1.001 InitPart: Max: 0.007, Sum: 0.108, Balance: 1.000 Project: Max: 0.000, Sum: 0.001, Balance: 1.354 Initialize: Max: 0.001, Sum: 0.009, Balance: 1.048 K-way: Max: 0.005, Sum: 0.074, Balance: 1.008 Remap: Max: 0.000, Sum: 0.001, Balance: 1.018 Total: Max: 0.021, Sum: 0.331, Balance: 1.000 *********************************************************** * Total Number of Elements read: 83055 * Total Number of Elements used: 83055 * Total Number of DOFs: 93830 *********************************************************** Time for setting up finite element framework: 0.1878261729998485 /********************************/ /* input parameters, KVC syntax */ /********************************/ Mesh : { ReplicatedElementDistribution : { average : 1226.25 total : 19620 stddev : 716.31440955305 max : 2632 min : 133 } File : /pscratch/sd/c/cho/cw23/pic3p/LCLSGun-DriveField.ncdf MeshCoords : 17711 ElementDistribution : { average : 5190.9375 total : 83055 stddev : 206.67477470654 max : 5448 min : 4526 } } /********************************/ Checking Mesh Quality: TETRAHEDRAL ELEMENTS: number = 83055 INVERTED SECOND-ORDER ELEMENTS: number = 0 <- GOOD! ASPECT RATIO: min = 1.015400885260363 max = 5.039549457372787 average = 1.631261362809352 std dev = 0.2348864240999239 SHAPE MEASURE: min = 0.0007739664191992893 <- WARNING max = 1.188193488017728 average = 0.788064280877556 std dev = 0.126130899089258 *************************** WARNING ******************************* Please consider improving the mesh quality, some elements are severely ill-formed. This can lead to inaccurate results or slow numerical performance. The bad mesh quality is caused by ill element shape ELEMENT VOLUME: min = 6.577674908833937e-13 max = 6.2469384566334e-08 average = 1.9185707120153e-09 std dev = 4.911768262216627e-09 BOUNDING BOX: min = (-3.337406306175295e-14, -3.695940255232788e-15, -0.06032500000000001) max = (0.07307460000000002, 0.1, 0.05654300000000001) EDGE LENGTH: min = 0.0001387745130375893 max = 0.01006751455748348 average = 0.001858842265115548 std dev = 0.001409164576642561 Time for checking the mesh quality: 0.03701424200016845 Time for save/load ComputationalMesh: 0.001117131000000882 Total Volume of the structure is : 0.0001593468904864307 Calling real solver No. Sum Average Max Min Std_dev Diagonal: 1359608 8.50e+04 96714 70081 8.65e+03 Offdiagonal: 48920 3.06e+03 6981 269 1.95e+03 Nonlocal v: 13424 8.39e+02 1875 87 5.21e+02 Number of Grad DOFs: 0 ********************************************************** ARPACK Loop: Shift = 3.443772023135082e+03 ********************************************************** factorizing the matrix using MUMPS ... Using ParMETIS for ordering... Use 16 processors to do parallel reordering (ParMetis) Partition of Processors: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 Processor 0: 0, 6484 Processor 1: 6484, 12451 Processor 2: 12451, 18744 Processor 3: 18744, 24192 Processor 4: 24192, 30063 Processor 5: 30063, 35451 Processor 6: 35451, 40885 Processor 7: 40885, 46765 Processor 8: 46765, 52624 Processor 9: 52624, 57919 Processor 10: 57919, 63928 Processor 11: 63928, 69367 Processor 12: 69367, 74799 Processor 13: 74799, 81141 Processor 14: 81141, 87365 Processor 15: 87365, 93830 total: 93830 16 Generate ordering using parmetis... Finished generating ordering using parmetis Analysis step: 0.18199 seconds Maximal per-core estimated memory 119 MB Aggregated estimated memory 1680 MB Maximal per-core estimated memory if OOC 102MB Aggregated estimated memory if OOC 1578MB Factorization step: 0.185693 seconds Memory usage: used mem per MPI process: min: 9.4543e+01 MB, max: 1.2134e+02 MB, avg: 1.0703e+02 MB, stddev: 7.4519e+00 MB, total: 1.7125e+03 MB used mem per node in GB : min: 2.5663e+01 GB, max: 2.5663e+01 GB, avg: 2.5663e+01 GB, stddev: 0.0000e+00 GB, total: 2.5663e+01 GB used mem per node in % : min: 5.0997e+00 %, max: 5.0997e+00 %, avg: 5.0997e+00 %, stddev: 0.0000e+00 % ncv=6 nev=2 Linear Solver Preparation Time: 7.1499e-01 Solver Time: 1.2847e-01 Number of converged eigenpairs = 2 Eigenvalue: 3.5356982199072286e+03 Frequency: 2.8371247311517472e+09 Residual: 3.3494893737715742e-11 Eigenvalue: 3.5733070881054141e+03 Frequency: 2.8521739237677927e+09 Residual: 4.1007031892505639e-11 ********************************************************** Total number of OP*x operations: 11 Total number of B*x operations if BMAT='G': 31 Total number of steps of re-orthogonalization: 9 ********************************************************** COMMIT MODE: 0 FREQ = 2.8371247311517472e+09 k= 5.9461737444403930e+01 norm(v[0]) = 3.7553941916741756e+01 COMMIT MODE: 1 FREQ = 2.8521739237677927e+09 k= 5.9777145198691230e+01 norm(v[1]) = 3.6954746616298834e+01 Number of TriSolve: 11. Average time for one TriSolv: 0.0117415 Setup: Max: 0.001, Sum: 0.020, Balance: 1.002 Matching: Max: 0.002, Sum: 0.039, Balance: 1.001 Contraction: Max: 0.001, Sum: 0.021, Balance: 1.001 InitPart: Max: 0.003, Sum: 0.047, Balance: 1.000 Project: Max: 0.000, Sum: 0.001, Balance: 1.284 Initialize: Max: 0.001, Sum: 0.008, Balance: 1.042 K-way: Max: 0.004, Sum: 0.061, Balance: 1.000 Remap: Max: 0.000, Sum: 0.001, Balance: 1.014 Total: Max: 0.012, Sum: 0.200, Balance: 1.000