[root@hamachi:/tmp]# coredumpctl dump 1523287 PID: 1523287 (python) UID: 0 (root) GID: 0 (root) Signal: 11 (SEGV) Timestamp: Sun 2025-11-16 22:56:07 PST (5min ago) Command Line: python -m gunicorn immich_ml.main:app -k immich_ml.config.CustomUvicornWorker -c /usr/src/immich_ml/gunicorn_conf.py -b $'[::]:3003' -w 1 -t 300 --log-config-json /usr/src/immich_ml/log_conf.json --keep-alive 2 --graceful-timeout 10 Executable: /usr/local/bin/python3 Control Group: /machine.slice/libpod-b04cf6399e7d88dcfcce63d776ca13f5ea8bc6092f435b306e6c4b70c3ffb4d1.scope/container Unit: libpod-b04cf6399e7d88dcfcce63d776ca13f5ea8bc6092f435b306e6c4b70c3ffb4d1.scope Slice: machine.slice Boot ID: 1f754f1a2b054c458e1339e8a92aabd2 Machine ID: 54ad900c0bda42ed843873458d1c6445 Hostname: b04cf6399e7d Storage: /var/lib/systemd/coredump/core.python.0.1f754f1a2b054c458e1339e8a92aabd2.1523287.1763362567000000.zst (present) Size on Disk: 381.9M Message: Process 1523287 (python) of user 0 dumped core. Module /opt/venv/lib/python3.11/site-packages/sklearn/_loss/_loss.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/sklearn/_loss/_loss.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_fast.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_fast.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_radius_neighbors_classmode.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_radius_neighbors_classmode.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_radius_neighbors.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_radius_neighbors.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_argkmin_classmode.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_argkmin_classmode.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_base.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_base.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_argkmin.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/sklearn/metrics/_pairwise_distances_reduction/_argkmin.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scikit_learn.libs/libgomp-a34b3233.so.1.0.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/scikit_learn.libs/libgomp-a34b3233.so.1.0.0 Module /opt/venv/lib/python3.11/site-packages/scipy/interpolate/_dfitpack.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/interpolate/_dfitpack.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/integrate/_lsoda.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/integrate/_lsoda.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/integrate/_vode.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/integrate/_vode.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/integrate/_odepack.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/integrate/_odepack.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/optimize/_slsqplib.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/optimize/_slsqplib.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/optimize/_lbfgsb.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/optimize/_lbfgsb.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_propack/_zpropack.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_propack/_zpropack.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/_flapack.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/_flapack.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy.libs/libquadmath-96973f99-934c22de.so.0.0.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy.libs/libquadmath-96973f99-934c22de.so.0.0.0 Module /opt/venv/lib/python3.11/site-packages/scipy/interpolate/_dierckx.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/interpolate/_dierckx.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy.libs/libgfortran-040039e1-0352e75f.so.5.0.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy.libs/libgfortran-040039e1-0352e75f.so.5.0.0 Module /opt/venv/lib/python3.11/site-packages/scipy/integrate/_dop.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/integrate/_dop.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy.libs/libscipy_openblas-68440149.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy.libs/libscipy_openblas-68440149.so Module /opt/venv/lib/python3.11/site-packages/scipy/special/_ufuncs.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/special/_ufuncs.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/shapely.libs/libgeos-3ef06f11.so.3.13.1 without build-id. Module /opt/venv/lib/python3.11/site-packages/shapely.libs/libgeos-3ef06f11.so.3.13.1 Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_propack/_dpropack.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_propack/_dpropack.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_propack/_spropack.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_propack/_spropack.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libharfbuzz-89381d8f.so.0.60850.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libharfbuzz-89381d8f.so.0.60850.0 Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_eigen/arpack/_arpack.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_eigen/arpack/_arpack.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libgfortran-91cc3cb1.so.3.0.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libgfortran-91cc3cb1.so.3.0.0 Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_dsolve/_superlu.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/sparse/linalg/_dsolve/_superlu.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libcrypto-8c1ab3ad.so.1.1 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libcrypto-8c1ab3ad.so.1.1 Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libvpx-9f572e11.so.9.1.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libvpx-9f572e11.so.9.1.0 Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libopenblas-r0-f650aae0.3.3.so without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libopenblas-r0-f650aae0.3.3.so Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libavformat-d296e685.so.59.27.100 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libavformat-d296e685.so.59.27.100 Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libavcodec-76c43bf0.so.59.37.100 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libavcodec-76c43bf0.so.59.37.100 Module /opt/venv/lib/python3.11/site-packages/sklearn/utils/_openmp_helpers.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/sklearn/utils/_openmp_helpers.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/optimize/_trlib/_trlib.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/optimize/_trlib/_trlib.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/cv2/cv2.abi3.so without build-id. Module /opt/venv/lib/python3.11/site-packages/cv2/cv2.abi3.so Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libXau-154567c4.so.6.0.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libXau-154567c4.so.6.0.0 Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libfreetype-be14bf51.so.6.20.1 without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libfreetype-be14bf51.so.6.20.1 Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/_matfuncs_expm.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/_matfuncs_expm.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/cython_blas.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/cython_blas.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/cython_lapack.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/cython_lapack.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/_matfuncs_schur_sqrtm.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/_matfuncs_schur_sqrtm.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/_fblas.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/linalg/_fblas.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libavutil-734d06dd.so.57.28.100 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libavutil-734d06dd.so.57.28.100 Module /opt/venv/lib/python3.11/site-packages/scipy/special/_ellip_harm_2.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/scipy/special/_ellip_harm_2.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/google/_upb/_message.abi3.so without build-id. Module /opt/venv/lib/python3.11/site-packages/google/_upb/_message.abi3.so Module /opt/venv/lib/python3.11/site-packages/shapely/_geometry_helpers.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/shapely/_geometry_helpers.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/shapely.libs/libgeos_c-abcdd5fa.so.1.19.2 without build-id. Module /opt/venv/lib/python3.11/site-packages/shapely.libs/libgeos_c-abcdd5fa.so.1.19.2 Module /opt/venv/lib/python3.11/site-packages/shapely/lib.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/shapely/lib.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libbrotlicommon-3ecfe81c.so.1 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libssl-28bef1ac.so.1.1 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libssl-28bef1ac.so.1.1 Module /opt/venv/lib/python3.11/site-packages/shapely/_geos.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/shapely/_geos.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libpng16-58efbb84.so.16.43.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libpng16-58efbb84.so.16.43.0 Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libswscale-95ddd674.so.6.7.100 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libswscale-95ddd674.so.6.7.100 Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libswresample-3e7db482.so.4.7.100 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libswresample-3e7db482.so.4.7.100 Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libpng16-ef62451c.so.16.44.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/opencv_python_headless.libs/libpng16-ef62451c.so.16.44.0 Module /opt/venv/lib/python3.11/site-packages/pillow.libs/liblzma-13fa198c.so.5.4.5 without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/liblzma-13fa198c.so.5.4.5 Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libjpeg-77ae51ab.so.62.4.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libjpeg-77ae51ab.so.62.4.0 Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libxcb-b8a56d01.so.1.1.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libxcb-b8a56d01.so.1.1.0 Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libtiff-0a86184d.so.6.0.2 without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libtiff-0a86184d.so.6.0.2 Module /opt/venv/lib/python3.11/site-packages/numpy.libs/libquadmath-96973f99.so.0.0.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/numpy.libs/libquadmath-96973f99.so.0.0.0 Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libbrotlidec-ba690955.so.1 without build-id. Module /opt/venv/lib/python3.11/site-packages/PIL/_imaging.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/PIL/_imaging.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/numpy.libs/libgfortran-040039e1.so.5.0.0 without build-id. Module /opt/venv/lib/python3.11/site-packages/numpy.libs/libgfortran-040039e1.so.5.0.0 Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libopenjp2-05423b53.so without build-id. Module /opt/venv/lib/python3.11/site-packages/pillow.libs/libopenjp2-05423b53.so Module /opt/venv/lib/python3.11/site-packages/numpy.libs/libopenblas64_p-r0-0cf96a72.3.23.dev.so without build-id. Module /opt/venv/lib/python3.11/site-packages/numpy.libs/libopenblas64_p-r0-0cf96a72.3.23.dev.so Module /opt/venv/lib/python3.11/site-packages/PIL/_imagingft.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/PIL/_imagingft.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/numpy/core/_multiarray_umath.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/numpy/core/_multiarray_umath.cpython-311-x86_64-linux-gnu.so Module /opt/venv/lib/python3.11/site-packages/numpy/linalg/_umath_linalg.cpython-311-x86_64-linux-gnu.so without build-id. Module /opt/venv/lib/python3.11/site-packages/numpy/linalg/_umath_linalg.cpython-311-x86_64-linux-gnu.so Stack trace of thread 587: #0 0x00007f1107933564 n/a (/opt/venv/lib/python3.11/site-packages/onnxruntime/capi/libonnxruntime_providers_cuda.so + 0x333564) #1 0x0000000000000000 n/a (n/a + 0x0) ELF object binary architecture: AMD x86-64