Absturz 1: Jul 6 14:51:48 IPS-KHL kernel: [1122462.270781] symcon invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270790] symcon cpuset=/ mems_allowed=0 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270805] CPU: 0 PID: 27123 Comm: symcon Tainted: G C 4.19.118-v7+ #1311 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270808] Hardware name: BCM2835 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270831] [<801120c8>] (unwind_backtrace) from [<8010d5fc>] (show_stack+0x20/0x24) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270841] [<8010d5fc>] (show_stack) from [<80856da8>] (dump_stack+0xe0/0x124) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270851] [<80856da8>] (dump_stack) from [<80261dd8>] (dump_header+0x80/0x250) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270860] [<80261dd8>] (dump_header) from [<80261140>] (oom_kill_process+0x354/0x3a4) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270867] [<80261140>] (oom_kill_process) from [<80261a70>] (out_of_memory+0x134/0x37c) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270875] [<80261a70>] (out_of_memory) from [<80267ed8>] (__alloc_pages_nodemask+0x1020/0x1174) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270884] [<80267ed8>] (__alloc_pages_nodemask) from [<8029b044>] (handle_mm_fault+0x638/0xd68) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270893] [<8029b044>] (handle_mm_fault) from [<80874a7c>] (do_page_fault+0x344/0x3b8) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270901] [<80874a7c>] (do_page_fault) from [<801167fc>] (do_DataAbort+0x58/0xf4) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270910] [<801167fc>] (do_DataAbort) from [<80101ca4>] (__dabt_usr+0x44/0x60) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270913] Exception stack(0xa45affb0 to 0xa45afff8) Jul 6 14:51:48 IPS-KHL kernel: [1122462.270919] ffa0: 39db3000 38575040 000429ba 38170000 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270925] ffc0: 00447ab2 663fab84 38170008 04deac60 04dead68 00002778 3b9aca00 00000000 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270931] ffe0: 00000080 663fab08 c0000000 76f96c5c 20000010 ffffffff Jul 6 14:51:48 IPS-KHL kernel: [1122462.270955] Mem-Info: Jul 6 14:51:48 IPS-KHL kernel: [1122462.270967] active_anon:104399 inactive_anon:105420 isolated_anon:0 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270967] active_file:171 inactive_file:413 isolated_file:0 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270967] unevictable:27 dirty:0 writeback:0 unstable:0 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270967] slab_reclaimable:6237 slab_unreclaimable:9987 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270967] mapped:810 shmem:893 pagetables:1137 bounce:0 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270967] free:4048 free_pcp:0 free_cma:284 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270976] Node 0 active_anon:417596kB inactive_anon:421680kB active_file:684kB inactive_file:1652kB unevictable:108kB isolated(anon):0kB isolated(file):0kB mapped:3240kB dirty:0kB writeback:0kB shmem:3572kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Jul 6 14:51:48 IPS-KHL kernel: [1122462.270989] Normal free:16192kB min:16384kB low:20480kB high:24576kB active_anon:417528kB inactive_anon:421696kB active_file:872kB inactive_file:2008kB unevictable:108kB writepending:0kB present:970752kB managed:948280kB mlocked:108kB kernel_stack:2168kB pagetables:4548kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:1136kB Jul 6 14:51:48 IPS-KHL kernel: [1122462.270991] lowmem_reserve[]: 0 0 Jul 6 14:51:48 IPS-KHL kernel: [1122462.270997] Normal: 552*4kB (UMEHC) 391*8kB (UMHC) 277*16kB (UMHC) 134*32kB (MEHC) 17*64kB (HC) 5*128kB (H) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 16808kB Jul 6 14:51:48 IPS-KHL kernel: [1122462.271024] 6238 total pagecache pages Jul 6 14:51:48 IPS-KHL kernel: [1122462.271028] 4707 pages in swap cache Jul 6 14:51:48 IPS-KHL kernel: [1122462.271032] Swap cache stats: add 260361, delete 255654, find 399982/422282 Jul 6 14:51:48 IPS-KHL kernel: [1122462.271035] Free swap = 0kB Jul 6 14:51:48 IPS-KHL kernel: [1122462.271037] Total swap = 102396kB Jul 6 14:51:48 IPS-KHL kernel: [1122462.271040] 242688 pages RAM Jul 6 14:51:48 IPS-KHL kernel: [1122462.271043] 0 pages HighMem/MovableOnly Jul 6 14:51:48 IPS-KHL kernel: [1122462.271045] 5618 pages reserved Jul 6 14:51:48 IPS-KHL kernel: [1122462.271048] 2048 pages cma reserved Jul 6 14:51:48 IPS-KHL kernel: [1122462.271050] Tasks state (memory values in pages): Jul 6 14:51:48 IPS-KHL kernel: [1122462.271054] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name Jul 6 14:51:48 IPS-KHL kernel: [1122462.271094] [ 115] 0 115 8844 807 73728 152 0 systemd-journal Jul 6 14:51:48 IPS-KHL kernel: [1122462.271101] [ 152] 0 152 4546 19 18432 199 -1000 systemd-udevd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271110] [ 321] 100 321 5603 20 26624 143 0 systemd-timesyn Jul 6 14:51:48 IPS-KHL kernel: [1122462.271116] [ 358] 0 358 3291 50 20480 126 0 systemd-logind Jul 6 14:51:48 IPS-KHL kernel: [1122462.271123] [ 361] 108 361 1476 47 14336 41 0 avahi-daemon Jul 6 14:51:48 IPS-KHL kernel: [1122462.271129] [ 363] 65534 363 1080 10 12288 36 0 thd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271136] [ 368] 0 368 6378 146 18432 89 0 rsyslogd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271142] [ 386] 104 386 1637 78 16384 47 -900 dbus-daemon Jul 6 14:51:48 IPS-KHL kernel: [1122462.271149] [ 395] 0 395 2685 13 18432 88 0 wpa_supplicant Jul 6 14:51:48 IPS-KHL kernel: [1122462.271155] [ 401] 0 401 1987 14 14336 32 0 cron Jul 6 14:51:48 IPS-KHL kernel: [1122462.271161] [ 402] 108 402 1443 5 14336 58 0 avahi-daemon Jul 6 14:51:48 IPS-KHL kernel: [1122462.271168] [ 403] 0 403 923 14 10240 35 0 alsactl Jul 6 14:51:48 IPS-KHL kernel: [1122462.271175] [ 423] 0 423 6914 25 18432 10 0 rngd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271181] [ 455] 0 455 2749 19 22528 121 0 wpa_supplicant Jul 6 14:51:48 IPS-KHL kernel: [1122462.271222] [ 629] 0 629 535 6 10240 26 0 hciattach Jul 6 14:51:48 IPS-KHL kernel: [1122462.271229] [ 634] 0 634 2384 0 14336 83 0 bluetoothd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271238] [ 694] 0 694 726 15 10240 86 0 dhcpcd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271244] [ 699] 0 699 1405 0 16384 99 0 login Jul 6 14:51:48 IPS-KHL kernel: [1122462.271252] [ 700] 0 700 2681 1 16384 144 -1000 sshd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271258] [ 710] 1000 710 3649 8 24576 220 0 systemd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271266] [ 713] 1000 713 4197 13 22528 380 0 (sd-pam) Jul 6 14:51:48 IPS-KHL kernel: [1122462.271272] [ 725] 1000 725 2091 7 18432 196 0 bash Jul 6 14:51:48 IPS-KHL kernel: [1122462.271279] [ 8678] 0 8678 12220 73 57344 454 0 smbd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271286] [ 8680] 0 8680 11356 18 53248 455 0 smbd-notifyd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271293] [ 8681] 0 8681 11357 36 51200 440 0 cleanupd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271300] [ 8683] 0 8683 12217 47 53248 473 0 lpqd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271306] [ 8728] 0 8728 8042 58 38912 302 0 nmbd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271331] [ 10910] 0 10910 30427 1262 61440 244 0 curlftpfs Jul 6 14:51:48 IPS-KHL kernel: [1122462.271338] [ 2481] 0 2481 3059 32 20480 165 0 sshd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271345] [ 2509] 1000 2509 3059 54 20480 147 0 sshd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271352] [ 2512] 1000 2512 2089 81 14336 121 0 bash Jul 6 14:51:48 IPS-KHL kernel: [1122462.271358] [ 32505] 0 32505 4751 221 24576 166 0 proftpd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271365] [ 27090] 0 27090 497890 200878 1218560 11798 0 symcon Jul 6 14:51:48 IPS-KHL kernel: [1122462.271372] [ 30973] 0 30973 2507 85 16384 0 0 sudo Jul 6 14:51:48 IPS-KHL kernel: [1122462.271378] [ 30978] 0 30978 2547 136 20480 0 0 top Jul 6 14:51:48 IPS-KHL kernel: [1122462.271386] [ 32116] 0 32116 2367 73 16384 5 0 cron Jul 6 14:51:48 IPS-KHL kernel: [1122462.271392] [ 32127] 1000 32127 485 13 10240 0 0 sh Jul 6 14:51:48 IPS-KHL kernel: [1122462.271398] [ 32129] 0 32129 2507 83 18432 0 0 sudo Jul 6 14:51:48 IPS-KHL kernel: [1122462.271405] [ 32173] 0 32173 2042 71 18432 0 0 rsync Jul 6 14:51:48 IPS-KHL kernel: [1122462.271411] [ 32174] 0 32174 2028 57 18432 0 0 rsync Jul 6 14:51:48 IPS-KHL kernel: [1122462.271418] [ 32182] 0 32182 2093 64 16384 0 0 rsync Jul 6 14:51:48 IPS-KHL kernel: [1122462.271425] [ 32295] 0 32295 4779 246 24576 144 0 proftpd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271431] [ 32307] 0 32307 4751 234 24576 153 0 proftpd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271456] [ 32321] 0 32321 12217 68 49152 456 0 lpqd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271463] [ 32324] 0 32324 4751 222 22528 165 0 proftpd Jul 6 14:51:48 IPS-KHL kernel: [1122462.271468] Out of memory: Kill process 27090 (symcon) score 810 or sacrifice child Jul 6 14:51:48 IPS-KHL kernel: [1122462.271834] Killed process 27090 (symcon) total-vm:1991560kB, anon-rss:803512kB, file-rss:0kB, shmem-rss:0kB Jul 6 14:51:48 IPS-KHL kernel: [1122462.505530] oom_reaper: reaped process 27090 (symcon), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Absturz 2: Jul 6 15:17:01 IPS-KHL CRON[1678]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Jul 6 15:20:02 IPS-KHL CRON[1904]: (root) CMD (/var/lib/symcon/watchdog.sh >/dev/null 2>&1) danach bis zum Reboot keine Einträge zwischen 15:24 und 15:26 muss Symcon abgestürzt sein, um 15:25 hat watchdog alles durcheinandergebracht und es wurde ein reboot nötig