cross-posted from: https://jlai.lu/post/4000526

Hey all !

I am in need of some help with understanding docker and logs.

I self-host nitter and miniflux with nginx acting as a proxy to handle vhost and ssl certificates. Today, I tried to connect to both of them from outside of my local network and got 502 Bad Gateway errors.

I sshed into my server and noticed that docker container list -a displayed all my containers with status Exited(0) 13 hours ago.

I searched through various log files and came across the following lines in the journalctl of the docker.service :

févr. 01 06:17:37 raspberrypi systemd[1]: Starting Docker Application Container Engine...
févr. 01 06:17:40 raspberrypi dockerd[901]: time="2024-02-01T06:17:40.127982537Z" level=info msg="Starting up"
févr. 01 06:17:40 raspberrypi dockerd[901]: time="2024-02-01T06:17:40.688248474Z" level=info msg="[graphdriver] using prior storage driver: overlay2"
févr. 01 06:17:40 raspberrypi dockerd[901]: time="2024-02-01T06:17:40.889082536Z" level=info msg="Loading containers: start."
févr. 01 06:17:43 raspberrypi dockerd[901]: time="2024-02-01T06:17:43.020099983Z" level=info msg="Removing stale sandbox 1fbc699a3e112b946f4413343a39c8c1406c27fb7cf2597f3dd50f7ebe3c24d7 (80246e5c8704f6c014f3009daaeec5ea603be6a410b999180846bc5087e2de5d)"
févr. 01 06:17:43 raspberrypi dockerd[901]: time="2024-02-01T06:17:43.104933890Z" level=warning msg="Error (Unable to complete atomic operation, key modified) deleting object [endpoint 9a352ca5256bf17c4a499456bc61e673d2ffec7f67ba4f97082909b702d268b5 0cd74359af5e64b544ce1cbae42348e2dcb71648e036ea67b4a57d30c80b47f5], retrying...."

I kagied that and found some GitHub issues about how docker could fail to remove network or stuff like that.

Do any of you might have some better infos ? Or ideas of where i should dig ?

Thank you !