Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [........X..X............X....X.............X..........X.X...] duration: 6.038849338s FAIL (2025-08-09 01:40:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b8192bcbf94a7611fba66f30e1c65b2139344aa7dd4a1271afa1d2cc935d0356 != before 43f6303d3becdd978a3c04b5105702430719f20550c97a23f441ad65112c32d9 ======LOGS====== Aug 9 01:38:53.282599694 (8h12m47.713679825s) [upload=8594]: Starting upload Aug 9 01:38:53.282666933 (8h12m47.713747064s) [upload=8594]: Done starting upload Aug 9 01:38:53.282754600 (8h12m47.713834731s) [upload=8594]: Uploading segments... Aug 9 01:38:53.282896502 (8h12m47.713976633s) [upload=8594]: Got next segment. Inline: false Aug 9 01:38:53.282925367 (8h12m47.714005498s) [upload=8594]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:38:53.282929485 (8h12m47.714009616s) [upload=8594]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:38:53.736052249 (8h12m48.16713238s) [seg_pos={0 0}, upload=8594]: Begin upload segment... Aug 9 01:38:53.736131220 (8h12m48.167211351s) [seg_pos={0 0}, upload=8594]: Done begin upload segment. Aug 9 01:38:53.736151099 (8h12m48.16723123s) [noise=true , address=104.36.82.43:4868 , piece_id=IOUGWTZN5VBWLUAU4S27ITFBZDXOPDEDD3QPOMS7IZSST5OGHWZQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736187889 (8h12m48.16726802s) [noise=true , address=104.36.82.61:4382 , piece_id=B2IT4DO5BHI4RQI5QPPZQEPNLRIR7JH5JKPZW2KZPXYBF5W4U2ZQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736481170 (8h12m48.167561301s) [noise=true , address=104.36.82.47:4517 , piece_id=AGM27YH5E6IXBJXXXWQPYUG6Y6KQ2EYW2HY4NLBNVHGEUNN3GMZA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736529152 (8h12m48.167609283s) [noise=true , address=77.90.31.18:4834 , piece_id=4GU4C353M2NDPZJDLLPCRHGX5344G324BXMHUXQESS7PBJU652KA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736699047 (8h12m48.167779168s) [noise=true , address=64.49.13.170:4722 , piece_id=EKLLMELUBKVTYVZDSIATIRJPXR5MXKPSUTEYVRT3JQZK2MLBA6AA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736926472 (8h12m48.168006593s) [noise=true , address=64.49.13.169:4707 , piece_id=6MGMFTU2T5E5POPIU2NLIXJSL2YC7RCBLHYSZRHUPNLHHYYQJM5A, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737131784 (8h12m48.168211915s) [noise=true , address=104.36.82.37:4663 , piece_id=WL57RHO2K6ZKQCHCYAG2HLRA4I5TYBZYIR6Q74JK7KPTC6P5U2GA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737363017 (8h12m48.168443148s) [noise=true , address=104.36.82.4:4811 , piece_id=E5XD2RNCSIIWQXU7EP5CH4CEWDWSMBWNVYWDXAN272EW7ILMEABA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737510729 (8h12m48.16859086s) [noise=true , address=104.36.82.44:4901 , piece_id=AVYWXB6MOTVI2I24L5TX73HP2JMG7OSKTPCS5IA6UH6V2E6WH3MA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737747323 (8h12m48.168827454s) [noise=true , address=104.36.82.62:4426 , piece_id=HOF546I5A3KDG5W64VG5XGEILX723USDVNQVCWF45267OEQDIFVA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738239114 (8h12m48.169319245s) [noise=true , address=104.36.82.39:4758 , piece_id=SIACF23NXQ7HY5UTQKYNX5KDXAP2RGU54ZMDUEEQQKY6FS3WH4GQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738486266 (8h12m48.169566398s) [noise=true , address=104.36.82.58:4283 , piece_id=T7O2JLWZJVBHXVIVGNBGUL6QXC6JCAQWYTOXSPTUP4VICKEGSYNA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738604021 (8h12m48.169684153s) [noise=true , address=104.36.82.23:4461 , piece_id=SWBVGP66EG5EYXPJ3JG57JMX3FTAO2J5SCC7QJ35H6HQZA3TBMLA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738937710 (8h12m48.170017841s) [noise=true , address=104.36.82.34:4569 , piece_id=HJVF4FQ3SKFBQGX74VYHKFZSOKGZZHJ6TO74JZDHBK2ZCXGMEGCA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738949523 (8h12m48.170029654s) [noise=true , address=104.36.82.4:4826 , piece_id=XTKB77LZXAFWALX5EIT6RBOAN6YRBAU34DRCZHEIKRZFXX4AL2KQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739217254 (8h12m48.170297386s) [noise=true , address=104.36.82.45:4921 , piece_id=PDL3NMTRT4I6JZ7CCW3KS47WONWE6MKDFGXDCJAO3B6VLPKVJSJA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739424962 (8h12m48.170505093s) [noise=true , address=104.36.82.38:4709 , piece_id=4T5H6DJPW6A5VM2ZH6QSAHRURQYZZE2FCOL66TH3H3YLXMIXMBKQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739467102 (8h12m48.170547233s) [noise=true , address=79.127.201.215:4360 , piece_id=V75D2I2YZLMQ4AP7ZMRD2QUZMOKYFCLE6PVZS3XIT7PAIE65J4YA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:54.824240416 (8h12m49.255320548s) [upload=8594]: Next returned nil segment Aug 9 01:38:54.824255545 (8h12m49.255335676s) [upload=8594]: Waiting for error group managing segments... Aug 9 01:38:55.103297282 (8h12m49.534377403s) [noise=true , address=64.49.13.170:4722 , piece_id=EKLLMELUBKVTYVZDSIATIRJPXR5MXKPSUTEYVRT3JQZK2MLBA6AA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.199725688 (8h12m49.630805819s) [noise=true , address=64.49.13.169:4707 , piece_id=6MGMFTU2T5E5POPIU2NLIXJSL2YC7RCBLHYSZRHUPNLHHYYQJM5A, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.651677912 (8h12m50.082758043s) [noise=true , address=79.127.201.215:4360 , piece_id=V75D2I2YZLMQ4AP7ZMRD2QUZMOKYFCLE6PVZS3XIT7PAIE65J4YA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.653425446 (8h12m50.084505577s) [noise=true , address=104.36.82.38:4709 , piece_id=4T5H6DJPW6A5VM2ZH6QSAHRURQYZZE2FCOL66TH3H3YLXMIXMBKQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.706392227 (8h12m50.137472358s) [noise=true , address=104.36.82.43:4868 , piece_id=IOUGWTZN5VBWLUAU4S27ITFBZDXOPDEDD3QPOMS7IZSST5OGHWZQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.721082463 (8h12m50.152162594s) [noise=true , address=104.36.82.34:4569 , piece_id=HJVF4FQ3SKFBQGX74VYHKFZSOKGZZHJ6TO74JZDHBK2ZCXGMEGCA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.758501015 (8h12m50.189581157s) [noise=true , address=104.36.82.23:4461 , piece_id=SWBVGP66EG5EYXPJ3JG57JMX3FTAO2J5SCC7QJ35H6HQZA3TBMLA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.759093319 (8h12m50.19017345s) [noise=true , address=104.36.82.4:4811 , piece_id=E5XD2RNCSIIWQXU7EP5CH4CEWDWSMBWNVYWDXAN272EW7ILMEABA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.759306647 (8h12m50.190386778s) [noise=true , address=104.36.82.62:4426 , piece_id=HOF546I5A3KDG5W64VG5XGEILX723USDVNQVCWF45267OEQDIFVA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.767873919 (8h12m50.19895405s) [noise=true , address=104.36.82.58:4283 , piece_id=T7O2JLWZJVBHXVIVGNBGUL6QXC6JCAQWYTOXSPTUP4VICKEGSYNA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.768509715 (8h12m50.199589846s) [noise=true , address=104.36.82.37:4663 , piece_id=WL57RHO2K6ZKQCHCYAG2HLRA4I5TYBZYIR6Q74JK7KPTC6P5U2GA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.796327909 (8h12m50.22740803s) [noise=true , address=104.36.82.47:4517 , piece_id=AGM27YH5E6IXBJXXXWQPYUG6Y6KQ2EYW2HY4NLBNVHGEUNN3GMZA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.806590574 (8h12m50.237670705s) [noise=true , address=104.36.82.61:4382 , piece_id=B2IT4DO5BHI4RQI5QPPZQEPNLRIR7JH5JKPZW2KZPXYBF5W4U2ZQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.826658520 (8h12m50.257738651s) [noise=true , address=77.90.31.18:4834 , piece_id=4GU4C353M2NDPZJDLLPCRHGX5344G324BXMHUXQESS7PBJU652KA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.826688498 (8h12m50.257768649s) [seg_pos={0 0}, upload=8594]: Segment reached optimal threshold of 14 pieces. Aug 9 01:38:55.826825350 (8h12m50.257905481s) [noise=true , address=104.36.82.39:4758 , piece_id=SIACF23NXQ7HY5UTQKYNX5KDXAP2RGU54ZMDUEEQQKY6FS3WH4GQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XjsLCQGSuQkDmyC4QFENshoLeo4kCZG1YNm34wBvG8UEuxTG7): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.826912055 (8h12m50.257992176s) [noise=true , address=104.36.82.4:4826 , piece_id=XTKB77LZXAFWALX5EIT6RBOAN6YRBAU34DRCZHEIKRZFXX4AL2KQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14hpQXA7AA3CQQ4z8Y81ZTxjY9Bhd1eNCjqEKyandGUHoyi548): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.826962021 (8h12m50.258042152s) [noise=true , address=104.36.82.45:4921 , piece_id=PDL3NMTRT4I6JZ7CCW3KS47WONWE6MKDFGXDCJAO3B6VLPKVJSJA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bBRKXiuSN2cw6KrdP8q4Dsf4MiFCUSgMEGjqG2dKL9RLTQra1): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.827019180 (8h12m50.258099311s) [noise=true , address=104.36.82.44:4901 , piece_id=AVYWXB6MOTVI2I24L5TX73HP2JMG7OSKTPCS5IA6UH6V2E6WH3MA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.827042796 (8h12m50.258122927s) [seg_pos={0 0}, upload=8594]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:38:55.827118901 (8h12m50.258199032s) [upload=8594]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:38:55.827123180 (8h12m50.258203301s) [upload=8594]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:38:56.157513742 (8h12m50.588593873s) [upload=8594]: Done uploading segments... Aug 9 01:38:56.157530954 (8h12m50.588611085s) [upload=8594]: Upload finished. err: <nil> Duration: 6.038879414s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X............X....................X.X.............X........] duration: 1.858264324s FAIL (2025-08-09 01:40:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 1.858294462s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.........X..X............X....X.............X..........X.X..] duration: 5.960208118s FAIL (2025-08-09 01:40:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b8192bcbf94a7611fba66f30e1c65b2139344aa7dd4a1271afa1d2cc935d0356 != before 43f6303d3becdd978a3c04b5105702430719f20550c97a23f441ad65112c32d9 ======LOGS====== Aug 9 01:38:53.282599694 (8h12m47.713679825s) [upload=8594]: Starting upload Aug 9 01:38:53.282666933 (8h12m47.713747064s) [upload=8594]: Done starting upload Aug 9 01:38:53.282754600 (8h12m47.713834731s) [upload=8594]: Uploading segments... Aug 9 01:38:53.282896502 (8h12m47.713976633s) [upload=8594]: Got next segment. Inline: false Aug 9 01:38:53.282925367 (8h12m47.714005498s) [upload=8594]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:38:53.282929485 (8h12m47.714009616s) [upload=8594]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:38:53.736052249 (8h12m48.16713238s) [seg_pos={0 0}, upload=8594]: Begin upload segment... Aug 9 01:38:53.736131220 (8h12m48.167211351s) [seg_pos={0 0}, upload=8594]: Done begin upload segment. Aug 9 01:38:53.736151099 (8h12m48.16723123s) [noise=true , address=104.36.82.43:4868 , piece_id=IOUGWTZN5VBWLUAU4S27ITFBZDXOPDEDD3QPOMS7IZSST5OGHWZQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736187889 (8h12m48.16726802s) [noise=true , address=104.36.82.61:4382 , piece_id=B2IT4DO5BHI4RQI5QPPZQEPNLRIR7JH5JKPZW2KZPXYBF5W4U2ZQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736481170 (8h12m48.167561301s) [noise=true , address=104.36.82.47:4517 , piece_id=AGM27YH5E6IXBJXXXWQPYUG6Y6KQ2EYW2HY4NLBNVHGEUNN3GMZA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736529152 (8h12m48.167609283s) [noise=true , address=77.90.31.18:4834 , piece_id=4GU4C353M2NDPZJDLLPCRHGX5344G324BXMHUXQESS7PBJU652KA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736699047 (8h12m48.167779168s) [noise=true , address=64.49.13.170:4722 , piece_id=EKLLMELUBKVTYVZDSIATIRJPXR5MXKPSUTEYVRT3JQZK2MLBA6AA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736926472 (8h12m48.168006593s) [noise=true , address=64.49.13.169:4707 , piece_id=6MGMFTU2T5E5POPIU2NLIXJSL2YC7RCBLHYSZRHUPNLHHYYQJM5A, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737131784 (8h12m48.168211915s) [noise=true , address=104.36.82.37:4663 , piece_id=WL57RHO2K6ZKQCHCYAG2HLRA4I5TYBZYIR6Q74JK7KPTC6P5U2GA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737363017 (8h12m48.168443148s) [noise=true , address=104.36.82.4:4811 , piece_id=E5XD2RNCSIIWQXU7EP5CH4CEWDWSMBWNVYWDXAN272EW7ILMEABA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737510729 (8h12m48.16859086s) [noise=true , address=104.36.82.44:4901 , piece_id=AVYWXB6MOTVI2I24L5TX73HP2JMG7OSKTPCS5IA6UH6V2E6WH3MA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737747323 (8h12m48.168827454s) [noise=true , address=104.36.82.62:4426 , piece_id=HOF546I5A3KDG5W64VG5XGEILX723USDVNQVCWF45267OEQDIFVA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738239114 (8h12m48.169319245s) [noise=true , address=104.36.82.39:4758 , piece_id=SIACF23NXQ7HY5UTQKYNX5KDXAP2RGU54ZMDUEEQQKY6FS3WH4GQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738486266 (8h12m48.169566398s) [noise=true , address=104.36.82.58:4283 , piece_id=T7O2JLWZJVBHXVIVGNBGUL6QXC6JCAQWYTOXSPTUP4VICKEGSYNA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738604021 (8h12m48.169684153s) [noise=true , address=104.36.82.23:4461 , piece_id=SWBVGP66EG5EYXPJ3JG57JMX3FTAO2J5SCC7QJ35H6HQZA3TBMLA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738937710 (8h12m48.170017841s) [noise=true , address=104.36.82.34:4569 , piece_id=HJVF4FQ3SKFBQGX74VYHKFZSOKGZZHJ6TO74JZDHBK2ZCXGMEGCA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738949523 (8h12m48.170029654s) [noise=true , address=104.36.82.4:4826 , piece_id=XTKB77LZXAFWALX5EIT6RBOAN6YRBAU34DRCZHEIKRZFXX4AL2KQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739217254 (8h12m48.170297386s) [noise=true , address=104.36.82.45:4921 , piece_id=PDL3NMTRT4I6JZ7CCW3KS47WONWE6MKDFGXDCJAO3B6VLPKVJSJA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739424962 (8h12m48.170505093s) [noise=true , address=104.36.82.38:4709 , piece_id=4T5H6DJPW6A5VM2ZH6QSAHRURQYZZE2FCOL66TH3H3YLXMIXMBKQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739467102 (8h12m48.170547233s) [noise=true , address=79.127.201.215:4360 , piece_id=V75D2I2YZLMQ4AP7ZMRD2QUZMOKYFCLE6PVZS3XIT7PAIE65J4YA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:54.824240416 (8h12m49.255320548s) [upload=8594]: Next returned nil segment Aug 9 01:38:54.824255545 (8h12m49.255335676s) [upload=8594]: Waiting for error group managing segments... Aug 9 01:38:55.103297282 (8h12m49.534377403s) [noise=true , address=64.49.13.170:4722 , piece_id=EKLLMELUBKVTYVZDSIATIRJPXR5MXKPSUTEYVRT3JQZK2MLBA6AA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.199725688 (8h12m49.630805819s) [noise=true , address=64.49.13.169:4707 , piece_id=6MGMFTU2T5E5POPIU2NLIXJSL2YC7RCBLHYSZRHUPNLHHYYQJM5A, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.651677912 (8h12m50.082758043s) [noise=true , address=79.127.201.215:4360 , piece_id=V75D2I2YZLMQ4AP7ZMRD2QUZMOKYFCLE6PVZS3XIT7PAIE65J4YA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.653425446 (8h12m50.084505577s) [noise=true , address=104.36.82.38:4709 , piece_id=4T5H6DJPW6A5VM2ZH6QSAHRURQYZZE2FCOL66TH3H3YLXMIXMBKQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.706392227 (8h12m50.137472358s) [noise=true , address=104.36.82.43:4868 , piece_id=IOUGWTZN5VBWLUAU4S27ITFBZDXOPDEDD3QPOMS7IZSST5OGHWZQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.721082463 (8h12m50.152162594s) [noise=true , address=104.36.82.34:4569 , piece_id=HJVF4FQ3SKFBQGX74VYHKFZSOKGZZHJ6TO74JZDHBK2ZCXGMEGCA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.758501015 (8h12m50.189581157s) [noise=true , address=104.36.82.23:4461 , piece_id=SWBVGP66EG5EYXPJ3JG57JMX3FTAO2J5SCC7QJ35H6HQZA3TBMLA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.759093319 (8h12m50.19017345s) [noise=true , address=104.36.82.4:4811 , piece_id=E5XD2RNCSIIWQXU7EP5CH4CEWDWSMBWNVYWDXAN272EW7ILMEABA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.759306647 (8h12m50.190386778s) [noise=true , address=104.36.82.62:4426 , piece_id=HOF546I5A3KDG5W64VG5XGEILX723USDVNQVCWF45267OEQDIFVA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.767873919 (8h12m50.19895405s) [noise=true , address=104.36.82.58:4283 , piece_id=T7O2JLWZJVBHXVIVGNBGUL6QXC6JCAQWYTOXSPTUP4VICKEGSYNA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.768509715 (8h12m50.199589846s) [noise=true , address=104.36.82.37:4663 , piece_id=WL57RHO2K6ZKQCHCYAG2HLRA4I5TYBZYIR6Q74JK7KPTC6P5U2GA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.796327909 (8h12m50.22740803s) [noise=true , address=104.36.82.47:4517 , piece_id=AGM27YH5E6IXBJXXXWQPYUG6Y6KQ2EYW2HY4NLBNVHGEUNN3GMZA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.806590574 (8h12m50.237670705s) [noise=true , address=104.36.82.61:4382 , piece_id=B2IT4DO5BHI4RQI5QPPZQEPNLRIR7JH5JKPZW2KZPXYBF5W4U2ZQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.826658520 (8h12m50.257738651s) [noise=true , address=77.90.31.18:4834 , piece_id=4GU4C353M2NDPZJDLLPCRHGX5344G324BXMHUXQESS7PBJU652KA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.826688498 (8h12m50.257768649s) [seg_pos={0 0}, upload=8594]: Segment reached optimal threshold of 14 pieces. Aug 9 01:38:55.826825350 (8h12m50.257905481s) [noise=true , address=104.36.82.39:4758 , piece_id=SIACF23NXQ7HY5UTQKYNX5KDXAP2RGU54ZMDUEEQQKY6FS3WH4GQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XjsLCQGSuQkDmyC4QFENshoLeo4kCZG1YNm34wBvG8UEuxTG7): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.826912055 (8h12m50.257992176s) [noise=true , address=104.36.82.4:4826 , piece_id=XTKB77LZXAFWALX5EIT6RBOAN6YRBAU34DRCZHEIKRZFXX4AL2KQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14hpQXA7AA3CQQ4z8Y81ZTxjY9Bhd1eNCjqEKyandGUHoyi548): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.826962021 (8h12m50.258042152s) [noise=true , address=104.36.82.45:4921 , piece_id=PDL3NMTRT4I6JZ7CCW3KS47WONWE6MKDFGXDCJAO3B6VLPKVJSJA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bBRKXiuSN2cw6KrdP8q4Dsf4MiFCUSgMEGjqG2dKL9RLTQra1): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.827019180 (8h12m50.258099311s) [noise=true , address=104.36.82.44:4901 , piece_id=AVYWXB6MOTVI2I24L5TX73HP2JMG7OSKTPCS5IA6UH6V2E6WH3MA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.827042796 (8h12m50.258122927s) [seg_pos={0 0}, upload=8594]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:38:55.827118901 (8h12m50.258199032s) [upload=8594]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:38:55.827123180 (8h12m50.258203301s) [upload=8594]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:38:56.157513742 (8h12m50.588593873s) [upload=8594]: Done uploading segments... Aug 9 01:38:56.157530954 (8h12m50.588611085s) [upload=8594]: Upload finished. err: <nil> Duration: 5.960239787s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..........X..X............X....X.............X..........X.X.] duration: 6.857598128s FAIL (2025-08-09 01:39:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b8192bcbf94a7611fba66f30e1c65b2139344aa7dd4a1271afa1d2cc935d0356 != before 43f6303d3becdd978a3c04b5105702430719f20550c97a23f441ad65112c32d9 ======LOGS====== Aug 9 01:38:53.282599694 (8h12m47.713679825s) [upload=8594]: Starting upload Aug 9 01:38:53.282666933 (8h12m47.713747064s) [upload=8594]: Done starting upload Aug 9 01:38:53.282754600 (8h12m47.713834731s) [upload=8594]: Uploading segments... Aug 9 01:38:53.282896502 (8h12m47.713976633s) [upload=8594]: Got next segment. Inline: false Aug 9 01:38:53.282925367 (8h12m47.714005498s) [upload=8594]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:38:53.282929485 (8h12m47.714009616s) [upload=8594]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:38:53.736052249 (8h12m48.16713238s) [seg_pos={0 0}, upload=8594]: Begin upload segment... Aug 9 01:38:53.736131220 (8h12m48.167211351s) [seg_pos={0 0}, upload=8594]: Done begin upload segment. Aug 9 01:38:53.736151099 (8h12m48.16723123s) [noise=true , address=104.36.82.43:4868 , piece_id=IOUGWTZN5VBWLUAU4S27ITFBZDXOPDEDD3QPOMS7IZSST5OGHWZQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736187889 (8h12m48.16726802s) [noise=true , address=104.36.82.61:4382 , piece_id=B2IT4DO5BHI4RQI5QPPZQEPNLRIR7JH5JKPZW2KZPXYBF5W4U2ZQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736481170 (8h12m48.167561301s) [noise=true , address=104.36.82.47:4517 , piece_id=AGM27YH5E6IXBJXXXWQPYUG6Y6KQ2EYW2HY4NLBNVHGEUNN3GMZA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736529152 (8h12m48.167609283s) [noise=true , address=77.90.31.18:4834 , piece_id=4GU4C353M2NDPZJDLLPCRHGX5344G324BXMHUXQESS7PBJU652KA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736699047 (8h12m48.167779168s) [noise=true , address=64.49.13.170:4722 , piece_id=EKLLMELUBKVTYVZDSIATIRJPXR5MXKPSUTEYVRT3JQZK2MLBA6AA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736926472 (8h12m48.168006593s) [noise=true , address=64.49.13.169:4707 , piece_id=6MGMFTU2T5E5POPIU2NLIXJSL2YC7RCBLHYSZRHUPNLHHYYQJM5A, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737131784 (8h12m48.168211915s) [noise=true , address=104.36.82.37:4663 , piece_id=WL57RHO2K6ZKQCHCYAG2HLRA4I5TYBZYIR6Q74JK7KPTC6P5U2GA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737363017 (8h12m48.168443148s) [noise=true , address=104.36.82.4:4811 , piece_id=E5XD2RNCSIIWQXU7EP5CH4CEWDWSMBWNVYWDXAN272EW7ILMEABA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737510729 (8h12m48.16859086s) [noise=true , address=104.36.82.44:4901 , piece_id=AVYWXB6MOTVI2I24L5TX73HP2JMG7OSKTPCS5IA6UH6V2E6WH3MA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737747323 (8h12m48.168827454s) [noise=true , address=104.36.82.62:4426 , piece_id=HOF546I5A3KDG5W64VG5XGEILX723USDVNQVCWF45267OEQDIFVA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738239114 (8h12m48.169319245s) [noise=true , address=104.36.82.39:4758 , piece_id=SIACF23NXQ7HY5UTQKYNX5KDXAP2RGU54ZMDUEEQQKY6FS3WH4GQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738486266 (8h12m48.169566398s) [noise=true , address=104.36.82.58:4283 , piece_id=T7O2JLWZJVBHXVIVGNBGUL6QXC6JCAQWYTOXSPTUP4VICKEGSYNA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738604021 (8h12m48.169684153s) [noise=true , address=104.36.82.23:4461 , piece_id=SWBVGP66EG5EYXPJ3JG57JMX3FTAO2J5SCC7QJ35H6HQZA3TBMLA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738937710 (8h12m48.170017841s) [noise=true , address=104.36.82.34:4569 , piece_id=HJVF4FQ3SKFBQGX74VYHKFZSOKGZZHJ6TO74JZDHBK2ZCXGMEGCA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738949523 (8h12m48.170029654s) [noise=true , address=104.36.82.4:4826 , piece_id=XTKB77LZXAFWALX5EIT6RBOAN6YRBAU34DRCZHEIKRZFXX4AL2KQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739217254 (8h12m48.170297386s) [noise=true , address=104.36.82.45:4921 , piece_id=PDL3NMTRT4I6JZ7CCW3KS47WONWE6MKDFGXDCJAO3B6VLPKVJSJA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739424962 (8h12m48.170505093s) [noise=true , address=104.36.82.38:4709 , piece_id=4T5H6DJPW6A5VM2ZH6QSAHRURQYZZE2FCOL66TH3H3YLXMIXMBKQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739467102 (8h12m48.170547233s) [noise=true , address=79.127.201.215:4360 , piece_id=V75D2I2YZLMQ4AP7ZMRD2QUZMOKYFCLE6PVZS3XIT7PAIE65J4YA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:54.824240416 (8h12m49.255320548s) [upload=8594]: Next returned nil segment Aug 9 01:38:54.824255545 (8h12m49.255335676s) [upload=8594]: Waiting for error group managing segments... Aug 9 01:38:55.103297282 (8h12m49.534377403s) [noise=true , address=64.49.13.170:4722 , piece_id=EKLLMELUBKVTYVZDSIATIRJPXR5MXKPSUTEYVRT3JQZK2MLBA6AA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.199725688 (8h12m49.630805819s) [noise=true , address=64.49.13.169:4707 , piece_id=6MGMFTU2T5E5POPIU2NLIXJSL2YC7RCBLHYSZRHUPNLHHYYQJM5A, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.651677912 (8h12m50.082758043s) [noise=true , address=79.127.201.215:4360 , piece_id=V75D2I2YZLMQ4AP7ZMRD2QUZMOKYFCLE6PVZS3XIT7PAIE65J4YA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.653425446 (8h12m50.084505577s) [noise=true , address=104.36.82.38:4709 , piece_id=4T5H6DJPW6A5VM2ZH6QSAHRURQYZZE2FCOL66TH3H3YLXMIXMBKQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.706392227 (8h12m50.137472358s) [noise=true , address=104.36.82.43:4868 , piece_id=IOUGWTZN5VBWLUAU4S27ITFBZDXOPDEDD3QPOMS7IZSST5OGHWZQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.721082463 (8h12m50.152162594s) [noise=true , address=104.36.82.34:4569 , piece_id=HJVF4FQ3SKFBQGX74VYHKFZSOKGZZHJ6TO74JZDHBK2ZCXGMEGCA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.758501015 (8h12m50.189581157s) [noise=true , address=104.36.82.23:4461 , piece_id=SWBVGP66EG5EYXPJ3JG57JMX3FTAO2J5SCC7QJ35H6HQZA3TBMLA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.759093319 (8h12m50.19017345s) [noise=true , address=104.36.82.4:4811 , piece_id=E5XD2RNCSIIWQXU7EP5CH4CEWDWSMBWNVYWDXAN272EW7ILMEABA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.759306647 (8h12m50.190386778s) [noise=true , address=104.36.82.62:4426 , piece_id=HOF546I5A3KDG5W64VG5XGEILX723USDVNQVCWF45267OEQDIFVA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.767873919 (8h12m50.19895405s) [noise=true , address=104.36.82.58:4283 , piece_id=T7O2JLWZJVBHXVIVGNBGUL6QXC6JCAQWYTOXSPTUP4VICKEGSYNA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.768509715 (8h12m50.199589846s) [noise=true , address=104.36.82.37:4663 , piece_id=WL57RHO2K6ZKQCHCYAG2HLRA4I5TYBZYIR6Q74JK7KPTC6P5U2GA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.796327909 (8h12m50.22740803s) [noise=true , address=104.36.82.47:4517 , piece_id=AGM27YH5E6IXBJXXXWQPYUG6Y6KQ2EYW2HY4NLBNVHGEUNN3GMZA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.806590574 (8h12m50.237670705s) [noise=true , address=104.36.82.61:4382 , piece_id=B2IT4DO5BHI4RQI5QPPZQEPNLRIR7JH5JKPZW2KZPXYBF5W4U2ZQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.826658520 (8h12m50.257738651s) [noise=true , address=77.90.31.18:4834 , piece_id=4GU4C353M2NDPZJDLLPCRHGX5344G324BXMHUXQESS7PBJU652KA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.826688498 (8h12m50.257768649s) [seg_pos={0 0}, upload=8594]: Segment reached optimal threshold of 14 pieces. Aug 9 01:38:55.826825350 (8h12m50.257905481s) [noise=true , address=104.36.82.39:4758 , piece_id=SIACF23NXQ7HY5UTQKYNX5KDXAP2RGU54ZMDUEEQQKY6FS3WH4GQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XjsLCQGSuQkDmyC4QFENshoLeo4kCZG1YNm34wBvG8UEuxTG7): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.826912055 (8h12m50.257992176s) [noise=true , address=104.36.82.4:4826 , piece_id=XTKB77LZXAFWALX5EIT6RBOAN6YRBAU34DRCZHEIKRZFXX4AL2KQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14hpQXA7AA3CQQ4z8Y81ZTxjY9Bhd1eNCjqEKyandGUHoyi548): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.826962021 (8h12m50.258042152s) [noise=true , address=104.36.82.45:4921 , piece_id=PDL3NMTRT4I6JZ7CCW3KS47WONWE6MKDFGXDCJAO3B6VLPKVJSJA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bBRKXiuSN2cw6KrdP8q4Dsf4MiFCUSgMEGjqG2dKL9RLTQra1): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.827019180 (8h12m50.258099311s) [noise=true , address=104.36.82.44:4901 , piece_id=AVYWXB6MOTVI2I24L5TX73HP2JMG7OSKTPCS5IA6UH6V2E6WH3MA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.827042796 (8h12m50.258122927s) [seg_pos={0 0}, upload=8594]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:38:55.827118901 (8h12m50.258199032s) [upload=8594]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:38:55.827123180 (8h12m50.258203301s) [upload=8594]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:38:56.157513742 (8h12m50.588593873s) [upload=8594]: Done uploading segments... Aug 9 01:38:56.157530954 (8h12m50.588611085s) [upload=8594]: Upload finished. err: <nil> Duration: 6.857620962s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..X............X....................X.X.............X.......] duration: 1.868268836s FAIL (2025-08-09 01:39:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 1.868297991s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [...........X..X............X....X.............X..........X.X] duration: 5.800692493s FAIL (2025-08-09 01:38:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b8192bcbf94a7611fba66f30e1c65b2139344aa7dd4a1271afa1d2cc935d0356 != before 43f6303d3becdd978a3c04b5105702430719f20550c97a23f441ad65112c32d9 ======LOGS====== Aug 9 01:38:53.282599694 (8h12m47.713679825s) [upload=8594]: Starting upload Aug 9 01:38:53.282666933 (8h12m47.713747064s) [upload=8594]: Done starting upload Aug 9 01:38:53.282754600 (8h12m47.713834731s) [upload=8594]: Uploading segments... Aug 9 01:38:53.282896502 (8h12m47.713976633s) [upload=8594]: Got next segment. Inline: false Aug 9 01:38:53.282925367 (8h12m47.714005498s) [upload=8594]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:38:53.282929485 (8h12m47.714009616s) [upload=8594]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:38:53.736052249 (8h12m48.16713238s) [seg_pos={0 0}, upload=8594]: Begin upload segment... Aug 9 01:38:53.736131220 (8h12m48.167211351s) [seg_pos={0 0}, upload=8594]: Done begin upload segment. Aug 9 01:38:53.736151099 (8h12m48.16723123s) [noise=true , address=104.36.82.43:4868 , piece_id=IOUGWTZN5VBWLUAU4S27ITFBZDXOPDEDD3QPOMS7IZSST5OGHWZQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736187889 (8h12m48.16726802s) [noise=true , address=104.36.82.61:4382 , piece_id=B2IT4DO5BHI4RQI5QPPZQEPNLRIR7JH5JKPZW2KZPXYBF5W4U2ZQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736481170 (8h12m48.167561301s) [noise=true , address=104.36.82.47:4517 , piece_id=AGM27YH5E6IXBJXXXWQPYUG6Y6KQ2EYW2HY4NLBNVHGEUNN3GMZA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736529152 (8h12m48.167609283s) [noise=true , address=77.90.31.18:4834 , piece_id=4GU4C353M2NDPZJDLLPCRHGX5344G324BXMHUXQESS7PBJU652KA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736699047 (8h12m48.167779168s) [noise=true , address=64.49.13.170:4722 , piece_id=EKLLMELUBKVTYVZDSIATIRJPXR5MXKPSUTEYVRT3JQZK2MLBA6AA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.736926472 (8h12m48.168006593s) [noise=true , address=64.49.13.169:4707 , piece_id=6MGMFTU2T5E5POPIU2NLIXJSL2YC7RCBLHYSZRHUPNLHHYYQJM5A, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737131784 (8h12m48.168211915s) [noise=true , address=104.36.82.37:4663 , piece_id=WL57RHO2K6ZKQCHCYAG2HLRA4I5TYBZYIR6Q74JK7KPTC6P5U2GA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737363017 (8h12m48.168443148s) [noise=true , address=104.36.82.4:4811 , piece_id=E5XD2RNCSIIWQXU7EP5CH4CEWDWSMBWNVYWDXAN272EW7ILMEABA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737510729 (8h12m48.16859086s) [noise=true , address=104.36.82.44:4901 , piece_id=AVYWXB6MOTVI2I24L5TX73HP2JMG7OSKTPCS5IA6UH6V2E6WH3MA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.737747323 (8h12m48.168827454s) [noise=true , address=104.36.82.62:4426 , piece_id=HOF546I5A3KDG5W64VG5XGEILX723USDVNQVCWF45267OEQDIFVA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738239114 (8h12m48.169319245s) [noise=true , address=104.36.82.39:4758 , piece_id=SIACF23NXQ7HY5UTQKYNX5KDXAP2RGU54ZMDUEEQQKY6FS3WH4GQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738486266 (8h12m48.169566398s) [noise=true , address=104.36.82.58:4283 , piece_id=T7O2JLWZJVBHXVIVGNBGUL6QXC6JCAQWYTOXSPTUP4VICKEGSYNA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738604021 (8h12m48.169684153s) [noise=true , address=104.36.82.23:4461 , piece_id=SWBVGP66EG5EYXPJ3JG57JMX3FTAO2J5SCC7QJ35H6HQZA3TBMLA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738937710 (8h12m48.170017841s) [noise=true , address=104.36.82.34:4569 , piece_id=HJVF4FQ3SKFBQGX74VYHKFZSOKGZZHJ6TO74JZDHBK2ZCXGMEGCA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.738949523 (8h12m48.170029654s) [noise=true , address=104.36.82.4:4826 , piece_id=XTKB77LZXAFWALX5EIT6RBOAN6YRBAU34DRCZHEIKRZFXX4AL2KQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739217254 (8h12m48.170297386s) [noise=true , address=104.36.82.45:4921 , piece_id=PDL3NMTRT4I6JZ7CCW3KS47WONWE6MKDFGXDCJAO3B6VLPKVJSJA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739424962 (8h12m48.170505093s) [noise=true , address=104.36.82.38:4709 , piece_id=4T5H6DJPW6A5VM2ZH6QSAHRURQYZZE2FCOL66TH3H3YLXMIXMBKQ, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:53.739467102 (8h12m48.170547233s) [noise=true , address=79.127.201.215:4360 , piece_id=V75D2I2YZLMQ4AP7ZMRD2QUZMOKYFCLE6PVZS3XIT7PAIE65J4YA, seg_pos={0 0}, upload=8594]: Uploading piece... Aug 9 01:38:54.824240416 (8h12m49.255320548s) [upload=8594]: Next returned nil segment Aug 9 01:38:54.824255545 (8h12m49.255335676s) [upload=8594]: Waiting for error group managing segments... Aug 9 01:38:55.103297282 (8h12m49.534377403s) [noise=true , address=64.49.13.170:4722 , piece_id=EKLLMELUBKVTYVZDSIATIRJPXR5MXKPSUTEYVRT3JQZK2MLBA6AA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.199725688 (8h12m49.630805819s) [noise=true , address=64.49.13.169:4707 , piece_id=6MGMFTU2T5E5POPIU2NLIXJSL2YC7RCBLHYSZRHUPNLHHYYQJM5A, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.651677912 (8h12m50.082758043s) [noise=true , address=79.127.201.215:4360 , piece_id=V75D2I2YZLMQ4AP7ZMRD2QUZMOKYFCLE6PVZS3XIT7PAIE65J4YA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.653425446 (8h12m50.084505577s) [noise=true , address=104.36.82.38:4709 , piece_id=4T5H6DJPW6A5VM2ZH6QSAHRURQYZZE2FCOL66TH3H3YLXMIXMBKQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.706392227 (8h12m50.137472358s) [noise=true , address=104.36.82.43:4868 , piece_id=IOUGWTZN5VBWLUAU4S27ITFBZDXOPDEDD3QPOMS7IZSST5OGHWZQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.721082463 (8h12m50.152162594s) [noise=true , address=104.36.82.34:4569 , piece_id=HJVF4FQ3SKFBQGX74VYHKFZSOKGZZHJ6TO74JZDHBK2ZCXGMEGCA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.758501015 (8h12m50.189581157s) [noise=true , address=104.36.82.23:4461 , piece_id=SWBVGP66EG5EYXPJ3JG57JMX3FTAO2J5SCC7QJ35H6HQZA3TBMLA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.759093319 (8h12m50.19017345s) [noise=true , address=104.36.82.4:4811 , piece_id=E5XD2RNCSIIWQXU7EP5CH4CEWDWSMBWNVYWDXAN272EW7ILMEABA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.759306647 (8h12m50.190386778s) [noise=true , address=104.36.82.62:4426 , piece_id=HOF546I5A3KDG5W64VG5XGEILX723USDVNQVCWF45267OEQDIFVA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.767873919 (8h12m50.19895405s) [noise=true , address=104.36.82.58:4283 , piece_id=T7O2JLWZJVBHXVIVGNBGUL6QXC6JCAQWYTOXSPTUP4VICKEGSYNA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.768509715 (8h12m50.199589846s) [noise=true , address=104.36.82.37:4663 , piece_id=WL57RHO2K6ZKQCHCYAG2HLRA4I5TYBZYIR6Q74JK7KPTC6P5U2GA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.796327909 (8h12m50.22740803s) [noise=true , address=104.36.82.47:4517 , piece_id=AGM27YH5E6IXBJXXXWQPYUG6Y6KQ2EYW2HY4NLBNVHGEUNN3GMZA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.806590574 (8h12m50.237670705s) [noise=true , address=104.36.82.61:4382 , piece_id=B2IT4DO5BHI4RQI5QPPZQEPNLRIR7JH5JKPZW2KZPXYBF5W4U2ZQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.826658520 (8h12m50.257738651s) [noise=true , address=77.90.31.18:4834 , piece_id=4GU4C353M2NDPZJDLLPCRHGX5344G324BXMHUXQESS7PBJU652KA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: <nil> Aug 9 01:38:55.826688498 (8h12m50.257768649s) [seg_pos={0 0}, upload=8594]: Segment reached optimal threshold of 14 pieces. Aug 9 01:38:55.826825350 (8h12m50.257905481s) [noise=true , address=104.36.82.39:4758 , piece_id=SIACF23NXQ7HY5UTQKYNX5KDXAP2RGU54ZMDUEEQQKY6FS3WH4GQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XjsLCQGSuQkDmyC4QFENshoLeo4kCZG1YNm34wBvG8UEuxTG7): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.826912055 (8h12m50.257992176s) [noise=true , address=104.36.82.4:4826 , piece_id=XTKB77LZXAFWALX5EIT6RBOAN6YRBAU34DRCZHEIKRZFXX4AL2KQ, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14hpQXA7AA3CQQ4z8Y81ZTxjY9Bhd1eNCjqEKyandGUHoyi548): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.826962021 (8h12m50.258042152s) [noise=true , address=104.36.82.45:4921 , piece_id=PDL3NMTRT4I6JZ7CCW3KS47WONWE6MKDFGXDCJAO3B6VLPKVJSJA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bBRKXiuSN2cw6KrdP8q4Dsf4MiFCUSgMEGjqG2dKL9RLTQra1): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.827019180 (8h12m50.258099311s) [noise=true , address=104.36.82.44:4901 , piece_id=AVYWXB6MOTVI2I24L5TX73HP2JMG7OSKTPCS5IA6UH6V2E6WH3MA, seg_pos={0 0}, upload=8594]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 9 01:38:55.827042796 (8h12m50.258122927s) [seg_pos={0 0}, upload=8594]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:38:55.827118901 (8h12m50.258199032s) [upload=8594]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:38:55.827123180 (8h12m50.258203301s) [upload=8594]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:38:56.157513742 (8h12m50.588593873s) [upload=8594]: Done uploading segments... Aug 9 01:38:56.157530954 (8h12m50.588611085s) [upload=8594]: Upload finished. err: <nil> Duration: 5.800713554s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [............X..X............X....X.............X..........X.] duration: 5.942400872s FAIL (2025-08-09 01:38:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:37:16.288949729 (8h11m10.72002986s) [upload=8565]: Starting upload Aug 9 01:37:16.289010275 (8h11m10.720090396s) [upload=8565]: Done starting upload Aug 9 01:37:16.289125055 (8h11m10.720205186s) [upload=8565]: Uploading segments... Aug 9 01:37:16.289188847 (8h11m10.720268978s) [upload=8565]: Got next segment. Inline: false Aug 9 01:37:16.289228322 (8h11m10.720308453s) [upload=8565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:37:16.289234454 (8h11m10.720314585s) [upload=8565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:37:16.526207832 (8h11m10.957287963s) [upload=8565]: Next segment err: metaclient: Too Many Requests Aug 9 01:37:16.526234483 (8h11m10.957314614s) [upload=8565]: Done uploading segments... Aug 9 01:37:16.526249102 (8h11m10.957329223s) [upload=8565]: Upload finished. err: metaclient: Too Many Requests Duration: 5.942426572s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...X............X....................X.X.............X......] duration: 2.037166165s FAIL (2025-08-09 01:38:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 2.037207684s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....X............X....................X.X.............X.....] duration: 1.989608935s FAIL (2025-08-09 01:37:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 1.989636478s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.............X..X............X....X.............X..........X] duration: 882.401648ms FAIL (2025-08-09 01:37:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:37:16.288949729 (8h11m10.72002986s) [upload=8565]: Starting upload Aug 9 01:37:16.289010275 (8h11m10.720090396s) [upload=8565]: Done starting upload Aug 9 01:37:16.289125055 (8h11m10.720205186s) [upload=8565]: Uploading segments... Aug 9 01:37:16.289188847 (8h11m10.720268978s) [upload=8565]: Got next segment. Inline: false Aug 9 01:37:16.289228322 (8h11m10.720308453s) [upload=8565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:37:16.289234454 (8h11m10.720314585s) [upload=8565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:37:16.526207832 (8h11m10.957287963s) [upload=8565]: Next segment err: metaclient: Too Many Requests Aug 9 01:37:16.526234483 (8h11m10.957314614s) [upload=8565]: Done uploading segments... Aug 9 01:37:16.526249102 (8h11m10.957329223s) [upload=8565]: Upload finished. err: metaclient: Too Many Requests Duration: 882.426236ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............X..X............X....X.............X..........] duration: 6.095715056s FAIL (2025-08-09 01:36:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 6.095736399s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....X............X....................X.X.............X....] duration: 1.904932234s FAIL (2025-08-09 01:36:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 1.904958634s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......X............X....................X.X.............X...] duration: 1.835655347s FAIL (2025-08-09 01:36:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 1.835682861s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......X............X....................X.X.............X..] duration: 1.884986381s FAIL (2025-08-09 01:36:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 1.885004065s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............X..X............X....X.............X.........] duration: 5.763337092s FAIL (2025-08-09 01:35:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 5.763368542s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........X............X....................X.X.............X.] duration: 1.889858043s FAIL (2025-08-09 01:35:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 1.889889694s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [................X..X............X....X.............X........] duration: 6.141537337s FAIL (2025-08-09 01:34:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 6.14156469s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X............X....................X.X.............X] duration: 1.401515213s FAIL (2025-08-09 01:34:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 01:34:33.045768922 (8h8m27.476849053s) [upload=8516]: Starting upload Aug 9 01:34:33.045848815 (8h8m27.476928946s) [upload=8516]: Done starting upload Aug 9 01:34:33.045990106 (8h8m27.477070237s) [upload=8516]: Uploading segments... Aug 9 01:34:33.046036865 (8h8m27.477116986s) [upload=8516]: Got next segment. Inline: true Aug 9 01:34:33.046053787 (8h8m27.477133918s) [upload=8516]: Waiting for error group managing segments... Aug 9 01:34:33.046092462 (8h8m27.477172593s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:34:33.046104544 (8h8m27.477184705s) [upload=8516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:33.046110576 (8h8m27.477190757s) [upload=8516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.337544953 (8h8m27.768625114s) [upload=8516]: Done uploading segments... Aug 9 01:34:33.337568498 (8h8m27.768648639s) [upload=8516]: Upload finished. err: <nil> Duration:* 1.401538837s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X.........X............X....................X.X.............] duration: 1.911616482s FAIL (2025-08-09 01:34:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.911642831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.................X..X............X....X.............X.......] duration: 6.076426661s FAIL (2025-08-09 01:33:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 6.076458853s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X.........X............X....................X.X............] duration: 1.907248306s FAIL (2025-08-09 01:33:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.907274956s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X.................X..X............X....X.............X......] duration: 6.139383437s FAIL (2025-08-09 01:33:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 6.139423744s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..X.........X............X....................X.X...........] duration: 1.929470793s FAIL (2025-08-09 01:33:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.929515748s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X.................X..X............X....X.............X.....] duration: 6.108250021s FAIL (2025-08-09 01:32:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 6.10827597s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...X.........X............X....................X.X..........] duration: 1.851756502s FAIL (2025-08-09 01:32:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.851786961s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..X.................X..X............X....X.............X....] duration: 5.839946367s FAIL (2025-08-09 01:32:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 5.839974s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....X.........X............X....................X.X.........] duration: 1.892877258s FAIL (2025-08-09 01:31:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.892906004s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....X.........X............X....................X.X........] duration: 1.885835086s FAIL (2025-08-09 01:31:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.885866094s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...X.................X..X............X....X.............X...] duration: 5.835805034s FAIL (2025-08-09 01:31:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 5.835833769s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......X.........X............X....................X.X.......] duration: 1.858729736s FAIL (2025-08-09 01:30:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.858755083s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [X...X.................X..X............X....X.............X..] duration: 6.051016033s FAIL (2025-08-09 01:30:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 6.051042283s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......X.........X............X....................X.X......] duration: 1.884943409s FAIL (2025-08-09 01:30:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.884974619s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.X...X.................X..X............X....X.............X.] duration: 5.901259337s FAIL (2025-08-09 01:30:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 5.901376502s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..X...X.................X..X............X....X.............X] duration: 859.063255ms FAIL (2025-08-09 01:29:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:29:07.808840060 (8h3m2.239920191s) [upload=8417]: Starting upload Aug 9 01:29:07.808910826 (8h3m2.239990957s) [upload=8417]: Done starting upload Aug 9 01:29:07.809116759 (8h3m2.2401969s) [upload=8417]: Uploading segments... Aug 9 01:29:07.809271566 (8h3m2.240351697s) [upload=8417]: Got next segment. Inline: false Aug 9 01:29:07.809327222 (8h3m2.240407363s) [upload=8417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:29:07.809334536 (8h3m2.240414707s) [upload=8417]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:29:08.022290151 (8h3m2.453370282s) [upload=8417]: Next segment err: metaclient: Too Many Requests Aug 9 01:29:08.022313065 (8h3m2.453393196s) [upload=8417]: Done uploading segments... Aug 9 01:29:08.022326300 (8h3m2.453406431s) [upload=8417]: Upload finished. err: metaclient: Too Many Requests Duration: 859.082142ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........X.........X............X....................X.X.....] duration: 2.060560796s FAIL (2025-08-09 01:29:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 2.060582056s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X.........X............X....................X.X....] duration: 1.82015951s FAIL (2025-08-09 01:28:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.82018558s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...X...X.................X..X............X....X.............] duration: 5.701828958s FAIL (2025-08-09 01:28:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:17:24.837360944 (7h51m19.268441075s) [upload=8215]: Starting upload Aug 9 01:17:24.837406240 (7h51m19.268486371s) [upload=8215]: Done starting upload Aug 9 01:17:24.837455224 (7h51m19.268535355s) [upload=8215]: Uploading segments... Aug 9 01:17:24.837640268 (7h51m19.268720399s) [upload=8215]: Got next segment. Inline: false Aug 9 01:17:24.837669003 (7h51m19.268749134s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:17:24.837673111 (7h51m19.268753232s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:17:25.297265302 (7h51m19.728345434s) [seg_pos={0 0}, upload=8215]: Begin upload segment... Aug 9 01:17:25.297315028 (7h51m19.728395149s) [seg_pos={0 0}, upload=8215]: Done begin upload segment. Aug 9 01:17:25.297328673 (7h51m19.728408804s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297339535 (7h51m19.728419666s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297686037 (7h51m19.728766158s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297709111 (7h51m19.728789243s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297989047 (7h51m19.729069178s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298009546 (7h51m19.729089687s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298246079 (7h51m19.72932621s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298487441 (7h51m19.729567572s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298704376 (7h51m19.729784507s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298915460 (7h51m19.729995591s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299003258 (7h51m19.730083389s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299240482 (7h51m19.730320613s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299463779 (7h51m19.73054392s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299676266 (7h51m19.730756397s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299700121 (7h51m19.730780253s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300017368 (7h51m19.731097499s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300317663 (7h51m19.731397794s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300429627 (7h51m19.731509758s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:26.411822782 (7h51m20.842902923s) [upload=8215]: Next returned nil segment Aug 9 01:17:26.411843291 (7h51m20.842923422s) [upload=8215]: Waiting for error group managing segments... Aug 9 01:17:26.704138476 (7h51m21.135218607s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.238612379 (7h51m21.66969251s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.258591254 (7h51m21.689671385s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.278592011 (7h51m21.709672142s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.290626396 (7h51m21.721706547s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.343461836 (7h51m21.774541967s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.347287756 (7h51m21.778367887s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.362912350 (7h51m21.793992531s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.379894121 (7h51m21.810974252s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.456679203 (7h51m21.887759334s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.464705400 (7h51m21.895785531s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.494136841 (7h51m21.925216972s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.587420599 (7h51m22.01850073s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677114379 (7h51m22.10819451s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677136662 (7h51m22.108216793s) [seg_pos={0 0}, upload=8215]: Segment reached optimal threshold of 14 pieces. Aug 9 01:17:27.677301908 (7h51m22.108382039s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY): protocol: expected piece hash; context canceled; EOF Aug 9 01:17:27.677377312 (7h51m22.108457443s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection Aug 9 01:17:27.677394935 (7h51m22.108475056s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection Aug 9 01:17:27.677425464 (7h51m22.108505595s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection Aug 9 01:17:27.677437758 (7h51m22.108517889s) [seg_pos={0 0}, upload=8215]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:17:27.677536947 (7h51m22.108617078s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:17:27.677541246 (7h51m22.108621377s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:17:28.000331767 (7h51m22.431411948s) [upload=8215]: Done uploading segments... Aug 9 01:17:28.000353929 (7h51m22.43143409s) [upload=8215]: Upload finished. err: <nil> Duration: 5.701864056s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........X.........X............X....................X.X...] duration: 1.849753249s FAIL (2025-08-09 01:27:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.84977949s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [....X...X.................X..X............X....X............] duration: 5.656862064s FAIL (2025-08-09 01:27:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:17:24.837360944 (7h51m19.268441075s) [upload=8215]: Starting upload Aug 9 01:17:24.837406240 (7h51m19.268486371s) [upload=8215]: Done starting upload Aug 9 01:17:24.837455224 (7h51m19.268535355s) [upload=8215]: Uploading segments... Aug 9 01:17:24.837640268 (7h51m19.268720399s) [upload=8215]: Got next segment. Inline: false Aug 9 01:17:24.837669003 (7h51m19.268749134s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:17:24.837673111 (7h51m19.268753232s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:17:25.297265302 (7h51m19.728345434s) [seg_pos={0 0}, upload=8215]: Begin upload segment... Aug 9 01:17:25.297315028 (7h51m19.728395149s) [seg_pos={0 0}, upload=8215]: Done begin upload segment. Aug 9 01:17:25.297328673 (7h51m19.728408804s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297339535 (7h51m19.728419666s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297686037 (7h51m19.728766158s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297709111 (7h51m19.728789243s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297989047 (7h51m19.729069178s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298009546 (7h51m19.729089687s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298246079 (7h51m19.72932621s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298487441 (7h51m19.729567572s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298704376 (7h51m19.729784507s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298915460 (7h51m19.729995591s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299003258 (7h51m19.730083389s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299240482 (7h51m19.730320613s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299463779 (7h51m19.73054392s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299676266 (7h51m19.730756397s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299700121 (7h51m19.730780253s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300017368 (7h51m19.731097499s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300317663 (7h51m19.731397794s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300429627 (7h51m19.731509758s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:26.411822782 (7h51m20.842902923s) [upload=8215]: Next returned nil segment Aug 9 01:17:26.411843291 (7h51m20.842923422s) [upload=8215]: Waiting for error group managing segments... Aug 9 01:17:26.704138476 (7h51m21.135218607s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.238612379 (7h51m21.66969251s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.258591254 (7h51m21.689671385s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.278592011 (7h51m21.709672142s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.290626396 (7h51m21.721706547s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.343461836 (7h51m21.774541967s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.347287756 (7h51m21.778367887s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.362912350 (7h51m21.793992531s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.379894121 (7h51m21.810974252s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.456679203 (7h51m21.887759334s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.464705400 (7h51m21.895785531s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.494136841 (7h51m21.925216972s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.587420599 (7h51m22.01850073s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677114379 (7h51m22.10819451s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677136662 (7h51m22.108216793s) [seg_pos={0 0}, upload=8215]: Segment reached optimal threshold of 14 pieces. Aug 9 01:17:27.677301908 (7h51m22.108382039s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY): protocol: expected piece hash; context canceled; EOF Aug 9 01:17:27.677377312 (7h51m22.108457443s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection Aug 9 01:17:27.677394935 (7h51m22.108475056s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection Aug 9 01:17:27.677425464 (7h51m22.108505595s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection Aug 9 01:17:27.677437758 (7h51m22.108517889s) [seg_pos={0 0}, upload=8215]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:17:27.677536947 (7h51m22.108617078s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:17:27.677541246 (7h51m22.108621377s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:17:28.000331767 (7h51m22.431411948s) [upload=8215]: Done uploading segments... Aug 9 01:17:28.000353929 (7h51m22.43143409s) [upload=8215]: Upload finished. err: <nil> Duration: 5.656908393s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........X.........X............X....................X.X..] duration: 2.067428869s FAIL (2025-08-09 01:27:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 2.067466991s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............X.........X............X....................X.X.] duration: 2.041976108s FAIL (2025-08-09 01:26:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 2.042000495s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.....X...X.................X..X............X....X...........] duration: 5.942334107s FAIL (2025-08-09 01:26:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:17:24.837360944 (7h51m19.268441075s) [upload=8215]: Starting upload Aug 9 01:17:24.837406240 (7h51m19.268486371s) [upload=8215]: Done starting upload Aug 9 01:17:24.837455224 (7h51m19.268535355s) [upload=8215]: Uploading segments... Aug 9 01:17:24.837640268 (7h51m19.268720399s) [upload=8215]: Got next segment. Inline: false Aug 9 01:17:24.837669003 (7h51m19.268749134s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:17:24.837673111 (7h51m19.268753232s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:17:25.297265302 (7h51m19.728345434s) [seg_pos={0 0}, upload=8215]: Begin upload segment... Aug 9 01:17:25.297315028 (7h51m19.728395149s) [seg_pos={0 0}, upload=8215]: Done begin upload segment. Aug 9 01:17:25.297328673 (7h51m19.728408804s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297339535 (7h51m19.728419666s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297686037 (7h51m19.728766158s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297709111 (7h51m19.728789243s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297989047 (7h51m19.729069178s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298009546 (7h51m19.729089687s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298246079 (7h51m19.72932621s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298487441 (7h51m19.729567572s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298704376 (7h51m19.729784507s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298915460 (7h51m19.729995591s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299003258 (7h51m19.730083389s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299240482 (7h51m19.730320613s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299463779 (7h51m19.73054392s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299676266 (7h51m19.730756397s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299700121 (7h51m19.730780253s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300017368 (7h51m19.731097499s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300317663 (7h51m19.731397794s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300429627 (7h51m19.731509758s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:26.411822782 (7h51m20.842902923s) [upload=8215]: Next returned nil segment Aug 9 01:17:26.411843291 (7h51m20.842923422s) [upload=8215]: Waiting for error group managing segments... Aug 9 01:17:26.704138476 (7h51m21.135218607s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.238612379 (7h51m21.66969251s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.258591254 (7h51m21.689671385s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.278592011 (7h51m21.709672142s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.290626396 (7h51m21.721706547s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.343461836 (7h51m21.774541967s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.347287756 (7h51m21.778367887s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.362912350 (7h51m21.793992531s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.379894121 (7h51m21.810974252s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.456679203 (7h51m21.887759334s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.464705400 (7h51m21.895785531s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.494136841 (7h51m21.925216972s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.587420599 (7h51m22.01850073s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677114379 (7h51m22.10819451s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677136662 (7h51m22.108216793s) [seg_pos={0 0}, upload=8215]: Segment reached optimal threshold of 14 pieces. Aug 9 01:17:27.677301908 (7h51m22.108382039s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY): protocol: expected piece hash; context canceled; EOF Aug 9 01:17:27.677377312 (7h51m22.108457443s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection Aug 9 01:17:27.677394935 (7h51m22.108475056s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection Aug 9 01:17:27.677425464 (7h51m22.108505595s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection Aug 9 01:17:27.677437758 (7h51m22.108517889s) [seg_pos={0 0}, upload=8215]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:17:27.677536947 (7h51m22.108617078s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:17:27.677541246 (7h51m22.108621377s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:17:28.000331767 (7h51m22.431411948s) [upload=8215]: Done uploading segments... Aug 9 01:17:28.000353929 (7h51m22.43143409s) [upload=8215]: Upload finished. err: <nil> Duration: 5.942362752s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [......X...X.................X..X............X....X..........] duration: 6.147794141s FAIL (2025-08-09 01:26:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:17:24.837360944 (7h51m19.268441075s) [upload=8215]: Starting upload Aug 9 01:17:24.837406240 (7h51m19.268486371s) [upload=8215]: Done starting upload Aug 9 01:17:24.837455224 (7h51m19.268535355s) [upload=8215]: Uploading segments... Aug 9 01:17:24.837640268 (7h51m19.268720399s) [upload=8215]: Got next segment. Inline: false Aug 9 01:17:24.837669003 (7h51m19.268749134s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:17:24.837673111 (7h51m19.268753232s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:17:25.297265302 (7h51m19.728345434s) [seg_pos={0 0}, upload=8215]: Begin upload segment... Aug 9 01:17:25.297315028 (7h51m19.728395149s) [seg_pos={0 0}, upload=8215]: Done begin upload segment. Aug 9 01:17:25.297328673 (7h51m19.728408804s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297339535 (7h51m19.728419666s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297686037 (7h51m19.728766158s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297709111 (7h51m19.728789243s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297989047 (7h51m19.729069178s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298009546 (7h51m19.729089687s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298246079 (7h51m19.72932621s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298487441 (7h51m19.729567572s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298704376 (7h51m19.729784507s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298915460 (7h51m19.729995591s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299003258 (7h51m19.730083389s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299240482 (7h51m19.730320613s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299463779 (7h51m19.73054392s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299676266 (7h51m19.730756397s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299700121 (7h51m19.730780253s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300017368 (7h51m19.731097499s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300317663 (7h51m19.731397794s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300429627 (7h51m19.731509758s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:26.411822782 (7h51m20.842902923s) [upload=8215]: Next returned nil segment Aug 9 01:17:26.411843291 (7h51m20.842923422s) [upload=8215]: Waiting for error group managing segments... Aug 9 01:17:26.704138476 (7h51m21.135218607s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.238612379 (7h51m21.66969251s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.258591254 (7h51m21.689671385s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.278592011 (7h51m21.709672142s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.290626396 (7h51m21.721706547s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.343461836 (7h51m21.774541967s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.347287756 (7h51m21.778367887s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.362912350 (7h51m21.793992531s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.379894121 (7h51m21.810974252s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.456679203 (7h51m21.887759334s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.464705400 (7h51m21.895785531s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.494136841 (7h51m21.925216972s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.587420599 (7h51m22.01850073s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677114379 (7h51m22.10819451s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677136662 (7h51m22.108216793s) [seg_pos={0 0}, upload=8215]: Segment reached optimal threshold of 14 pieces. Aug 9 01:17:27.677301908 (7h51m22.108382039s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY): protocol: expected piece hash; context canceled; EOF Aug 9 01:17:27.677377312 (7h51m22.108457443s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection Aug 9 01:17:27.677394935 (7h51m22.108475056s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection Aug 9 01:17:27.677425464 (7h51m22.108505595s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection Aug 9 01:17:27.677437758 (7h51m22.108517889s) [seg_pos={0 0}, upload=8215]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:17:27.677536947 (7h51m22.108617078s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:17:27.677541246 (7h51m22.108621377s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:17:28.000331767 (7h51m22.431411948s) [upload=8215]: Done uploading segments... Aug 9 01:17:28.000353929 (7h51m22.43143409s) [upload=8215]: Upload finished. err: <nil> Duration: 6.147819388s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............X.........X............X....................X.X] duration: 1.973085712s FAIL (2025-08-09 01:25:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a19a5a49706ed164155ed0029ea7f2c78893b555e900ef725d3aef9f34f94b5a != before 36608a66798abcc2c3dba5027d9a0237d65071767be32fee0c9a080c168467b4 ======LOGS====== Aug 9 01:25:31.920371564 (7h59m26.351451695s) [upload=8354]: Starting upload Aug 9 01:25:31.920414967 (7h59m26.351495098s) [upload=8354]: Done starting upload Aug 9 01:25:31.920508546 (7h59m26.351588677s) [upload=8354]: Uploading segments... Aug 9 01:25:31.920571696 (7h59m26.351651847s) [upload=8354]: Got next segment. Inline: true Aug 9 01:25:31.920578400 (7h59m26.351658571s) [upload=8354]: Waiting for error group managing segments... Aug 9 01:25:31.920641210 (7h59m26.351721341s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:25:31.920646950 (7h59m26.351727082s) [upload=8354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:25:31.920649626 (7h59m26.351729757s) [upload=8354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:25:32.525668552 (7h59m26.956748683s) [upload=8354]: Done uploading segments... Aug 9 01:25:32.525877120 (7h59m26.956957251s) [upload=8354]: Upload finished. err: <nil> Duration:* 1.973111129s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.......X...X.................X..X............X....X.........] duration: 5.875275272s FAIL (2025-08-09 01:25:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:17:24.837360944 (7h51m19.268441075s) [upload=8215]: Starting upload Aug 9 01:17:24.837406240 (7h51m19.268486371s) [upload=8215]: Done starting upload Aug 9 01:17:24.837455224 (7h51m19.268535355s) [upload=8215]: Uploading segments... Aug 9 01:17:24.837640268 (7h51m19.268720399s) [upload=8215]: Got next segment. Inline: false Aug 9 01:17:24.837669003 (7h51m19.268749134s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:17:24.837673111 (7h51m19.268753232s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:17:25.297265302 (7h51m19.728345434s) [seg_pos={0 0}, upload=8215]: Begin upload segment... Aug 9 01:17:25.297315028 (7h51m19.728395149s) [seg_pos={0 0}, upload=8215]: Done begin upload segment. Aug 9 01:17:25.297328673 (7h51m19.728408804s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297339535 (7h51m19.728419666s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297686037 (7h51m19.728766158s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297709111 (7h51m19.728789243s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297989047 (7h51m19.729069178s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298009546 (7h51m19.729089687s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298246079 (7h51m19.72932621s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298487441 (7h51m19.729567572s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298704376 (7h51m19.729784507s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298915460 (7h51m19.729995591s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299003258 (7h51m19.730083389s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299240482 (7h51m19.730320613s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299463779 (7h51m19.73054392s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299676266 (7h51m19.730756397s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299700121 (7h51m19.730780253s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300017368 (7h51m19.731097499s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300317663 (7h51m19.731397794s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300429627 (7h51m19.731509758s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:26.411822782 (7h51m20.842902923s) [upload=8215]: Next returned nil segment Aug 9 01:17:26.411843291 (7h51m20.842923422s) [upload=8215]: Waiting for error group managing segments... Aug 9 01:17:26.704138476 (7h51m21.135218607s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.238612379 (7h51m21.66969251s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.258591254 (7h51m21.689671385s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.278592011 (7h51m21.709672142s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.290626396 (7h51m21.721706547s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.343461836 (7h51m21.774541967s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.347287756 (7h51m21.778367887s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.362912350 (7h51m21.793992531s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.379894121 (7h51m21.810974252s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.456679203 (7h51m21.887759334s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.464705400 (7h51m21.895785531s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.494136841 (7h51m21.925216972s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.587420599 (7h51m22.01850073s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677114379 (7h51m22.10819451s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677136662 (7h51m22.108216793s) [seg_pos={0 0}, upload=8215]: Segment reached optimal threshold of 14 pieces. Aug 9 01:17:27.677301908 (7h51m22.108382039s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY): protocol: expected piece hash; context canceled; EOF Aug 9 01:17:27.677377312 (7h51m22.108457443s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection Aug 9 01:17:27.677394935 (7h51m22.108475056s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection Aug 9 01:17:27.677425464 (7h51m22.108505595s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection Aug 9 01:17:27.677437758 (7h51m22.108517889s) [seg_pos={0 0}, upload=8215]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:17:27.677536947 (7h51m22.108617078s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:17:27.677541246 (7h51m22.108621377s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:17:28.000331767 (7h51m22.431411948s) [upload=8215]: Done uploading segments... Aug 9 01:17:28.000353929 (7h51m22.43143409s) [upload=8215]: Upload finished. err: <nil> Duration: 5.875302024s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [........X...X.................X..X............X....X........] duration: 6.238273234s FAIL (2025-08-09 01:24:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:17:24.837360944 (7h51m19.268441075s) [upload=8215]: Starting upload Aug 9 01:17:24.837406240 (7h51m19.268486371s) [upload=8215]: Done starting upload Aug 9 01:17:24.837455224 (7h51m19.268535355s) [upload=8215]: Uploading segments... Aug 9 01:17:24.837640268 (7h51m19.268720399s) [upload=8215]: Got next segment. Inline: false Aug 9 01:17:24.837669003 (7h51m19.268749134s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:17:24.837673111 (7h51m19.268753232s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:17:25.297265302 (7h51m19.728345434s) [seg_pos={0 0}, upload=8215]: Begin upload segment... Aug 9 01:17:25.297315028 (7h51m19.728395149s) [seg_pos={0 0}, upload=8215]: Done begin upload segment. Aug 9 01:17:25.297328673 (7h51m19.728408804s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297339535 (7h51m19.728419666s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297686037 (7h51m19.728766158s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297709111 (7h51m19.728789243s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297989047 (7h51m19.729069178s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298009546 (7h51m19.729089687s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298246079 (7h51m19.72932621s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298487441 (7h51m19.729567572s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298704376 (7h51m19.729784507s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298915460 (7h51m19.729995591s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299003258 (7h51m19.730083389s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299240482 (7h51m19.730320613s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299463779 (7h51m19.73054392s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299676266 (7h51m19.730756397s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299700121 (7h51m19.730780253s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300017368 (7h51m19.731097499s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300317663 (7h51m19.731397794s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300429627 (7h51m19.731509758s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:26.411822782 (7h51m20.842902923s) [upload=8215]: Next returned nil segment Aug 9 01:17:26.411843291 (7h51m20.842923422s) [upload=8215]: Waiting for error group managing segments... Aug 9 01:17:26.704138476 (7h51m21.135218607s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.238612379 (7h51m21.66969251s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.258591254 (7h51m21.689671385s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.278592011 (7h51m21.709672142s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.290626396 (7h51m21.721706547s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.343461836 (7h51m21.774541967s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.347287756 (7h51m21.778367887s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.362912350 (7h51m21.793992531s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.379894121 (7h51m21.810974252s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.456679203 (7h51m21.887759334s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.464705400 (7h51m21.895785531s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.494136841 (7h51m21.925216972s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.587420599 (7h51m22.01850073s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677114379 (7h51m22.10819451s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677136662 (7h51m22.108216793s) [seg_pos={0 0}, upload=8215]: Segment reached optimal threshold of 14 pieces. Aug 9 01:17:27.677301908 (7h51m22.108382039s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY): protocol: expected piece hash; context canceled; EOF Aug 9 01:17:27.677377312 (7h51m22.108457443s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection Aug 9 01:17:27.677394935 (7h51m22.108475056s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection Aug 9 01:17:27.677425464 (7h51m22.108505595s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection Aug 9 01:17:27.677437758 (7h51m22.108517889s) [seg_pos={0 0}, upload=8215]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:17:27.677536947 (7h51m22.108617078s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:17:27.677541246 (7h51m22.108621377s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:17:28.000331767 (7h51m22.431411948s) [upload=8215]: Done uploading segments... Aug 9 01:17:28.000353929 (7h51m22.43143409s) [upload=8215]: Upload finished. err: <nil> Duration: 6.238298422s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X.........X............X....................X.] duration: 1.931339721s FAIL (2025-08-09 01:24:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:24:05.537525134 (7h57m59.968605265s) [upload=8325]: Starting upload Aug 9 01:24:05.537629253 (7h57m59.968709404s) [upload=8325]: Done starting upload Aug 9 01:24:05.537742369 (7h57m59.968822511s) [upload=8325]: Uploading segments... Aug 9 01:24:05.537837762 (7h57m59.968917934s) [upload=8325]: Got next segment. Inline: true Aug 9 01:24:05.537847020 (7h57m59.968927181s) [upload=8325]: Waiting for error group managing segments... Aug 9 01:24:05.537890293 (7h57m59.968970424s) [upload=8325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:24:05.537894631 (7h57m59.968974762s) [upload=8325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:24:05.537897487 (7h57m59.968977618s) [upload=8325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:24:05.764540420 (7h58m0.195620541s) [upload=8325]: Done uploading segments... Aug 9 01:24:05.764552183 (7h58m0.195632314s) [upload=8325]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.931366332s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.........X...X.................X..X............X....X.......] duration: 5.993428085s FAIL (2025-08-09 01:24:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 01:17:24.837360944 (7h51m19.268441075s) [upload=8215]: Starting upload Aug 9 01:17:24.837406240 (7h51m19.268486371s) [upload=8215]: Done starting upload Aug 9 01:17:24.837455224 (7h51m19.268535355s) [upload=8215]: Uploading segments... Aug 9 01:17:24.837640268 (7h51m19.268720399s) [upload=8215]: Got next segment. Inline: false Aug 9 01:17:24.837669003 (7h51m19.268749134s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:17:24.837673111 (7h51m19.268753232s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 01:17:25.297265302 (7h51m19.728345434s) [seg_pos={0 0}, upload=8215]: Begin upload segment... Aug 9 01:17:25.297315028 (7h51m19.728395149s) [seg_pos={0 0}, upload=8215]: Done begin upload segment. Aug 9 01:17:25.297328673 (7h51m19.728408804s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297339535 (7h51m19.728419666s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297686037 (7h51m19.728766158s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297709111 (7h51m19.728789243s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.297989047 (7h51m19.729069178s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298009546 (7h51m19.729089687s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298246079 (7h51m19.72932621s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298487441 (7h51m19.729567572s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298704376 (7h51m19.729784507s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.298915460 (7h51m19.729995591s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299003258 (7h51m19.730083389s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299240482 (7h51m19.730320613s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299463779 (7h51m19.73054392s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299676266 (7h51m19.730756397s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.299700121 (7h51m19.730780253s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300017368 (7h51m19.731097499s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300317663 (7h51m19.731397794s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:25.300429627 (7h51m19.731509758s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Uploading piece... Aug 9 01:17:26.411822782 (7h51m20.842902923s) [upload=8215]: Next returned nil segment Aug 9 01:17:26.411843291 (7h51m20.842923422s) [upload=8215]: Waiting for error group managing segments... Aug 9 01:17:26.704138476 (7h51m21.135218607s) [noise=true , address=64.49.13.138:4487 , piece_id=ARF54AIZPLQ4D7YT2GN6P3CIZJ7CBTBZEVOLXPCMPSBU4XEUGEVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.238612379 (7h51m21.66969251s) [noise=true , address=104.36.82.5:4859 , piece_id=J3IUXLK6IFVFGMDHATUC5KUB6NS7F4ZFUXF3634M6NRA5DX2NFBA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.258591254 (7h51m21.689671385s) [noise=true , address=104.36.82.39:4745 , piece_id=LUFM54UDD3GLPGDM7XR54N433V654A7Y5OMUR2LJSOM6PCKSLN7Q, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.278592011 (7h51m21.709672142s) [noise=true , address=104.36.82.23:4461 , piece_id=Y4ENYKDZR5NOWDOUVXWG6LZ46MYY4TM3WF3JUSFMIRDE7FUSZYVA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.290626396 (7h51m21.721706547s) [noise=true , address=104.36.82.37:4681 , piece_id=JJYI6FAIZNZ7TKB6OCSC2IYW767R7RD37OUHJCBHIFRM5RHDDIDQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.343461836 (7h51m21.774541967s) [noise=true , address=104.36.82.36:4640 , piece_id=SPM62GAOGNSR4YJWUL3LIZ6NMFKP44N22LP5LFRDGE7DJK3NUZ3A, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.347287756 (7h51m21.778367887s) [noise=true , address=104.36.82.47:4537 , piece_id=PBOCAPRVFOVVSETFN6MHCKG3KPMM7R4J6PT3SOARQZ3W36FOOXIQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.362912350 (7h51m21.793992531s) [noise=true , address=77.90.31.14:4667 , piece_id=YBO7EIDBZNST453UEPCSOMWCMPKFIZTLVDTLUUG5GNAWK6RR2ZOA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.379894121 (7h51m21.810974252s) [noise=true , address=104.36.82.62:4409 , piece_id=WTMY73TNSG3IZCKS5U5KLCNCUGA467JS2Q64SIEH4OF4KLCZIEIA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.456679203 (7h51m21.887759334s) [noise=true , address=104.36.82.8:4001 , piece_id=3FRN57HD5YZSRTFNUIR3DMUSBZ523BGUUXBSZMCEAOTW2C3G2UCQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.464705400 (7h51m21.895785531s) [noise=true , address=104.36.82.18:4383 , piece_id=ACLKLGVMHNE7BV3TGW3KJG63V5B3743KHR2Z72SYGSFPZDMACYNQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.494136841 (7h51m21.925216972s) [noise=true , address=104.36.82.42:4832 , piece_id=DVRPGIU2YLWQ7BE6GLINS2QIJMY45ZLZ6B7LPHL7FT3BN4UVG3TQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.587420599 (7h51m22.01850073s) [noise=true , address=104.36.82.4:4829 , piece_id=TSZZ2HWB2EDPXYS35HBFQZ66JVGLUQOPXG6PLD3BNHPYPMNMSPEA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677114379 (7h51m22.10819451s) [noise=true , address=104.36.82.55:4214 , piece_id=WKRGF7XVV4MCEGGYE263FE7IFGIKMUJR3W5CDKMJJFVTSLWLL2JA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: <nil> Aug 9 01:17:27.677136662 (7h51m22.108216793s) [seg_pos={0 0}, upload=8215]: Segment reached optimal threshold of 14 pieces. Aug 9 01:17:27.677301908 (7h51m22.108382039s) [noise=true , address=104.36.82.41:4780 , piece_id=3TXFE5DGIN2KHBSBNJI5UDBMVENPUGGFO7M74XBA2QAHKPBEJVMA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY): protocol: expected piece hash; context canceled; EOF Aug 9 01:17:27.677377312 (7h51m22.108457443s) [noise=true , address=104.36.82.14:4254 , piece_id=FK7XF3D2Z5KJ5A5WRYFQHG3G33BOK3WOBM5K2SASK746P34TPUTQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35050->104.36.82.14:4254: use of closed network connection Aug 9 01:17:27.677394935 (7h51m22.108475056s) [noise=true , address=104.36.82.16:4319 , piece_id=T6SJGRNDU7A4IM7HJUM4V2UXWS57R6VLLJZMWPTSMVVJM7XJAAWA, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50984->104.36.82.16:4319: use of closed network connection Aug 9 01:17:27.677425464 (7h51m22.108505595s) [noise=true , address=104.36.82.59:4321 , piece_id=Q727VQ3PGDJ3WWY456ZAB2OPZ4ZLL6Q6QSIVB34FOWQ5QCCS3ZQQ, seg_pos={0 0}, upload=8215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41394->104.36.82.59:4321: use of closed network connection Aug 9 01:17:27.677437758 (7h51m22.108517889s) [seg_pos={0 0}, upload=8215]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 01:17:27.677536947 (7h51m22.108617078s) [upload=8215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 01:17:27.677541246 (7h51m22.108621377s) [upload=8215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:17:28.000331767 (7h51m22.431411948s) [upload=8215]: Done uploading segments... Aug 9 01:17:28.000353929 (7h51m22.43143409s) [upload=8215]: Upload finished. err: <nil> Duration: 5.993445818s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X.........X............X....................X] duration: 879.705247ms FAIL (2025-08-09 01:24:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 01:24:05.537525134 (7h57m59.968605265s) [upload=8325]: Starting upload Aug 9 01:24:05.537629253 (7h57m59.968709404s) [upload=8325]: Done starting upload Aug 9 01:24:05.537742369 (7h57m59.968822511s) [upload=8325]: Uploading segments... Aug 9 01:24:05.537837762 (7h57m59.968917934s) [upload=8325]: Got next segment. Inline: true Aug 9 01:24:05.537847020 (7h57m59.968927181s) [upload=8325]: Waiting for error group managing segments... Aug 9 01:24:05.537890293 (7h57m59.968970424s) [upload=8325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:24:05.537894631 (7h57m59.968974762s) [upload=8325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:24:05.537897487 (7h57m59.968977618s) [upload=8325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:24:05.764540420 (7h58m0.195620541s) [upload=8325]: Done uploading segments... Aug 9 01:24:05.764552183 (7h58m0.195632314s) [upload=8325]: Upload finished. err: metaclient: Too Many Requests Duration:* 879.721991ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X.........X............X....................] duration: 1.97765831s FAIL (2025-08-09 01:23:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 01:08:15.407550863 (7h42m9.838630995s) [upload=8054]: Starting upload Aug 9 01:08:15.407585941 (7h42m9.838666072s) [upload=8054]: Done starting upload Aug 9 01:08:15.407625697 (7h42m9.838705828s) [upload=8054]: Uploading segments... Aug 9 01:08:15.407657608 (7h42m9.838737739s) [upload=8054]: Got next segment. Inline: true Aug 9 01:08:15.407661165 (7h42m9.838741296s) [upload=8054]: Waiting for error group managing segments... Aug 9 01:08:15.407691152 (7h42m9.838771283s) [upload=8054]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 01:08:15.407695501 (7h42m9.838775632s) [upload=8054]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 01:08:15.407698166 (7h42m9.838778297s) [upload=8054]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 01:08:15.690642090 (7h42m10.121722221s) [upload=8054]: Done uploading segments... Aug 9 01:08:15.690660516 (7h42m10.121740647s) [upload=8054]: Upload finished. err: <nil> Duration:* 1.977687967s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)