Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [............X............X.XX...X.......XXXX.X.XX.XX.XXXX...] duration: 4.65357566s trace: https://jaeger.dev.storj.io/trace/27efa76c186e6633 FAIL (2026-04-17 22:18:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.653594527s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 9.133501481s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:18:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 9.133524816s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [.............X............X.XX...X.......XXXX.X.XX.XX.XXXX..] duration: 4.404796125s trace: https://jaeger.dev.storj.io/trace/27efa76c186e6633 FAIL (2026-04-17 22:18:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.405023324s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 9.21009897s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:17:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 9.210113958s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.X.......................................XXXXX..............] duration: 16.060863334s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:17:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 16.060900476s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [..............X............X.XX...X.......XXXX.X.XX.XX.XXXX.] duration: 4.848540872s trace: https://jaeger.dev.storj.io/trace/27efa76c186e6633 FAIL (2026-04-17 22:17:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.848557694s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [..X.......................................XXXXX.............] duration: 35.558062188s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:17:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 35.558087928s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [...............X............X.XX...X.......XXXX.X.XX.XX.XXXX] duration: 5.000630611s trace: https://jaeger.dev.storj.io/trace/27efa76c186e6633 FAIL (2026-04-17 22:17:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000659947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 8.442995423s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:16:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 8.443020901s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [...X.......................................XXXXX............] duration: 17.845945745s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:16:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 17.84596329s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 17 out of 60 is failed (threshold=6) [................X............X.XX...X.......XXXX.X.XX.XX.XXX] duration: 5.001594719s trace: https://jaeger.dev.storj.io/trace/22dd7253e8525caf FAIL (2026-04-17 22:16:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001616271s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 8.353778567s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:16:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 8.353813134s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 16 out of 60 is failed (threshold=6) [.................X............X.XX...X.......XXXX.X.XX.XX.XX] duration: 5.001444809s trace: https://jaeger.dev.storj.io/trace/5ea1d80e32a983ce FAIL (2026-04-17 22:15:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001463264s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [....X.......................................XXXXX...........] duration: 29.533619715s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:15:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 29.533675773s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 15 out of 60 is failed (threshold=6) [..................X............X.XX...X.......XXXX.X.XX.XX.X] duration: 5.000764054s trace: https://jaeger.dev.storj.io/trace/70bf892bd1fc5bbb FAIL (2026-04-17 22:14:57 UTC) orbiter warning: context deadline exceeded Duration: 5.000792039s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 7.969582078s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:14:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 7.969618577s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.....X.......................................XXXXX..........] duration: 5.774939765s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:14:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.774965386s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 14 out of 60 is failed (threshold=6) [...................X............X.XX...X.......XXXX.X.XX.XX.] duration: 3.457499764s trace: https://jaeger.dev.storj.io/trace/570672b8721b2396 FAIL (2026-04-17 22:14:12 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.457526987s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 8.1125456s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:13:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 8.11256618s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 14 out of 60 is failed (threshold=6) [....................X............X.XX...X.......XXXX.X.XX.XX] duration: 5.00104594s trace: https://jaeger.dev.storj.io/trace/570672b8721b2396 FAIL (2026-04-17 22:13:58 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001069556s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [......X.......................................XXXXX.........] duration: 9.643217971s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:13:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.643240755s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 13 out of 60 is failed (threshold=6) [.....................X............X.XX...X.......XXXX.X.XX.X] duration: 5.001013961s trace: https://jaeger.dev.storj.io/trace/73d58f6f18d44c1 FAIL (2026-04-17 22:12:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00103416s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 7.659229804s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:12:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 7.659260634s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.......X.......................................XXXXX........] duration: 16.135152313s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:12:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 16.135180305s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 12 out of 60 is failed (threshold=6) [......................X............X.XX...X.......XXXX.X.XX.] duration: 4.384221101s trace: https://jaeger.dev.storj.io/trace/39986dc68e35954 FAIL (2026-04-17 22:12:29 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.384249234s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 9.257451028s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:12:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 9.257476257s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 12 out of 60 is failed (threshold=6) [.......................X............X.XX...X.......XXXX.X.XX] duration: 5.001558869s trace: https://jaeger.dev.storj.io/trace/39986dc68e35954 FAIL (2026-04-17 22:11:49 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001577695s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002849942s trace: https://jaeger.dev.storj.io/trace/5cc52839840193df FAIL (2026-04-17 22:11:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 17 22:11:17.642192354 (246h25m4.461428378s) [upload=236583]: Starting upload Apr 17 22:11:17.642264764 (246h25m4.461500788s) [upload=236583]: Done starting upload Apr 17 22:11:17.642342734 (246h25m4.461578758s) [upload=236583]: Uploading segments... Apr 17 22:11:17.642525718 (246h25m4.461761742s) [upload=236583]: Got next segment. Inline: false Apr 17 22:11:17.642558962 (246h25m4.461794986s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 17 22:11:17.642563912 (246h25m4.461799936s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 17 22:11:17.882374413 (246h25m4.701610437s) [seg_pos={0 0}, upload=236583]: Begin upload segment... Apr 17 22:11:17.882438487 (246h25m4.701674511s) [seg_pos={0 0}, upload=236583]: Done begin upload segment. Apr 17 22:11:17.885163417 (246h25m4.704399471s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.890822067 (246h25m4.710058101s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.891352060 (246h25m4.710588084s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.893193865 (246h25m4.712429889s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895445962 (246h25m4.714681986s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.895518891 (246h25m4.714754915s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.897292695 (246h25m4.716528719s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.899077650 (246h25m4.718313674s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900145952 (246h25m4.719381976s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.900530905 (246h25m4.719766929s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.901710130 (246h25m4.720946154s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.902279129 (246h25m4.721515153s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903290060 (246h25m4.722526084s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.903897372 (246h25m4.723133396s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.904735619 (246h25m4.723971643s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:17.905349224 (246h25m4.724585248s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Uploading piece... Apr 17 22:11:19.706338743 (246h25m6.525574767s) [upload=236583]: Next returned nil segment Apr 17 22:11:19.706356788 (246h25m6.525592812s) [upload=236583]: Waiting for error group managing segments... Apr 17 22:11:19.994408492 (246h25m6.813644527s) [noise=true , address=77.90.31.18:4810 , piece_id=N7XFDY27NJTWOYMIS5KEGBSAUTJ5BXQXNTWD367YSRRNAB5WLNOA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:19.995247402 (246h25m6.814483426s) [noise=true , address=77.90.31.10:4521 , piece_id=OD6737KJZK3DYXTY7KVHT7YM4EZJ5G3PLPM24OV5K6QSVT6LQAZA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.782393945 (246h25m7.601629969s) [noise=true , address=145.79.227.14:4837 , piece_id=ZOMRP2QCEPGDJ7NNE2QROG5KH73RTJ2LM2DS763TKBUULAJ2G37Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:20.929683807 (246h25m7.748919831s) [noise=true , address=145.79.227.2:4116 , piece_id=QWMDOBFXL3C3MC4UAH32YZYTEGG2YYDXYMPMDJZZYHWEQLZIUOTA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.038934967 (246h25m7.858170991s) [noise=true , address=145.79.227.3:4150 , piece_id=NLEB5GCUK4OXMZ43GG33SC7PKSHNXRFN4N7OCT37VIJZLCZ7SRXA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.351460856 (246h25m8.17069688s) [noise=true , address=145.79.227.8:4331 , piece_id=VO4NPYQ3HAC35SP5ZTKZ4RIW4WUUHUBZMF5VZWJOVGWFQ36ETC4Q, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.445533741 (246h25m8.264769765s) [noise=true , address=145.79.227.12:4769 , piece_id=D7OX66PSEP4A2H5A64MA2MVSPT3H7BVQAU3PPNPXA2HM4DC4UEHA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.481223641 (246h25m8.300459665s) [noise=true , address=45.91.116.9:4296 , piece_id=SHDLZOWNC7VLN63OLW24FKRJTWDGOOQA6OBBXHIILSZYPHHZKHDQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.603836618 (246h25m8.423072642s) [noise=true , address=45.91.116.12:4226 , piece_id=BYP6OEG4PM5NBAJMKXVMNDJAIBHZD237OSTHIHPQLQZREHWVDZFQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.713343271 (246h25m8.532579295s) [noise=true , address=45.91.116.7:4024 , piece_id=5X7NBLIFKJBYSBV4IPBPID4OON3IAVWOIKKFLJKSBFC6ZXCU6OWA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:21.729259759 (246h25m8.548495783s) [noise=true , address=145.79.227.26:4658 , piece_id=MBX7N2AP7RC4EHJVRLTC53TUHIGVLFH3SEN3FPRJVAGT43J5NUTQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.107132825 (246h25m8.926368849s) [noise=true , address=145.79.227.31:4801 , piece_id=B6LP62UZ3SHLTKQK54ZMVE3RPSRHYBPLRMGLQX6MME54ZT7NENJQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189431728 (246h25m9.008667762s) [noise=true , address=145.79.227.23:4551 , piece_id=JPWBC5NCZSXSHXO757XF2SKIZZQUCI3RM5IMVTROOQHL5FVW5E2A, seg_pos={0 0}, upload=236583]: Done uploading piece. err: <nil> Apr 17 22:11:22.189455404 (246h25m9.008691428s) [seg_pos={0 0}, upload=236583]: Satisfied cohort requirements after 13 pieces Apr 17 22:11:22.189633718 (246h25m9.008869752s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189642284 (246h25m9.008878308s) [noise=true , address=145.79.227.35:4486 , piece_id=P26B5NG7QTTTRJ4RM4NQWRQ5HYTINX6SQV6NRUQKX7ITW4EAIFOQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189645831 (246h25m9.008881865s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126xWe3ELGmYQfSUk3tYtGTSa6LnGfDNWcGT164pR6tHEtFPAFt): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189656893 (246h25m9.008892937s) [noise=true , address=145.79.227.5:4226 , piece_id=EII3WG5HI7MAUGCRFBL2CIFL5R3QA2M4RHZXZJLZPGSFVVV3VSYQ, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189838644 (246h25m9.009074668s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA): protocol: expected piece hash; context canceled; EOF Apr 17 22:11:22.189844715 (246h25m9.009080739s) [noise=true , address=145.79.227.43:4159 , piece_id=TJQOYPQX7N3QLTA6H5J7E6KCRQUZYAHLCNIO4U5K5YGLRRZSTHCA, seg_pos={0 0}, upload=236583]: Long tail cancellation due to optimal threshold Apr 17 22:11:22.189861708 (246h25m9.009097742s) [seg_pos={0 0}, upload=236583]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Apr 17 22:11:22.189948866 (246h25m9.00918489s) [upload=236583]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 17 22:11:22.189954657 (246h25m9.009190691s) [upload=236583]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 17 22:11:22.483797551 (246h25m9.303033585s) [upload=236583]: Done uploading segments... Apr 17 22:11:22.483827999 (246h25m9.303064023s) [upload=236583]: Upload finished. err: <nil> Duration: 30.002871122s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [........X.......................................XXXXX.......] duration: 9.451859933s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:11:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.451891824s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.........X.......................................XXXXX......] duration: 14.432381467s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:11:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 14.432403339s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [..........X.......................................XXXXX.....] duration: 11.957057739s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:11:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.957086926s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 11 out of 60 is failed (threshold=6) [........................X............X.XX...X.......XXXX.X.X] duration: 5.001570941s trace: https://jaeger.dev.storj.io/trace/69293eea35491224 FAIL (2026-04-17 22:10:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001583885s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [...........X.......................................XXXXX....] duration: 21.437418298s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:10:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.437491348s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [.........................X............X.XX...X.......XXXX.X.] duration: 3.989013394s trace: https://jaeger.dev.storj.io/trace/647533b91507d3c9 FAIL (2026-04-17 22:10:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.989040557s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [............X.......................................XXXXX...] duration: 10.118843564s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:09:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.118863603s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [..........................X............X.XX...X.......XXXX.X] duration: 5.001330536s trace: https://jaeger.dev.storj.io/trace/647533b91507d3c9 FAIL (2026-04-17 22:09:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001350957s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.............X.......................................XXXXX..] duration: 15.704062475s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:09:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 15.704084737s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 9 out of 60 is failed (threshold=6) [...........................X............X.XX...X.......XXXX.] duration: 4.464963936s trace: https://jaeger.dev.storj.io/trace/5899156be6e4cbbd FAIL (2026-04-17 22:08:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.464987483s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 9 out of 60 is failed (threshold=6) [............................X............X.XX...X.......XXXX] duration: 5.001371425s trace: https://jaeger.dev.storj.io/trace/5899156be6e4cbbd FAIL (2026-04-17 22:08:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001397396s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [..............X.......................................XXXXX.] duration: 15.711679634s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:08:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 15.711694883s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [...............X.......................................XXXXX] duration: 1m0.00148519s trace: https://jaeger.dev.storj.io/trace/1999777fac8036ca FAIL (2026-04-17 22:07:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001497243s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [.............................X............X.XX...X.......XXX] duration: 5.001582369s trace: https://jaeger.dev.storj.io/trace/300cfb710bf6a09d FAIL (2026-04-17 22:07:25 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001603899s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [................X.......................................XXXX] duration: 1m0.00057257s trace: https://jaeger.dev.storj.io/trace/5bbf085e939aab9a FAIL (2026-04-17 22:06:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000585665s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [..............................X............X.XX...X.......XX] duration: 5.001176338s trace: https://jaeger.dev.storj.io/trace/714c3ea26f493027 FAIL (2026-04-17 22:06:52 UTC) orbiter warning: context deadline exceeded Duration: 5.001199602s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 6 out of 60 is failed (threshold=6) [...............................X............X.XX...X.......X] duration: 5.001176967s trace: https://jaeger.dev.storj.io/trace/29c0a91458954729 FAIL (2026-04-17 22:06:00 UTC) orbiter warning: context deadline exceeded Duration: 5.00119888s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.................X.......................................XXX] duration: 1m0.00073646s trace: https://jaeger.dev.storj.io/trace/2dbd50288c3361ef FAIL (2026-04-17 22:05:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000760236s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [................................X............X.XX...X.......] duration: 4.122175628s trace: https://jaeger.dev.storj.io/trace/4770c95ef5df97c7 FAIL (2026-04-17 22:05:42 UTC) orbiter warning: context deadline exceeded Duration: 4.122199464s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..................X.......................................XX] duration: 1m0.000905705s trace: https://jaeger.dev.storj.io/trace/45be871c2d61012c FAIL (2026-04-17 22:04:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000913951s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [.................................X............X.XX...X......] duration: 4.439851967s trace: https://jaeger.dev.storj.io/trace/4770c95ef5df97c7 FAIL (2026-04-17 22:04:49 UTC) orbiter warning: context deadline exceeded Duration: 4.439916332s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [..................................X............X.XX...X.....] duration: 4.354822741s trace: https://jaeger.dev.storj.io/trace/4770c95ef5df97c7 FAIL (2026-04-17 22:04:14 UTC) orbiter warning: context deadline exceeded Duration: 4.354848971s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)