Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................X..........X.............................] duration: 3.71308051s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:13:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.713095487s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....................XX..........X..........................] duration: 6.711100265s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:13:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.711174126s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................X........................X................] duration: 4.158092244s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:13:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.158117782s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................X..........X............................] duration: 3.745703701s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:13:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.745721244s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................X..........X...........................] duration: 3.736788137s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:13:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.736812693s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................XX..........X.........................] duration: 6.599099818s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:12:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.599119856s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................X........................X...............] duration: 4.26821062s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:12:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.268234014s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................X..........X..........................] duration: 3.772064619s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:12:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.772090739s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................X........................X..............] duration: 13.226854997s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:12:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 13.22686696s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......................XX..........X........................] duration: 6.635294318s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:12:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.635312332s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................X..........X.........................] duration: 3.860452132s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:11:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.860464365s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................X........................X.............] duration: 4.155688157s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:11:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.155707765s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................XX..........X.......................] duration: 6.78246767s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:10:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.782490884s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................X........................X............] duration: 5.922719517s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:10:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 5.922743293s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................X..........X........................] duration: 3.766978456s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:10:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.766999236s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................X..........X.......................] duration: 3.720277972s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:10:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.720301806s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................X........................X...........] duration: 4.029286226s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:10:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.029311875s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................XX..........X......................] duration: 6.58004611s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:10:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.580066539s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................X........................X..........] duration: 4.204790705s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:09:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.204869976s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................X..........X......................] duration: 3.69340499s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:09:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.693426611s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........................XX..........X.....................] duration: 6.922546026s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:09:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.922565663s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................X..........X.....................] duration: 3.708737442s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:08:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.708756268s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................X........................X.........] duration: 3.990310469s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:08:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 3.990323784s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................X........................X........] duration: 42.788815361s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:08:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 42.788837823s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................X..........X....................] duration: 3.703222962s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:08:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.703236046s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........................XX..........X....................] duration: 6.910225299s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:08:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.910246448s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............................X..........X...................] duration: 3.640195975s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:07:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.640218248s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............................XX..........X...................] duration: 6.626895131s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:07:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.626921372s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............................X..........X..................] duration: 3.650602507s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:07:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.650631161s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................X........................X.......] duration: 4.215711003s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:06:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.215732462s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................X..........X.................] duration: 3.624979394s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:06:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.624999694s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............................XX..........X..................] duration: 6.938626699s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:06:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.938644243s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [X...........................X........................X......] duration: 4.348628227s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:06:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.348651241s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................X..........X................] duration: 3.762532429s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:06:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.762543861s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............................XX..........X.................] duration: 6.557839485s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:05:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.557860735s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............................XX..........X................] duration: 7.774755755s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:05:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.774777626s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.X...........................X........................X.....] duration: 4.022128966s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:05:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.022144846s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................X..........X...............] duration: 3.905715853s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:05:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.905805576s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [................................XX..........X...............] duration: 6.72803223s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:04:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.728059002s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..X...........................X........................X....] duration: 8.94950603s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:04:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 8.94952656s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................X..........X..............] duration: 3.84666066s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:03:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.846740092s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...X...........................X........................X...] duration: 3.981295713s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:03:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 3.981316584s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.................................XX..........X..............] duration: 6.69210892s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:03:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.692136523s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....X...........................X........................X..] duration: 4.189408129s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:03:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 4.189431653s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..................................XX..........X.............] duration: 6.673314909s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:03:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.673338183s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................................X..........X.............] duration: 3.896085326s trace: https://jaeger.dev.storj.io/trace/50cb1c9dfcc01f98 FAIL (2026-05-26 13:02:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.896105845s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [X....X...........................X........................X.] duration: 5.522311345s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:02:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 5.522323579s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...................................XX..........X............] duration: 6.840592597s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:02:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.840611853s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.X....X...........................X........................X] duration: 1m0.001926063s trace: https://jaeger.dev.storj.io/trace/723da1e049dd435b FAIL (2026-05-26 13:02:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176600990 (34h58m2.959941099s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176627370 (34h58m2.959967469s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176935959 (34h58m2.960276058s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.176946819 (34h58m2.960286918s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177262342 (34h58m2.960602451s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177271709 (34h58m2.960611809s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177594596 (34h58m2.960934695s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177611167 (34h58m2.960951266s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.177962798 (34h58m2.961302897s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178296124 (34h58m2.961636223s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178654658 (34h58m2.961994757s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178973868 (34h58m2.962313967s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.178982053 (34h58m2.962322162s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.179333174 (34h58m2.962673273s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:17.180019303 (34h58m2.963359412s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Uploading piece... May 26 13:02:18.251458863 (34h58m4.034798962s) [upload=33502]: Next returned nil segment May 26 13:02:18.251468922 (34h58m4.034809021s) [upload=33502]: Waiting for error group managing segments... May 26 13:02:18.533816631 (34h58m4.31715673s) [noise=true , address=212.102.52.215:4369 , piece_id=ITRXNHHTQV47K7KVHY62MS5QMRKETWFLVHPYRG62BYPUTG55UBWA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.535498340 (34h58m4.318838439s) [noise=true , address=212.102.52.213:4340 , piece_id=YQ2X5H2QM7Z6PVDIXACSG6KPAHJUFE7QQKB7TPKOZ7YGBS4DFH2Q, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.536123884 (34h58m4.319463983s) [noise=true , address=212.102.52.217:4440 , piece_id=REMNBYULFFJSCR34LALAUHWWOPVV42KYHHFIP4KFO4Z2N43CU4NA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.556219760 (34h58m4.339559859s) [noise=true , address=212.102.52.216:4411 , piece_id=WL7TQNII7TLMSKZ2VF5IC4WJZUDGZHWO2CH5VUXUDYIN6UKUIDLA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.565686324 (34h58m4.349026423s) [noise=true , address=212.102.52.214:4353 , piece_id=AEKFOSIORFKB6F376QICJ5KUEBFRADC3SWI2LHKYICT3HPCP7AOA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.567677052 (34h58m4.351017151s) [noise=true , address=212.102.52.217:4439 , piece_id=E47DKZJUBW5W4QFWHZCNT4EQPISA7HN72IBZU3HWPRTK52VI2BXA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570015554 (34h58m4.353355653s) [noise=true , address=212.102.52.216:4409 , piece_id=IDATXGH3AWXEGDCEJSVVYWDXOLLISZD7MI5XBH6SUZ57UERAGE4A, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.570778911 (34h58m4.35411901s) [noise=true , address=212.102.52.215:4384 , piece_id=R4MXEURK52KCPL53SZQDTKENS7MM4CRQQEFG66TLFVV6NZUDOBIQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.576937162 (34h58m4.360277261s) [noise=true , address=212.102.52.216:4396 , piece_id=F2SWUJO5EIV6XPLBPQBMJGS6VVLGMSQ64ALIBZGII4JAX3ZUHNRQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.577201366 (34h58m4.360541465s) [noise=true , address=212.102.52.214:4365 , piece_id=FS3I3B33P26Y7D6FFJZYEO7UZ6IOOOMSJT7PDEK6UNUQZV35MYIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.578140207 (34h58m4.361480306s) [noise=true , address=212.102.52.217:4435 , piece_id=3PABELXHKKBLHACKRHGGGAF5EEW6Z2WHSFWQENZZXDIPQIN3XIMQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.579111059 (34h58m4.362451159s) [noise=true , address=212.102.52.215:4378 , piece_id=TWU7L2TOKP7H72VOEL5KSOK4FYQXBJWDZ2YNY444J5ESHB5ABFTA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.581745477 (34h58m4.365085576s) [noise=true , address=212.102.52.213:4328 , piece_id=CE76T5UZ5SYQ6DCPMKJQYSMZ5DMDF77DZYXIOLV32S4YO4V7YQWQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.588596309 (34h58m4.371936398s) [noise=true , address=212.102.52.214:4362 , piece_id=EOEI5IUQ5NMZQFCFKWP34P4RQYRBPBHCRQIY2ESRKNQEGBUZJVGQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.590182496 (34h58m4.373522605s) [noise=true , address=212.102.52.213:4343 , piece_id=DUZEC6W5DIFH4PT4ZF3AXHUXWJYINPECPLH7VF4F5SONVX23WXOQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592521870 (34h58m4.375861969s) [noise=true , address=212.102.52.215:4388 , piece_id=2JQENKAYX5YRULEYBEETN4D6PNO3XSOSMZH5XQ5WWAPYBUJOG5XQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: <nil> May 26 13:02:18.592530065 (34h58m4.375870164s) [seg_pos={0 0}, upload=33502]: Satisfied cohort requirements after 16 pieces May 26 13:02:18.592686984 (34h58m4.376027084s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592692756 (34h58m4.376032855s) [noise=true , address=212.102.52.213:4334 , piece_id=XUCZD2575E6RLLUVILNXYOSYIJXA37RFJJQ64L43RCVNYV67DIDA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592795532 (34h58m4.376135631s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BA6ZmPnVWhQ86R27YBcNR2f7qDAbjPBadMtYxvzBpDcunYt8F): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592802826 (34h58m4.376142925s) [noise=true , address=212.102.52.214:4346 , piece_id=TVXJU72USBE3CZCG2XEHWDLX6GAIXU52Z3R7PWOKTBDXPMMMQ7TQ, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592884672 (34h58m4.376224771s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592903248 (34h58m4.376243347s) [noise=true , address=212.102.52.217:4419 , piece_id=BT7JOHM3C7Y57PEWZWBT2FDJOI3PT64OJGNZEGO33FH6I5UPLPIA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592910962 (34h58m4.376251061s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YyuYGM7ttMRXybutoxVQBktQPes1XMce5fTs4BUfQVykeZtqT): protocol: expected piece hash; context canceled; EOF May 26 13:02:18.592916523 (34h58m4.376256622s) [noise=true , address=212.102.52.216:4397 , piece_id=WGQOMFJ4GAOERACZSAM46KF7E7CCZXGDV4WII7HLVMT6A2QOG7CA, seg_pos={0 0}, upload=33502]: Long tail cancellation due to optimal threshold May 26 13:02:18.592944486 (34h58m4.376284585s) [seg_pos={0 0}, upload=33502]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 13:02:18.592998580 (34h58m4.376338679s) [upload=33502]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 13:02:18.593003078 (34h58m4.376343177s) [upload=33502]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 13:02:30.448364991 (34h58m16.23170509s) [upload=33502]: Done uploading segments... May 26 13:02:30.448379599 (34h58m16.231719698s) [upload=33502]: Upload finished. err: <nil> Duration: 1m0.001942485s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....................................XX..........X...........] duration: 6.728205316s trace: https://jaeger.dev.storj.io/trace/52bc4cc0477decda FAIL (2026-05-26 13:02:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.728253398s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)