Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.X...............................] duration: 8.865765209s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:49:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.865786429s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................X...X...................................] duration: 3.820729986s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:49:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.820754453s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........................X.X..............................] duration: 7.025881957s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:49:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.025900061s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................X...X..................................] duration: 3.851115511s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:48:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.851156529s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.............X....X..................X...................X..] duration: 4.043070393s trace: https://jaeger.dev.storj.io/trace/6ac462d3dcd73c3 FAIL (2026-05-26 11:48:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:47:17.160544681 (33h43m2.943884781s) [upload=32300]: Starting upload May 26 11:47:17.160581793 (33h43m2.943921892s) [upload=32300]: Done starting upload May 26 11:47:17.160754332 (33h43m2.944094431s) [upload=32300]: Uploading segments... May 26 11:47:17.160830087 (33h43m2.944170186s) [upload=32300]: Got next segment. Inline: false May 26 11:47:17.160866406 (33h43m2.944206505s) [upload=32300]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:47:17.160872156 (33h43m2.944212256s) [upload=32300]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:48:04.189368932 (33h43m49.972709041s) [upload=32300]: Next segment err: context deadline exceeded May 26 11:48:04.189641342 (33h43m49.972981441s) [upload=32300]: Done uploading segments... May 26 11:48:04.189769426 (33h43m49.973109525s) [upload=32300]: Upload finished. err: context deadline exceeded Duration: 4.04308953s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................X...X.................................] duration: 3.911726241s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:48:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.911747011s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..............X....X..................X...................X.] duration: 4.262411904s trace: https://jaeger.dev.storj.io/trace/6ac462d3dcd73c3 FAIL (2026-05-26 11:48:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:47:17.160544681 (33h43m2.943884781s) [upload=32300]: Starting upload May 26 11:47:17.160581793 (33h43m2.943921892s) [upload=32300]: Done starting upload May 26 11:47:17.160754332 (33h43m2.944094431s) [upload=32300]: Uploading segments... May 26 11:47:17.160830087 (33h43m2.944170186s) [upload=32300]: Got next segment. Inline: false May 26 11:47:17.160866406 (33h43m2.944206505s) [upload=32300]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:47:17.160872156 (33h43m2.944212256s) [upload=32300]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:48:04.189368932 (33h43m49.972709041s) [upload=32300]: Next segment err: context deadline exceeded May 26 11:48:04.189641342 (33h43m49.972981441s) [upload=32300]: Done uploading segments... May 26 11:48:04.189769426 (33h43m49.973109525s) [upload=32300]: Upload finished. err: context deadline exceeded Duration: 4.262433465s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............................X.X.............................] duration: 7.17943222s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:48:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.179450847s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [X..............X....X..................X...................X] duration: 1m0.001093946s trace: https://jaeger.dev.storj.io/trace/6ac462d3dcd73c3 FAIL (2026-05-26 11:48:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:47:17.160544681 (33h43m2.943884781s) [upload=32300]: Starting upload May 26 11:47:17.160581793 (33h43m2.943921892s) [upload=32300]: Done starting upload May 26 11:47:17.160754332 (33h43m2.944094431s) [upload=32300]: Uploading segments... May 26 11:47:17.160830087 (33h43m2.944170186s) [upload=32300]: Got next segment. Inline: false May 26 11:47:17.160866406 (33h43m2.944206505s) [upload=32300]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:47:17.160872156 (33h43m2.944212256s) [upload=32300]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:48:04.189368932 (33h43m49.972709041s) [upload=32300]: Next segment err: context deadline exceeded May 26 11:48:04.189641342 (33h43m49.972981441s) [upload=32300]: Done uploading segments... May 26 11:48:04.189769426 (33h43m49.973109525s) [upload=32300]: Upload finished. err: context deadline exceeded Duration: 1m0.00111132s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................X...X................................] duration: 3.736983377s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:47:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.737008567s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................X...X...............................] duration: 3.973948864s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:47:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.973969363s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............................X.X............................] duration: 10.385356725s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:47:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.385382705s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.X..............X....X..................X...................] duration: 4.323388265s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:46:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.323411971s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............................X.X...........................] duration: 10.65090087s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:46:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.650936568s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................X...X..............................] duration: 3.79140027s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:46:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.791422553s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..X..............X....X..................X..................] duration: 4.185052121s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:46:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.185074813s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................X...X.............................] duration: 3.904721218s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:46:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.904744222s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.X..........................] duration: 6.600852972s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:45:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.600875376s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...X..............X....X..................X.................] duration: 4.215129723s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:45:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.215153467s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................X...X............................] duration: 3.851114137s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:45:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.85114215s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................................X.X.........................] duration: 10.533478304s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:45:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.533552457s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................X...X...........................] duration: 3.743265887s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:44:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.743365757s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [....X..............X....X..................X................] duration: 4.131899308s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:44:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.13192126s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.X........................] duration: 12.788685721s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:44:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.78870071s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............................X...X..........................] duration: 3.816713816s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:44:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.816735859s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [X....X..............X....X..................X...............] duration: 5.421500676s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:43:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.421522087s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............................X...X.........................] duration: 3.947847756s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:43:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.947868615s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.X.......................] duration: 6.868099807s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:43:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.868113452s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [.X....X..............X....X..................X..............] duration: 4.105448004s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:43:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.105458703s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.X......................] duration: 6.693330381s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:42:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.693347384s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................X...X........................] duration: 4.936693235s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:42:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.936712603s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [..X....X..............X....X..................X.............] duration: 4.265910005s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:42:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.265934721s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [...X....X..............X....X..................X............] duration: 4.160017634s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:41:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.160032853s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.X.....................] duration: 6.874709818s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:41:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.87472662s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [....X....X..............X....X..................X...........] duration: 3.960239162s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:41:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.960264299s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................X...X.......................] duration: 3.818675608s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:41:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.81869271s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [.....X....X..............X....X..................X..........] duration: 3.945010183s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:40:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.945030253s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.X....................] duration: 6.727348154s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:40:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.727368564s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [......X....X..............X....X..................X.........] duration: 3.971853958s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:40:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.971882303s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................X...X......................] duration: 3.914630811s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:40:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.914725741s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [.......X....X..............X....X..................X........] duration: 3.985623181s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:40:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.98567564s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................X...X.....................] duration: 3.779948414s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:40:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.779972601s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.X...................] duration: 6.629228783s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:39:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.629242348s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [........X....X..............X....X..................X.......] duration: 4.028512375s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:38:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.028534015s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration: 6.607446641s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:38:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.607491025s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................................X...X....................] duration: 3.883037619s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:38:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.883047718s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [.........X....X..............X....X..................X......] duration: 4.041033053s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:38:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.041070735s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................................X...X...................] duration: 3.785609075s trace: https://jaeger.dev.storj.io/trace/3f59f32ec8bcb666 FAIL (2026-05-26 11:37:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.785621019s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.X.................] duration: 6.87970395s trace: https://jaeger.dev.storj.io/trace/1f80eefb3d29cbe3 FAIL (2026-05-26 11:37:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.879722947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 5 out of 60 is failed (threshold=3) [..........X....X..............X....X..................X.....] duration: 5.657411369s trace: https://jaeger.dev.storj.io/trace/591f717acd2fb4ee FAIL (2026-05-26 11:37:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ]: Uploading piece... May 26 11:35:11.676332990 (33h30m57.459673089s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.676655064 (33h30m57.459995163s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677013428 (33h30m57.460353517s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677370369 (33h30m57.460710468s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.677728092 (33h30m57.461068191s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678714394 (33h30m57.462054493s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.678871233 (33h30m57.462211332s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.679685467 (33h30m57.463025566s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.680638816 (33h30m57.463978905s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.682491591 (33h30m57.46583169s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.683877145 (33h30m57.467217244s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.685180713 (33h30m57.468520812s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.686130345 (33h30m57.469470444s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687102040 (33h30m57.470442129s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:11.687332258 (33h30m57.470672357s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Uploading piece... May 26 11:35:12.741032974 (33h30m58.524373073s) [upload=32098]: Next returned nil segment May 26 11:35:12.741045958 (33h30m58.524386057s) [upload=32098]: Waiting for error group managing segments... May 26 11:35:13.019471619 (33h30m58.802811718s) [noise=true , address=212.102.52.214:4358 , piece_id=MR2A7DMYMP7KBW6AMYAOA7SQAPAZBZP23CBUDMOCM72UEH6DITZQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.021129593 (33h30m58.804469702s) [noise=true , address=212.102.52.213:4326 , piece_id=7QK6W2FY635YCZ65MGRU65HHET7GEMFEKRRMOUMLRLXWDMHM443A, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.031315600 (33h30m58.814655699s) [noise=true , address=212.102.52.215:4378 , piece_id=EDH47ZYURW5MQM6KE6H67NJ5TVADBXPTE53BCM3T6L4DM4F4MBZA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.033023238 (33h30m58.816363337s) [noise=true , address=212.102.52.215:4386 , piece_id=NYRONC24MXS3EXLC6BKVXFD3UCHCI7DODADA3EPHGAHMVYSPBVXA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.037750649 (33h30m58.821090748s) [noise=true , address=212.102.52.213:4332 , piece_id=KMD3HPIIZTDGCQLIXAIZDHEIFPDCTCPPPINHUDISNGH2Z6HLFNIQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.040935426 (33h30m58.824275535s) [noise=true , address=212.102.52.214:4364 , piece_id=5DKUEXVP5MGT6CFRMFUJMIECZDKF3EVT6I4CAQE7ITMCTNRAFIYA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.043623124 (33h30m58.826963224s) [noise=true , address=212.102.52.217:4439 , piece_id=NYK36DFFJ274Y2MONVJYYA4PK6N2AAJF6G4AB6MCK2T65YGJ4GRA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044186480 (33h30m58.827526569s) [noise=true , address=212.102.52.217:4428 , piece_id=PIHZ7VDAAYIEBEZXIHLPLKWBS6DNBBMBB5XVGZFPDWUHFBRBXFJQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.044839977 (33h30m58.828180076s) [noise=true , address=212.102.52.217:4433 , piece_id=DXX345PZTA4NDQI6ITGSPPSR2RMUDOCEBOVEOT77QZ4SUDY7BJ2Q, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.050906402 (33h30m58.834246521s) [noise=true , address=212.102.52.213:4343 , piece_id=X25IK7IPQLB32FX4VIFJABXI2KGGYA52CJZYMX75ZUKM4RDMAFRQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056117936 (33h30m58.839458036s) [noise=true , address=212.102.52.214:4345 , piece_id=ZNRIBWRLWN6OGFXO6O73CPBCI4G5OVNPXSWSKGRC6L64EBVOGQDQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.056778046 (33h30m58.840118155s) [noise=true , address=212.102.52.216:4398 , piece_id=BV3ATTSW2A7VBWKTX4DONDJFOPSKULSMZDIPR23MMRGIKV2XCFKQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.057824563 (33h30m58.841164662s) [noise=true , address=212.102.52.214:4367 , piece_id=EO7DKKYTQY3ERXHUMK3PHMV3SDG7GXJLKL7A4FSWVNYKV5H43JVQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.059053168 (33h30m58.842393257s) [noise=true , address=212.102.52.216:4415 , piece_id=V3CGPGQRDE6LZE7IKO6QYXNEX76UZXPILDTHKSBNOBTGRL3B36EQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.090809665 (33h30m58.874149764s) [noise=true , address=212.102.52.217:4440 , piece_id=URXT4ALA6VS2MBG7DNYICBKJCYONVKDU6NGFQUKNFKUWRMBIMTPA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096832378 (33h30m58.880172478s) [noise=true , address=212.102.52.215:4380 , piece_id=EN7N2NR5TGGWCY7CLSBQJTKYHWPMZLLE5ZN4UAP3AERXPVMSFNKA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: <nil> May 26 11:35:13.096851434 (33h30m58.880191533s) [seg_pos={0 0}, upload=32098]: Satisfied cohort requirements after 16 pieces May 26 11:35:13.097096842 (33h30m58.880436941s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097104908 (33h30m58.880445008s) [noise=true , address=212.102.52.216:4416 , piece_id=BVPXBFWS7MWK2QQISFBBYPBCXLIZKBXSY7B72WQU47CGAK4SU6JQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097299419 (33h30m58.880639538s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f1unaJrBkG1zw5XdBmCMeS8EKdqELYbQcr5cLq513xvctxcED): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097314168 (33h30m58.880654267s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GobdbvLireyEB6WtiokfHU1PnDtmyoGTZctB7PTzcjG7Spz1z): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097324467 (33h30m58.880664566s) [noise=true , address=212.102.52.216:4393 , piece_id=VQRYNNP2HH35JPBO23M4N3LNTYIZ42KAQ3TY4BWPWJKBIUBPXZNQ, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097331600 (33h30m58.8806717s) [noise=true , address=212.102.52.213:4322 , piece_id=GKO5QOE52VYHZ55S4MODTYTP35FHEV3X3GZ6LGAMMYCBAP64LSSA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097455767 (33h30m58.880795856s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KAQ6XCg6V2H4a7xAsWDtXLsfbfVs3DTVFHTWUGUnwQLkF79EK): protocol: expected piece hash; context canceled; EOF May 26 11:35:13.097461388 (33h30m58.880801487s) [noise=true , address=212.102.52.215:4390 , piece_id=QOLA7LL4VRYSJW2M6MKCSMGHNTEZWJAHFKFDRELS3EGVL4K4ELMA, seg_pos={0 0}, upload=32098]: Long tail cancellation due to optimal threshold May 26 11:35:13.097499872 (33h30m58.880839971s) [seg_pos={0 0}, upload=32098]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 11:35:13.097564916 (33h30m58.880905015s) [upload=32098]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 11:35:13.097569725 (33h30m58.880909824s) [upload=32098]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 11:35:37.962376623 (33h31m23.745716722s) [upload=32098]: Done uploading segments... May 26 11:35:37.962419524 (33h31m23.745759623s) [upload=32098]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.657435224s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)