Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 905642 reports (Page 2582 of 18113)
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [...X...........................X..............X...X....X....]
duration:
4.138488025s
trace:
https://jaeger.dev.storj.io/trace/4ae0893df65c4124
FAIL (2026-05-26 10:01:30 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 4.13852156s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................]
duration:
3.597528911s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 10:00:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.597549782s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [....X...........................X..............X...X....X...]
duration:
5.752683337s
trace:
https://jaeger.dev.storj.io/trace/4ae0893df65c4124
FAIL (2026-05-26 10:00:33 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 5.752712172s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [.....X...........................X..............X...X....X..]
duration:
4.092309044s
trace:
https://jaeger.dev.storj.io/trace/4ae0893df65c4124
FAIL (2026-05-26 09:59:48 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 4.092324254s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................]
duration:
3.580816202s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:59:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.58083596s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
6 out of 60 is failed (threshold=3) [X.....X...........................X..............X...X....X.]
duration:
4.230698619s
trace:
https://jaeger.dev.storj.io/trace/4ae0893df65c4124
FAIL (2026-05-26 09:59:30 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 4.2307091s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................]
duration:
3.731815539s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:59:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.731835727s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
6 out of 60 is failed (threshold=3) [.X.....X...........................X..............X...X....X]
duration:
1m0.001576058s
trace:
https://jaeger.dev.storj.io/trace/4ae0893df65c4124
FAIL (2026-05-26 09:59:26 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1m0.001595003s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [..X.....X...........................X..............X...X....]
duration:
8.425144152s
trace:
https://jaeger.dev.storj.io/trace/3f4d5c0720a959aa
FAIL (2026-05-26 09:58:18 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 8.425163721s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................]
duration:
3.578887052s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:58:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.578909616s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [...X.....X...........................X..............X...X...]
duration:
3.945992144s
trace:
https://jaeger.dev.storj.io/trace/3f4d5c0720a959aa
FAIL (2026-05-26 09:57:41 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 3.94601589s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................]
duration:
3.640034863s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:57:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.640090178s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................]
duration:
3.692866477s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:56:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.692911293s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [....X.....X...........................X..............X...X..]
duration:
3.94461917s
trace:
https://jaeger.dev.storj.io/trace/3f4d5c0720a959aa
FAIL (2026-05-26 09:56:45 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 3.94464549s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [.....X.....X...........................X..............X...X.]
duration:
3.989739013s
trace:
https://jaeger.dev.storj.io/trace/3f4d5c0720a959aa
FAIL (2026-05-26 09:56:09 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 3.989749383s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [......X.....X...........................X..............X...X]
duration:
1m0.000923103s
trace:
https://jaeger.dev.storj.io/trace/3f4d5c0720a959aa
FAIL (2026-05-26 09:56:05 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 1m0.000941908s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................]
duration:
3.726729578s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:55:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.726749516s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................]
duration:
3.786820769s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:55:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.786842723s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................]
duration:
3.737377946s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:54:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.737403645s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
4 out of 60 is failed (threshold=3) [.......X.....X...........................X..............X...]
duration:
3.939187299s
trace:
https://jaeger.dev.storj.io/trace/17b18657184415d1
FAIL (2026-05-26 09:54:38 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.306990546 (31h48m9.090330645s) [noise=true , address=212.102.52.216:4407  , piece_id=OJJYVSDXMF4ULPD3QGMBQUVGD6JZECLBZ4RCDPMUHNJCXRAO576Q, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307056141 (31h48m9.09039624s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307275068 (31h48m9.090615167s) [noise=true , address=212.102.52.213:4335  , piece_id=F2QMK76CXB6EVANCMPDUXEGADIQHAU74OYAKBVL7HQPK5F2IA73Q, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307444392 (31h48m9.090784491s) [noise=true , address=212.102.52.216:4393  , piece_id=YSHLTNVEUQYKLNSVXAZ5472K5P63ECP6LF4V34ASVDQKGHNXYN3A, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307578407 (31h48m9.090918496s) [noise=true , address=212.102.52.217:4433  , piece_id=7GSK5UX3ZKNLMKUUJLJNN46BDTPI2QTRJBMGGPBOA6MUOI6ZWLLQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307875624 (31h48m9.091215723s) [noise=true , address=212.102.52.216:4403  , piece_id=63SOKCFFZ4DEVL4M3YG7VFLC7IGOPGRW3D4RFLJJYGTQLF57JQBA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307884462 (31h48m9.091224561s) [noise=true , address=212.102.52.213:4340  , piece_id=KTIRLB5ZTLBY3R6VD6JPMGBJDHIBY53JKC4CV6WC6BQ3G5AYFULA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308145419 (31h48m9.091485518s) [noise=true , address=212.102.52.217:4426  , piece_id=XYM7GKIGA4PI3SXXKMQS7KL643NBSFLWBZ4JIIHWUVAH4LYFWFGQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308263044 (31h48m9.091603143s) [noise=true , address=212.102.52.214:4360  , piece_id=V3LRFEO6NW5ZGHUMFPCH57IS6ZTPRMYLBGU5MK3TGW5GHZVAADMQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308417508 (31h48m9.091757607s) [noise=true , address=212.102.52.213:4333  , piece_id=QOAUXQNWZYVKJS66JFXMG75SUX5HTIZSJVXAQZKLLQQCV7QIQTSQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308701501 (31h48m9.09204159s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308728331 (31h48m9.09206843s) [noise=true , address=212.102.52.214:4359  , piece_id=MZKBROP5HXJ6KDMBWDE5CGZ2QQY33UYYLUTV7JWPFAO6SHDRBKEQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309051859 (31h48m9.092391958s) [noise=true , address=212.102.52.215:4376  , piece_id=76SDZT3IO4ANVS2WALX7GB4YAPUTWZXQ2GCKTEKSFF5FIHWXGHBQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309090512 (31h48m9.092430611s) [noise=true , address=212.102.52.215:4389  , piece_id=6NXQTIDBQU2LBOYN6P5CAXWWSQGXGS5A2YOCJGDAFBZ7LAU2QONA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309334247 (31h48m9.092674346s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:24.378189139 (31h48m10.161529228s) [upload=30442]: Next returned nil segment
May 26 09:52:24.378199880 (31h48m10.161539979s) [upload=30442]: Waiting for error group managing segments...
May 26 09:52:24.659829502 (31h48m10.443169601s) [noise=true , address=212.102.52.215:4376  , piece_id=76SDZT3IO4ANVS2WALX7GB4YAPUTWZXQ2GCKTEKSFF5FIHWXGHBQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.663626916 (31h48m10.446967015s) [noise=true , address=212.102.52.216:4403  , piece_id=63SOKCFFZ4DEVL4M3YG7VFLC7IGOPGRW3D4RFLJJYGTQLF57JQBA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.663664118 (31h48m10.447004217s) [noise=true , address=212.102.52.213:4336  , piece_id=NN5Z4L7FP5K4KVK3NAKL4TAVZAYONNZY35BYZ3YQAOC3E7SQI3WQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.664249364 (31h48m10.447589464s) [noise=true , address=212.102.52.217:4433  , piece_id=7GSK5UX3ZKNLMKUUJLJNN46BDTPI2QTRJBMGGPBOA6MUOI6ZWLLQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.664928580 (31h48m10.448268679s) [noise=true , address=212.102.52.215:4377  , piece_id=66MYAP2K4A44KZTVLSEHTAAXNKHBSC6HELIJUEMEFEKX2UU4GX7Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.672007387 (31h48m10.455347486s) [noise=true , address=212.102.52.217:4420  , piece_id=QJE2INNSG6PX7HPWMYCI7KYPY66ZICTIVLRBRMYONTQGD67VAIJQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.672188944 (31h48m10.455529043s) [noise=true , address=212.102.52.216:4393  , piece_id=YSHLTNVEUQYKLNSVXAZ5472K5P63ECP6LF4V34ASVDQKGHNXYN3A, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.673393472 (31h48m10.456733571s) [noise=true , address=212.102.52.214:4360  , piece_id=V3LRFEO6NW5ZGHUMFPCH57IS6ZTPRMYLBGU5MK3TGW5GHZVAADMQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.679090592 (31h48m10.462430691s) [noise=true , address=212.102.52.214:4359  , piece_id=MZKBROP5HXJ6KDMBWDE5CGZ2QQY33UYYLUTV7JWPFAO6SHDRBKEQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.679902040 (31h48m10.463242129s) [noise=true , address=212.102.52.216:4402  , piece_id=E3WNXEPWX2TP4YUGJ4BC2HQLK6KQYL7HIWN3YFUGFS5CQC6ONWTA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.681332850 (31h48m10.464672939s) [noise=true , address=212.102.52.217:4426  , piece_id=XYM7GKIGA4PI3SXXKMQS7KL643NBSFLWBZ4JIIHWUVAH4LYFWFGQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.683554580 (31h48m10.466894679s) [noise=true , address=212.102.52.213:4333  , piece_id=QOAUXQNWZYVKJS66JFXMG75SUX5HTIZSJVXAQZKLLQQCV7QIQTSQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.685268600 (31h48m10.468608699s) [noise=true , address=212.102.52.213:4335  , piece_id=F2QMK76CXB6EVANCMPDUXEGADIQHAU74OYAKBVL7HQPK5F2IA73Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.685624750 (31h48m10.468964849s) [noise=true , address=212.102.52.216:4407  , piece_id=OJJYVSDXMF4ULPD3QGMBQUVGD6JZECLBZ4RCDPMUHNJCXRAO576Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.687741489 (31h48m10.471081618s) [noise=true , address=212.102.52.215:4389  , piece_id=6NXQTIDBQU2LBOYN6P5CAXWWSQGXGS5A2YOCJGDAFBZ7LAU2QONA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.688741978 (31h48m10.472082077s) [noise=true , address=212.102.52.213:4340  , piece_id=KTIRLB5ZTLBY3R6VD6JPMGBJDHIBY53JKC4CV6WC6BQ3G5AYFULA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.688751445 (31h48m10.472091544s) [seg_pos={0 0}, upload=30442]: Satisfied cohort requirements after 16 pieces
May 26 09:52:24.688933493 (31h48m10.472273592s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.688939514 (31h48m10.472279613s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689071136 (31h48m10.472411235s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689079842 (31h48m10.472419941s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689126652 (31h48m10.472466751s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689133154 (31h48m10.472473253s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689256640 (31h48m10.472596739s) [noise=true , address=212.102.52.214:4356  , piece_id=3LI47HOGCTJOKEDKMRS5O7D5JI5LOMODOF7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689261929 (31h48m10.472602029s) [noise=true , address=212.102.52.214:4356  , piece_id=3LI47HOGCTJOKEDKMRS5O7D5JI5LOMODOF7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689277630 (31h48m10.472617729s) [seg_pos={0 0}, upload=30442]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:52:24.689340830 (31h48m10.472680929s) [upload=30442]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:52:24.689346361 (31h48m10.47268645s) [upload=30442]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:52:42.323942035 (31h48m28.107282124s) [upload=30442]: Done uploading segments...
May 26 09:52:42.323956832 (31h48m28.107296932s) [upload=30442]: Upload finished. err: <nil>
Duration: 3.939211605s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................]
duration:
3.774343168s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:54:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.774369239s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
4 out of 60 is failed (threshold=3) [........X.....X...........................X..............X..]
duration:
3.970442778s
trace:
https://jaeger.dev.storj.io/trace/17b18657184415d1
FAIL (2026-05-26 09:54:10 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.306990546 (31h48m9.090330645s) [noise=true , address=212.102.52.216:4407  , piece_id=OJJYVSDXMF4ULPD3QGMBQUVGD6JZECLBZ4RCDPMUHNJCXRAO576Q, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307056141 (31h48m9.09039624s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307275068 (31h48m9.090615167s) [noise=true , address=212.102.52.213:4335  , piece_id=F2QMK76CXB6EVANCMPDUXEGADIQHAU74OYAKBVL7HQPK5F2IA73Q, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307444392 (31h48m9.090784491s) [noise=true , address=212.102.52.216:4393  , piece_id=YSHLTNVEUQYKLNSVXAZ5472K5P63ECP6LF4V34ASVDQKGHNXYN3A, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307578407 (31h48m9.090918496s) [noise=true , address=212.102.52.217:4433  , piece_id=7GSK5UX3ZKNLMKUUJLJNN46BDTPI2QTRJBMGGPBOA6MUOI6ZWLLQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307875624 (31h48m9.091215723s) [noise=true , address=212.102.52.216:4403  , piece_id=63SOKCFFZ4DEVL4M3YG7VFLC7IGOPGRW3D4RFLJJYGTQLF57JQBA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307884462 (31h48m9.091224561s) [noise=true , address=212.102.52.213:4340  , piece_id=KTIRLB5ZTLBY3R6VD6JPMGBJDHIBY53JKC4CV6WC6BQ3G5AYFULA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308145419 (31h48m9.091485518s) [noise=true , address=212.102.52.217:4426  , piece_id=XYM7GKIGA4PI3SXXKMQS7KL643NBSFLWBZ4JIIHWUVAH4LYFWFGQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308263044 (31h48m9.091603143s) [noise=true , address=212.102.52.214:4360  , piece_id=V3LRFEO6NW5ZGHUMFPCH57IS6ZTPRMYLBGU5MK3TGW5GHZVAADMQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308417508 (31h48m9.091757607s) [noise=true , address=212.102.52.213:4333  , piece_id=QOAUXQNWZYVKJS66JFXMG75SUX5HTIZSJVXAQZKLLQQCV7QIQTSQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308701501 (31h48m9.09204159s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308728331 (31h48m9.09206843s) [noise=true , address=212.102.52.214:4359  , piece_id=MZKBROP5HXJ6KDMBWDE5CGZ2QQY33UYYLUTV7JWPFAO6SHDRBKEQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309051859 (31h48m9.092391958s) [noise=true , address=212.102.52.215:4376  , piece_id=76SDZT3IO4ANVS2WALX7GB4YAPUTWZXQ2GCKTEKSFF5FIHWXGHBQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309090512 (31h48m9.092430611s) [noise=true , address=212.102.52.215:4389  , piece_id=6NXQTIDBQU2LBOYN6P5CAXWWSQGXGS5A2YOCJGDAFBZ7LAU2QONA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309334247 (31h48m9.092674346s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:24.378189139 (31h48m10.161529228s) [upload=30442]: Next returned nil segment
May 26 09:52:24.378199880 (31h48m10.161539979s) [upload=30442]: Waiting for error group managing segments...
May 26 09:52:24.659829502 (31h48m10.443169601s) [noise=true , address=212.102.52.215:4376  , piece_id=76SDZT3IO4ANVS2WALX7GB4YAPUTWZXQ2GCKTEKSFF5FIHWXGHBQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.663626916 (31h48m10.446967015s) [noise=true , address=212.102.52.216:4403  , piece_id=63SOKCFFZ4DEVL4M3YG7VFLC7IGOPGRW3D4RFLJJYGTQLF57JQBA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.663664118 (31h48m10.447004217s) [noise=true , address=212.102.52.213:4336  , piece_id=NN5Z4L7FP5K4KVK3NAKL4TAVZAYONNZY35BYZ3YQAOC3E7SQI3WQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.664249364 (31h48m10.447589464s) [noise=true , address=212.102.52.217:4433  , piece_id=7GSK5UX3ZKNLMKUUJLJNN46BDTPI2QTRJBMGGPBOA6MUOI6ZWLLQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.664928580 (31h48m10.448268679s) [noise=true , address=212.102.52.215:4377  , piece_id=66MYAP2K4A44KZTVLSEHTAAXNKHBSC6HELIJUEMEFEKX2UU4GX7Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.672007387 (31h48m10.455347486s) [noise=true , address=212.102.52.217:4420  , piece_id=QJE2INNSG6PX7HPWMYCI7KYPY66ZICTIVLRBRMYONTQGD67VAIJQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.672188944 (31h48m10.455529043s) [noise=true , address=212.102.52.216:4393  , piece_id=YSHLTNVEUQYKLNSVXAZ5472K5P63ECP6LF4V34ASVDQKGHNXYN3A, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.673393472 (31h48m10.456733571s) [noise=true , address=212.102.52.214:4360  , piece_id=V3LRFEO6NW5ZGHUMFPCH57IS6ZTPRMYLBGU5MK3TGW5GHZVAADMQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.679090592 (31h48m10.462430691s) [noise=true , address=212.102.52.214:4359  , piece_id=MZKBROP5HXJ6KDMBWDE5CGZ2QQY33UYYLUTV7JWPFAO6SHDRBKEQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.679902040 (31h48m10.463242129s) [noise=true , address=212.102.52.216:4402  , piece_id=E3WNXEPWX2TP4YUGJ4BC2HQLK6KQYL7HIWN3YFUGFS5CQC6ONWTA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.681332850 (31h48m10.464672939s) [noise=true , address=212.102.52.217:4426  , piece_id=XYM7GKIGA4PI3SXXKMQS7KL643NBSFLWBZ4JIIHWUVAH4LYFWFGQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.683554580 (31h48m10.466894679s) [noise=true , address=212.102.52.213:4333  , piece_id=QOAUXQNWZYVKJS66JFXMG75SUX5HTIZSJVXAQZKLLQQCV7QIQTSQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.685268600 (31h48m10.468608699s) [noise=true , address=212.102.52.213:4335  , piece_id=F2QMK76CXB6EVANCMPDUXEGADIQHAU74OYAKBVL7HQPK5F2IA73Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.685624750 (31h48m10.468964849s) [noise=true , address=212.102.52.216:4407  , piece_id=OJJYVSDXMF4ULPD3QGMBQUVGD6JZECLBZ4RCDPMUHNJCXRAO576Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.687741489 (31h48m10.471081618s) [noise=true , address=212.102.52.215:4389  , piece_id=6NXQTIDBQU2LBOYN6P5CAXWWSQGXGS5A2YOCJGDAFBZ7LAU2QONA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.688741978 (31h48m10.472082077s) [noise=true , address=212.102.52.213:4340  , piece_id=KTIRLB5ZTLBY3R6VD6JPMGBJDHIBY53JKC4CV6WC6BQ3G5AYFULA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.688751445 (31h48m10.472091544s) [seg_pos={0 0}, upload=30442]: Satisfied cohort requirements after 16 pieces
May 26 09:52:24.688933493 (31h48m10.472273592s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.688939514 (31h48m10.472279613s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689071136 (31h48m10.472411235s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689079842 (31h48m10.472419941s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689126652 (31h48m10.472466751s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689133154 (31h48m10.472473253s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689256640 (31h48m10.472596739s) [noise=true , address=212.102.52.214:4356  , piece_id=3LI47HOGCTJOKEDKMRS5O7D5JI5LOMODOF7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689261929 (31h48m10.472602029s) [noise=true , address=212.102.52.214:4356  , piece_id=3LI47HOGCTJOKEDKMRS5O7D5JI5LOMODOF7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689277630 (31h48m10.472617729s) [seg_pos={0 0}, upload=30442]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:52:24.689340830 (31h48m10.472680929s) [upload=30442]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:52:24.689346361 (31h48m10.47268645s) [upload=30442]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:52:42.323942035 (31h48m28.107282124s) [upload=30442]: Done uploading segments...
May 26 09:52:42.323956832 (31h48m28.107296932s) [upload=30442]: Upload finished. err: <nil>
Duration: 3.970462615s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.........................................X..................]
duration:
3.832099295s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:53:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.832123221s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..........................................X.................]
duration:
3.88770116s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:53:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.887721139s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
4 out of 60 is failed (threshold=3) [.........X.....X...........................X..............X.]
duration:
4.103385857s
trace:
https://jaeger.dev.storj.io/trace/17b18657184415d1
FAIL (2026-05-26 09:52:55 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.306990546 (31h48m9.090330645s) [noise=true , address=212.102.52.216:4407  , piece_id=OJJYVSDXMF4ULPD3QGMBQUVGD6JZECLBZ4RCDPMUHNJCXRAO576Q, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307056141 (31h48m9.09039624s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307275068 (31h48m9.090615167s) [noise=true , address=212.102.52.213:4335  , piece_id=F2QMK76CXB6EVANCMPDUXEGADIQHAU74OYAKBVL7HQPK5F2IA73Q, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307444392 (31h48m9.090784491s) [noise=true , address=212.102.52.216:4393  , piece_id=YSHLTNVEUQYKLNSVXAZ5472K5P63ECP6LF4V34ASVDQKGHNXYN3A, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307578407 (31h48m9.090918496s) [noise=true , address=212.102.52.217:4433  , piece_id=7GSK5UX3ZKNLMKUUJLJNN46BDTPI2QTRJBMGGPBOA6MUOI6ZWLLQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307875624 (31h48m9.091215723s) [noise=true , address=212.102.52.216:4403  , piece_id=63SOKCFFZ4DEVL4M3YG7VFLC7IGOPGRW3D4RFLJJYGTQLF57JQBA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307884462 (31h48m9.091224561s) [noise=true , address=212.102.52.213:4340  , piece_id=KTIRLB5ZTLBY3R6VD6JPMGBJDHIBY53JKC4CV6WC6BQ3G5AYFULA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308145419 (31h48m9.091485518s) [noise=true , address=212.102.52.217:4426  , piece_id=XYM7GKIGA4PI3SXXKMQS7KL643NBSFLWBZ4JIIHWUVAH4LYFWFGQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308263044 (31h48m9.091603143s) [noise=true , address=212.102.52.214:4360  , piece_id=V3LRFEO6NW5ZGHUMFPCH57IS6ZTPRMYLBGU5MK3TGW5GHZVAADMQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308417508 (31h48m9.091757607s) [noise=true , address=212.102.52.213:4333  , piece_id=QOAUXQNWZYVKJS66JFXMG75SUX5HTIZSJVXAQZKLLQQCV7QIQTSQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308701501 (31h48m9.09204159s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308728331 (31h48m9.09206843s) [noise=true , address=212.102.52.214:4359  , piece_id=MZKBROP5HXJ6KDMBWDE5CGZ2QQY33UYYLUTV7JWPFAO6SHDRBKEQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309051859 (31h48m9.092391958s) [noise=true , address=212.102.52.215:4376  , piece_id=76SDZT3IO4ANVS2WALX7GB4YAPUTWZXQ2GCKTEKSFF5FIHWXGHBQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309090512 (31h48m9.092430611s) [noise=true , address=212.102.52.215:4389  , piece_id=6NXQTIDBQU2LBOYN6P5CAXWWSQGXGS5A2YOCJGDAFBZ7LAU2QONA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309334247 (31h48m9.092674346s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:24.378189139 (31h48m10.161529228s) [upload=30442]: Next returned nil segment
May 26 09:52:24.378199880 (31h48m10.161539979s) [upload=30442]: Waiting for error group managing segments...
May 26 09:52:24.659829502 (31h48m10.443169601s) [noise=true , address=212.102.52.215:4376  , piece_id=76SDZT3IO4ANVS2WALX7GB4YAPUTWZXQ2GCKTEKSFF5FIHWXGHBQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.663626916 (31h48m10.446967015s) [noise=true , address=212.102.52.216:4403  , piece_id=63SOKCFFZ4DEVL4M3YG7VFLC7IGOPGRW3D4RFLJJYGTQLF57JQBA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.663664118 (31h48m10.447004217s) [noise=true , address=212.102.52.213:4336  , piece_id=NN5Z4L7FP5K4KVK3NAKL4TAVZAYONNZY35BYZ3YQAOC3E7SQI3WQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.664249364 (31h48m10.447589464s) [noise=true , address=212.102.52.217:4433  , piece_id=7GSK5UX3ZKNLMKUUJLJNN46BDTPI2QTRJBMGGPBOA6MUOI6ZWLLQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.664928580 (31h48m10.448268679s) [noise=true , address=212.102.52.215:4377  , piece_id=66MYAP2K4A44KZTVLSEHTAAXNKHBSC6HELIJUEMEFEKX2UU4GX7Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.672007387 (31h48m10.455347486s) [noise=true , address=212.102.52.217:4420  , piece_id=QJE2INNSG6PX7HPWMYCI7KYPY66ZICTIVLRBRMYONTQGD67VAIJQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.672188944 (31h48m10.455529043s) [noise=true , address=212.102.52.216:4393  , piece_id=YSHLTNVEUQYKLNSVXAZ5472K5P63ECP6LF4V34ASVDQKGHNXYN3A, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.673393472 (31h48m10.456733571s) [noise=true , address=212.102.52.214:4360  , piece_id=V3LRFEO6NW5ZGHUMFPCH57IS6ZTPRMYLBGU5MK3TGW5GHZVAADMQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.679090592 (31h48m10.462430691s) [noise=true , address=212.102.52.214:4359  , piece_id=MZKBROP5HXJ6KDMBWDE5CGZ2QQY33UYYLUTV7JWPFAO6SHDRBKEQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.679902040 (31h48m10.463242129s) [noise=true , address=212.102.52.216:4402  , piece_id=E3WNXEPWX2TP4YUGJ4BC2HQLK6KQYL7HIWN3YFUGFS5CQC6ONWTA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.681332850 (31h48m10.464672939s) [noise=true , address=212.102.52.217:4426  , piece_id=XYM7GKIGA4PI3SXXKMQS7KL643NBSFLWBZ4JIIHWUVAH4LYFWFGQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.683554580 (31h48m10.466894679s) [noise=true , address=212.102.52.213:4333  , piece_id=QOAUXQNWZYVKJS66JFXMG75SUX5HTIZSJVXAQZKLLQQCV7QIQTSQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.685268600 (31h48m10.468608699s) [noise=true , address=212.102.52.213:4335  , piece_id=F2QMK76CXB6EVANCMPDUXEGADIQHAU74OYAKBVL7HQPK5F2IA73Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.685624750 (31h48m10.468964849s) [noise=true , address=212.102.52.216:4407  , piece_id=OJJYVSDXMF4ULPD3QGMBQUVGD6JZECLBZ4RCDPMUHNJCXRAO576Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.687741489 (31h48m10.471081618s) [noise=true , address=212.102.52.215:4389  , piece_id=6NXQTIDBQU2LBOYN6P5CAXWWSQGXGS5A2YOCJGDAFBZ7LAU2QONA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.688741978 (31h48m10.472082077s) [noise=true , address=212.102.52.213:4340  , piece_id=KTIRLB5ZTLBY3R6VD6JPMGBJDHIBY53JKC4CV6WC6BQ3G5AYFULA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.688751445 (31h48m10.472091544s) [seg_pos={0 0}, upload=30442]: Satisfied cohort requirements after 16 pieces
May 26 09:52:24.688933493 (31h48m10.472273592s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.688939514 (31h48m10.472279613s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689071136 (31h48m10.472411235s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689079842 (31h48m10.472419941s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689126652 (31h48m10.472466751s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689133154 (31h48m10.472473253s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689256640 (31h48m10.472596739s) [noise=true , address=212.102.52.214:4356  , piece_id=3LI47HOGCTJOKEDKMRS5O7D5JI5LOMODOF7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689261929 (31h48m10.472602029s) [noise=true , address=212.102.52.214:4356  , piece_id=3LI47HOGCTJOKEDKMRS5O7D5JI5LOMODOF7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689277630 (31h48m10.472617729s) [seg_pos={0 0}, upload=30442]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:52:24.689340830 (31h48m10.472680929s) [upload=30442]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:52:24.689346361 (31h48m10.47268645s) [upload=30442]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:52:42.323942035 (31h48m28.107282124s) [upload=30442]: Done uploading segments...
May 26 09:52:42.323956832 (31h48m28.107296932s) [upload=30442]: Upload finished. err: <nil>
Duration: 4.103401407s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
4 out of 60 is failed (threshold=3) [..........X.....X...........................X..............X]
duration:
1m0.00266825s
trace:
https://jaeger.dev.storj.io/trace/17b18657184415d1
FAIL (2026-05-26 09:52:51 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.306990546 (31h48m9.090330645s) [noise=true , address=212.102.52.216:4407  , piece_id=OJJYVSDXMF4ULPD3QGMBQUVGD6JZECLBZ4RCDPMUHNJCXRAO576Q, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307056141 (31h48m9.09039624s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307275068 (31h48m9.090615167s) [noise=true , address=212.102.52.213:4335  , piece_id=F2QMK76CXB6EVANCMPDUXEGADIQHAU74OYAKBVL7HQPK5F2IA73Q, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307444392 (31h48m9.090784491s) [noise=true , address=212.102.52.216:4393  , piece_id=YSHLTNVEUQYKLNSVXAZ5472K5P63ECP6LF4V34ASVDQKGHNXYN3A, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307578407 (31h48m9.090918496s) [noise=true , address=212.102.52.217:4433  , piece_id=7GSK5UX3ZKNLMKUUJLJNN46BDTPI2QTRJBMGGPBOA6MUOI6ZWLLQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307875624 (31h48m9.091215723s) [noise=true , address=212.102.52.216:4403  , piece_id=63SOKCFFZ4DEVL4M3YG7VFLC7IGOPGRW3D4RFLJJYGTQLF57JQBA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.307884462 (31h48m9.091224561s) [noise=true , address=212.102.52.213:4340  , piece_id=KTIRLB5ZTLBY3R6VD6JPMGBJDHIBY53JKC4CV6WC6BQ3G5AYFULA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308145419 (31h48m9.091485518s) [noise=true , address=212.102.52.217:4426  , piece_id=XYM7GKIGA4PI3SXXKMQS7KL643NBSFLWBZ4JIIHWUVAH4LYFWFGQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308263044 (31h48m9.091603143s) [noise=true , address=212.102.52.214:4360  , piece_id=V3LRFEO6NW5ZGHUMFPCH57IS6ZTPRMYLBGU5MK3TGW5GHZVAADMQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308417508 (31h48m9.091757607s) [noise=true , address=212.102.52.213:4333  , piece_id=QOAUXQNWZYVKJS66JFXMG75SUX5HTIZSJVXAQZKLLQQCV7QIQTSQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308701501 (31h48m9.09204159s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.308728331 (31h48m9.09206843s) [noise=true , address=212.102.52.214:4359  , piece_id=MZKBROP5HXJ6KDMBWDE5CGZ2QQY33UYYLUTV7JWPFAO6SHDRBKEQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309051859 (31h48m9.092391958s) [noise=true , address=212.102.52.215:4376  , piece_id=76SDZT3IO4ANVS2WALX7GB4YAPUTWZXQ2GCKTEKSFF5FIHWXGHBQ, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309090512 (31h48m9.092430611s) [noise=true , address=212.102.52.215:4389  , piece_id=6NXQTIDBQU2LBOYN6P5CAXWWSQGXGS5A2YOCJGDAFBZ7LAU2QONA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:23.309334247 (31h48m9.092674346s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Uploading piece...
May 26 09:52:24.378189139 (31h48m10.161529228s) [upload=30442]: Next returned nil segment
May 26 09:52:24.378199880 (31h48m10.161539979s) [upload=30442]: Waiting for error group managing segments...
May 26 09:52:24.659829502 (31h48m10.443169601s) [noise=true , address=212.102.52.215:4376  , piece_id=76SDZT3IO4ANVS2WALX7GB4YAPUTWZXQ2GCKTEKSFF5FIHWXGHBQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.663626916 (31h48m10.446967015s) [noise=true , address=212.102.52.216:4403  , piece_id=63SOKCFFZ4DEVL4M3YG7VFLC7IGOPGRW3D4RFLJJYGTQLF57JQBA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.663664118 (31h48m10.447004217s) [noise=true , address=212.102.52.213:4336  , piece_id=NN5Z4L7FP5K4KVK3NAKL4TAVZAYONNZY35BYZ3YQAOC3E7SQI3WQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.664249364 (31h48m10.447589464s) [noise=true , address=212.102.52.217:4433  , piece_id=7GSK5UX3ZKNLMKUUJLJNN46BDTPI2QTRJBMGGPBOA6MUOI6ZWLLQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.664928580 (31h48m10.448268679s) [noise=true , address=212.102.52.215:4377  , piece_id=66MYAP2K4A44KZTVLSEHTAAXNKHBSC6HELIJUEMEFEKX2UU4GX7Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.672007387 (31h48m10.455347486s) [noise=true , address=212.102.52.217:4420  , piece_id=QJE2INNSG6PX7HPWMYCI7KYPY66ZICTIVLRBRMYONTQGD67VAIJQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.672188944 (31h48m10.455529043s) [noise=true , address=212.102.52.216:4393  , piece_id=YSHLTNVEUQYKLNSVXAZ5472K5P63ECP6LF4V34ASVDQKGHNXYN3A, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.673393472 (31h48m10.456733571s) [noise=true , address=212.102.52.214:4360  , piece_id=V3LRFEO6NW5ZGHUMFPCH57IS6ZTPRMYLBGU5MK3TGW5GHZVAADMQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.679090592 (31h48m10.462430691s) [noise=true , address=212.102.52.214:4359  , piece_id=MZKBROP5HXJ6KDMBWDE5CGZ2QQY33UYYLUTV7JWPFAO6SHDRBKEQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.679902040 (31h48m10.463242129s) [noise=true , address=212.102.52.216:4402  , piece_id=E3WNXEPWX2TP4YUGJ4BC2HQLK6KQYL7HIWN3YFUGFS5CQC6ONWTA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.681332850 (31h48m10.464672939s) [noise=true , address=212.102.52.217:4426  , piece_id=XYM7GKIGA4PI3SXXKMQS7KL643NBSFLWBZ4JIIHWUVAH4LYFWFGQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.683554580 (31h48m10.466894679s) [noise=true , address=212.102.52.213:4333  , piece_id=QOAUXQNWZYVKJS66JFXMG75SUX5HTIZSJVXAQZKLLQQCV7QIQTSQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.685268600 (31h48m10.468608699s) [noise=true , address=212.102.52.213:4335  , piece_id=F2QMK76CXB6EVANCMPDUXEGADIQHAU74OYAKBVL7HQPK5F2IA73Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.685624750 (31h48m10.468964849s) [noise=true , address=212.102.52.216:4407  , piece_id=OJJYVSDXMF4ULPD3QGMBQUVGD6JZECLBZ4RCDPMUHNJCXRAO576Q, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.687741489 (31h48m10.471081618s) [noise=true , address=212.102.52.215:4389  , piece_id=6NXQTIDBQU2LBOYN6P5CAXWWSQGXGS5A2YOCJGDAFBZ7LAU2QONA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.688741978 (31h48m10.472082077s) [noise=true , address=212.102.52.213:4340  , piece_id=KTIRLB5ZTLBY3R6VD6JPMGBJDHIBY53JKC4CV6WC6BQ3G5AYFULA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: <nil>
May 26 09:52:24.688751445 (31h48m10.472091544s) [seg_pos={0 0}, upload=30442]: Satisfied cohort requirements after 16 pieces
May 26 09:52:24.688933493 (31h48m10.472273592s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bxeEAEMntffvtmk2odFcueSUATJuPxxX1H1rFEHvVZH1JpreC): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.688939514 (31h48m10.472279613s) [noise=true , address=212.102.52.217:4419  , piece_id=OS5ETZLW6VNUSLOLFRLG4GKPR5NDFK6FIJ3OHE6ZZSEXGGWQBNCQ, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689071136 (31h48m10.472411235s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689079842 (31h48m10.472419941s) [noise=true , address=212.102.52.214:4362  , piece_id=Y22GVU2YC542KQANXO2D3MPV6M6TTNHGO422FOPYQV27OKIBKXBQ, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689126652 (31h48m10.472466751s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689133154 (31h48m10.472473253s) [noise=true , address=212.102.52.215:4381  , piece_id=CETQ3DGTFRX4JKDGORC7B3PR25LIA34FEVH5CTDW667F3SYYRBVA, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689256640 (31h48m10.472596739s) [noise=true , address=212.102.52.214:4356  , piece_id=3LI47HOGCTJOKEDKMRS5O7D5JI5LOMODOF7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1263MPtQZy9iB1pxhBYqZ9tgqitVmjm2X7gyehcdSRja9kWfPKd): protocol: expected piece hash; context canceled; EOF
May 26 09:52:24.689261929 (31h48m10.472602029s) [noise=true , address=212.102.52.214:4356  , piece_id=3LI47HOGCTJOKEDKMRS5O7D5JI5LOMODOF7HUYELMOG7ZZCV2YFA, seg_pos={0 0}, upload=30442]: Long tail cancellation due to optimal threshold
May 26 09:52:24.689277630 (31h48m10.472617729s) [seg_pos={0 0}, upload=30442]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:52:24.689340830 (31h48m10.472680929s) [upload=30442]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:52:24.689346361 (31h48m10.47268645s) [upload=30442]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:52:42.323942035 (31h48m28.107282124s) [upload=30442]: Done uploading segments...
May 26 09:52:42.323956832 (31h48m28.107296932s) [upload=30442]: Upload finished. err: <nil>
Duration: 1m0.002686605s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...........................................X................]
duration:
3.781278488s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:52:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.781299988s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
3 out of 60 is failed (threshold=3) [...........X.....X...........................X..............]
duration:
4.062410264s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:51:33 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.062430443s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [............................................X...............]
duration:
3.765869918s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:51:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.76589204s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.............................................X..............]
duration:
3.7867229s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:50:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.786743249s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
3 out of 60 is failed (threshold=3) [............X.....X...........................X.............]
duration:
4.036216204s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:50:39 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.03623531s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
3 out of 60 is failed (threshold=3) [.............X.....X...........................X............]
duration:
3.892284784s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:49:59 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.892300866s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..............................................X.............]
duration:
3.670604439s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:49:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.670627694s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
3 out of 60 is failed (threshold=3) [..............X.....X...........................X...........]
duration:
5.210562278s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:49:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.210575113s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...............................................X............]
duration:
3.733059205s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:48:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.733119261s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
3 out of 60 is failed (threshold=3) [...............X.....X...........................X..........]
duration:
7.207856945s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:48:09 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.207877544s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [................................................X...........]
duration:
3.73533903s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:47:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.735358947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
3 out of 60 is failed (threshold=3) [................X.....X...........................X.........]
duration:
3.959658999s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:47:31 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.959680099s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
3 out of 60 is failed (threshold=3) [.................X.....X...........................X........]
duration:
4.065840136s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:47:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.065913295s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.................................................X..........]
duration:
3.67315684s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:47:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.673177789s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
3 out of 60 is failed (threshold=3) [..................X.....X...........................X.......]
duration:
6.18607772s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:46:45 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.186101625s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..................................................X.........]
duration:
3.910871801s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:46:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.911189518s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
4 out of 60 is failed (threshold=3) [X..................X.....X...........................X......]
duration:
4.045535518s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:45:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.045558051s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...................................................X........]
duration:
3.889537226s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:45:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.889554148s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [XX..................X.....X...........................X.....]
duration:
3.981593491s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:45:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 3.981616074s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....................................................X.......]
duration:
3.797010346s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:44:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.797334354s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [.XX..................X.....X...........................X....]
duration:
4.136394185s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:44:21 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.13641198s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......]
duration:
3.749685039s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:44:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.749700639s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....]
duration:
3.718863823s
trace:
https://jaeger.dev.storj.io/trace/4f22cdb4d3d35a26
FAIL (2026-05-26 09:43:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.718892749s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)
antiblip:
5 out of 60 is failed (threshold=3) [..XX..................X.....X...........................X...]
duration:
4.88423573s
trace:
https://jaeger.dev.storj.io/trace/257d591a1c575668
FAIL (2026-05-26 09:43:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
30261]: Uploading piece...
May 26 09:41:53.171606112 (31h37m38.954946211s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171859346 (31h37m38.955199445s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.171911364 (31h37m38.955251453s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172209363 (31h37m38.955549452s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172386261 (31h37m38.95572636s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172491501 (31h37m38.9558316s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172769192 (31h37m38.956109291s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.172853562 (31h37m38.956193671s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173054435 (31h37m38.956394534s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173277641 (31h37m38.95661774s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173344720 (31h37m38.956684819s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173602070 (31h37m38.956942169s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173693114 (31h37m38.957033213s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.173880401 (31h37m38.9572205s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:53.174092666 (31h37m38.957432765s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Uploading piece...
May 26 09:41:54.240666175 (31h37m40.024006274s) [upload=30261]: Next returned nil segment
May 26 09:41:54.240677165 (31h37m40.024017264s) [upload=30261]: Waiting for error group managing segments...
May 26 09:41:54.524605392 (31h37m40.307945481s) [noise=true , address=212.102.52.217:4420  , piece_id=GAWAYLVUX6LJSBAIA6H4Y2SJN6SYFRCHTUOWMG4F37N5VOOLEEJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.525724147 (31h37m40.309064246s) [noise=true , address=212.102.52.213:4339  , piece_id=KREE7GH4LG3K3QHYF5KXJNSAG3HLMJEOLG77BZPT5SQNQLZ4EARQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.527010031 (31h37m40.31035012s) [noise=true , address=212.102.52.214:4358  , piece_id=3MU7A3OZWPHBGEUWCO3IXOJZUXFSNA33QEZFHY4LUX3NQQZU4WGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.528100822 (31h37m40.311440921s) [noise=true , address=212.102.52.216:4412  , piece_id=5WURMTNNQXDPKX7D22DVXJRPAQTHWO2RYWTXHJ7SDHVF2CKSRPDQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.529764746 (31h37m40.313104836s) [noise=true , address=212.102.52.217:4427  , piece_id=NJLBOXFVPSF5BUY5ZU3MITBBXSSXQFG56FHFFDRXLRQ3YO4ZJPYA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530109594 (31h37m40.313449693s) [noise=true , address=212.102.52.216:4404  , piece_id=73PIWGZJIV37P25UQQHCAWOMKD4Z4T4KDEWRYQ65WJE5WTY4HASA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.530715039 (31h37m40.314055128s) [noise=true , address=212.102.52.215:4370  , piece_id=MVWOW4K6WRXKH6BWIAE2ZT4ZJW6SSO6LS62DXHEHVYPTPZD3WZGQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.533248032 (31h37m40.316588121s) [noise=true , address=212.102.52.215:4372  , piece_id=2QMH5P7OZJMFQMYEHULZ3PMEUH5FAJFWOQ3EB74OQI2PGLTD5FPA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.534807879 (31h37m40.318147978s) [noise=true , address=212.102.52.217:4428  , piece_id=AGRGLGVP4IBJ64RHGQE6MGKEUKWIVGDTJLJMWRAKHI3XEKL3FAXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.539604321 (31h37m40.32294442s) [noise=true , address=212.102.52.214:4345  , piece_id=WTT3UDVIKG3D7VRTXCHCXE3ST67Z7TK6NMMR2OL5SE3N6AK2RJAA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.541641277 (31h37m40.324981366s) [noise=true , address=212.102.52.213:4340  , piece_id=RGFFKNM2XG2QK4ONCHOGYN2TNJSPMDMRYL5YFV6WENKBBTL3R6IQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.543192176 (31h37m40.326532265s) [noise=true , address=212.102.52.213:4325  , piece_id=TY2J4AILWM47LCXFUL4JZ7AK2MDYKSFY5MRT4PAZEYQZO2ZOHCKQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.552490038 (31h37m40.335830137s) [noise=true , address=212.102.52.215:4390  , piece_id=NIW6EL4O5GYWYXD4BEOXZO2XK7I64Y4WGOZUWPIIEOVMHSSPLQ6A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.553925927 (31h37m40.337266026s) [noise=true , address=212.102.52.216:4414  , piece_id=LLUXGLZ37ICEODT6B4QEEZ7Q3RHPHGNOAGZOAO5JW4DW5YI3U7UQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.582232076 (31h37m40.365572176s) [noise=true , address=212.102.52.214:4352  , piece_id=FDFFSVZ6OYMILQXHCCZ3V47DRY3JYSG5Q4PRTRI5UKISGQYPCLXQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593725617 (31h37m40.377065716s) [noise=true , address=212.102.52.215:4369  , piece_id=T5DVT7F3SHJIMZWXEK6CK5UBAJRYFATWU35BPZYLCJUHF6L3LSHA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: <nil>
May 26 09:41:54.593744122 (31h37m40.377084221s) [seg_pos={0 0}, upload=30261]: Satisfied cohort requirements after 16 pieces
May 26 09:41:54.593994159 (31h37m40.377334258s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594000491 (31h37m40.377340591s) [noise=true , address=212.102.52.217:4437  , piece_id=GFAEZQNAL2E7BTCI42JNFISZCKST5BDXDHN4KR2DY3MSUP3TW45A, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594134356 (31h37m40.377474446s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594139145 (31h37m40.377479235s) [noise=true , address=212.102.52.213:4326  , piece_id=UFPJ7EKHQYYDKTUD2PDRWYDUFN5OJXCW7BB5QXOZJX326JQJTKTQ, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594227895 (31h37m40.377567994s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BsdeZy1odVCAgcjxU6KdveXhUUTJKviRrrHLNCUuVergW6zVk): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594232423 (31h37m40.377572522s) [noise=true , address=212.102.52.216:4408  , piece_id=SGG2I56X2MKVT6GEJKNFZXM2CM2EWMC3RFIGYK3UXCXCZALDAWMA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594365718 (31h37m40.377705817s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF
May 26 09:41:54.594382149 (31h37m40.377722248s) [noise=true , address=212.102.52.214:4349  , piece_id=XM5TE6KMBM6PSOWMFREJDOF6QIZVWTHBQXWUB2SJ6ZKVUBPBEXJA, seg_pos={0 0}, upload=30261]: Long tail cancellation due to optimal threshold
May 26 09:41:54.594400204 (31h37m40.377740303s) [seg_pos={0 0}, upload=30261]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 09:41:54.594493051 (31h37m40.37783315s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 09:41:54.594497399 (31h37m40.377837498s) [upload=30261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 09:42:53.194114292 (31h38m38.977454391s) [upload=30261]: Done uploading segments...
May 26 09:42:53.194187341 (31h38m38.977527441s) [upload=30261]: Upload finished. err: metaclient: context deadline exceeded
Duration: 4.8842574s core uplink uk-select-1 uk1-placement-17