Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.864741457s trace:
https://jaeger.dev.storj.io/trace/70fcc11ecddb66b2
FAIL (2026-01-13 15:00:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 13 14:58:20.405741809 (935h29m20.276824854s) [upload=818796]: Starting upload
Jan 13 14:58:20.405840697 (935h29m20.276923762s) [upload=818796]: Done starting upload
Jan 13 14:58:20.405953662 (935h29m20.277036697s) [upload=818796]: Uploading segments...
Jan 13 14:58:20.406134045 (935h29m20.27721709s) [upload=818796]: Got next segment. Inline: false
Jan 13 14:58:20.406171537 (935h29m20.277254582s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 13 14:58:20.406177257 (935h29m20.277260303s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 13 14:58:20.989941022 (935h29m20.861024067s) [seg_pos={0 0}, upload=818796]: Begin upload segment...
Jan 13 14:58:20.989998812 (935h29m20.861081857s) [seg_pos={0 0}, upload=818796]: Done begin upload segment.
Jan 13 14:58:20.990058015 (935h29m20.86114106s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.990069437 (935h29m20.861152472s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.990692603 (935h29m20.861775638s) [noise=true , address=145.79.227.14:4837 , piece_id=HL7VLA4IPL23MSEHGWQVQPV5BNO6NEWFDSPVZNYRIIFUFXXBLULQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991108856 (935h29m20.862191891s) [noise=true , address=145.79.227.11:4730 , piece_id=4QONQVZH4EHW44BN7MS5MZEKL5LCJ2WT4J4S6SOEYQ22VLDDQ5TQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991521741 (935h29m20.862604787s) [noise=true , address=145.79.227.18:4006 , piece_id=3OIZDHJ42VPXWSFC7O57U53EBYEB43C34AMVXXSYZDOGOOQ7JQ5Q, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991911605 (935h29m20.86299465s) [noise=true , address=145.79.227.19:4077 , piece_id=7K5RSWATDE47EWQRQ5PH5HU777QLCD5SVJPJY5LBYYJGEEHD6HDA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.992330562 (935h29m20.863413597s) [noise=true , address=145.79.227.46:4601 , piece_id=CEPWOW73BFZ7I5UEC2SMWWR6T2BGEHPG6B3WYIK23IP5CIN5OHKA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.992644180 (935h29m20.863727215s) [noise=true , address=145.79.227.44:4194 , piece_id=6V6P5EM6UMRSJ5VUWRRGD2LQX6K5V4NMWJQHW7MMZSBUVGPIFJ5A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.993069800 (935h29m20.864152835s) [noise=true , address=45.91.116.11:4119 , piece_id=XNAYXGAEJEL3TCNXG4MHZOGPFTFCYMSGQR2R7J3SNPHE4VZ6ANQQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.993449733 (935h29m20.864532768s) [noise=true , address=145.79.227.37:4565 , piece_id=J664HGQIMYYJBRCKYGSENJ4KWWEQWXTAMWCXJJMYCHDMMJ7UCTTA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.994061387 (935h29m20.865144422s) [noise=true , address=77.90.31.11:4556 , piece_id=NNJGC6WKYXOVVZZDXJELFPXWC5F4PITCIVCSPTGQECARIHVUK7OA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.995523001 (935h29m20.866606046s) [noise=true , address=145.79.227.49:4337 , piece_id=2MCT4GCPPRMO4CBEUSKADBKV6GMTSPKCF7CRYY3WQLTKIFOVQTVQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.996995013 (935h29m20.868078058s) [noise=true , address=145.79.227.34:4906 , piece_id=B4NT4ARTROLWSYPHAOHPKTDU4S7E3HXOQCNWZTVJJYM2BY22VT3A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.998321850 (935h29m20.869404885s) [noise=true , address=145.79.227.2:4115 , piece_id=LDKU6YULGG6GPHJW6JNFF22A4XZXSNMHXGJWV2EG3VH5H4ZSX6PQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.999884836 (935h29m20.870967881s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:21.003445065 (935h29m20.87452813s) [noise=true , address=45.91.116.4:4937 , piece_id=JJ72XOJHAA5DJSJJYP33PAJHVFWTYOWLPBVUM6TQNI2W6Y66QVWQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:22.858963677 (935h29m22.730046722s) [upload=818796]: Next returned nil segment
Jan 13 14:58:22.858978946 (935h29m22.730061991s) [upload=818796]: Waiting for error group managing segments...
Jan 13 14:58:23.170109204 (935h29m23.041192239s) [noise=true , address=145.79.227.44:4194 , piece_id=6V6P5EM6UMRSJ5VUWRRGD2LQX6K5V4NMWJQHW7MMZSBUVGPIFJ5A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.186162781 (935h29m23.057245816s) [noise=true , address=145.79.227.18:4006 , piece_id=3OIZDHJ42VPXWSFC7O57U53EBYEB43C34AMVXXSYZDOGOOQ7JQ5Q, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.194382592 (935h29m23.065465627s) [noise=true , address=145.79.227.11:4730 , piece_id=4QONQVZH4EHW44BN7MS5MZEKL5LCJ2WT4J4S6SOEYQ22VLDDQ5TQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.230397598 (935h29m23.101480633s) [noise=true , address=145.79.227.19:4077 , piece_id=7K5RSWATDE47EWQRQ5PH5HU777QLCD5SVJPJY5LBYYJGEEHD6HDA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.231165541 (935h29m23.102248576s) [noise=true , address=145.79.227.37:4565 , piece_id=J664HGQIMYYJBRCKYGSENJ4KWWEQWXTAMWCXJJMYCHDMMJ7UCTTA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.234866517 (935h29m23.105949563s) [noise=true , address=145.79.227.49:4337 , piece_id=2MCT4GCPPRMO4CBEUSKADBKV6GMTSPKCF7CRYY3WQLTKIFOVQTVQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.267169465 (935h29m23.1382525s) [noise=true , address=145.79.227.34:4906 , piece_id=B4NT4ARTROLWSYPHAOHPKTDU4S7E3HXOQCNWZTVJJYM2BY22VT3A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.299073002 (935h29m23.170156037s) [noise=true , address=145.79.227.2:4115 , piece_id=LDKU6YULGG6GPHJW6JNFF22A4XZXSNMHXGJWV2EG3VH5H4ZSX6PQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.572295861 (935h29m23.443378896s) [noise=true , address=45.91.116.4:4937 , piece_id=JJ72XOJHAA5DJSJJYP33PAJHVFWTYOWLPBVUM6TQNI2W6Y66QVWQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.819529393 (935h29m23.690612428s) [noise=true , address=145.79.227.14:4837 , piece_id=HL7VLA4IPL23MSEHGWQVQPV5BNO6NEWFDSPVZNYRIIFUFXXBLULQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.821950814 (935h29m23.693033859s) [noise=true , address=77.90.31.11:4556 , piece_id=NNJGC6WKYXOVVZZDXJELFPXWC5F4PITCIVCSPTGQECARIHVUK7OA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.938272061 (935h29m23.809355096s) [noise=true , address=145.79.227.46:4601 , piece_id=CEPWOW73BFZ7I5UEC2SMWWR6T2BGEHPG6B3WYIK23IP5CIN5OHKA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.992165478 (935h29m23.863248513s) [noise=true , address=45.91.116.11:4119 , piece_id=XNAYXGAEJEL3TCNXG4MHZOGPFTFCYMSGQR2R7J3SNPHE4VZ6ANQQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.992192278 (935h29m23.863275323s) [seg_pos={0 0}, upload=818796]: Segment reached optimal threshold of 13 pieces.
Jan 13 14:58:23.992481640 (935h29m23.863564675s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF
Jan 13 14:58:23.992490857 (935h29m23.863573892s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992496397 (935h29m23.863579443s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: read tcp 188.166.225.170:54712->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 14:58:23.992506046 (935h29m23.863589091s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992666491 (935h29m23.863749537s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF
Jan 13 14:58:23.992674987 (935h29m23.863758022s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992700126 (935h29m23.863783161s) [seg_pos={0 0}, upload=818796]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 13 14:58:23.992809093 (935h29m23.863892128s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 13 14:58:23.992816397 (935h29m23.863899432s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 13 14:58:24.315806947 (935h29m24.186889982s) [upload=818796]: Done uploading segments...
Jan 13 14:58:24.315825372 (935h29m24.186908408s) [upload=818796]: Upload finished. err: <nil>
Duration: 5.864761205s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X........................X................X.........] duration:
11.744631404s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 15:00:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 11.744658074s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001588802s trace:
https://jaeger.dev.storj.io/trace/2c65b2aec660a1ec
FAIL (2026-01-13 15:00:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001618608s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [.X....X................X..XX.............X......X........XX.] duration:
18.009253266s trace:
https://jaeger.dev.storj.io/trace/3466b8ff646ac0fc
FAIL (2026-01-13 15:00:03 UTC)
orbiter warning: context deadline exceeded
Duration: 18.009272933s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X......XXXXX.X] duration:
11.651635649s trace:
https://jaeger.dev.storj.io/trace/4c71af0402356d62
FAIL (2026-01-13 14:59:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 11.651647893s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [..X....X................X..XX.............X......X........XX] duration:
1m0.000664899s trace:
https://jaeger.dev.storj.io/trace/3466b8ff646ac0fc
FAIL (2026-01-13 14:59:44 UTC)
orbiter warning: context deadline exceeded
Duration: 1m0.000687351s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X........................X................X........] duration:
11.292735773s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:59:41 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 11.292765059s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [X...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X......XXXXX.] duration:
27.689681716s trace:
https://jaeger.dev.storj.io/trace/79b619221d6b8672
FAIL (2026-01-13 14:59:38 UTC)
orbiter warning: context deadline exceeded
Duration: 27.689747252s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.735470976s trace:
https://jaeger.dev.storj.io/trace/70fcc11ecddb66b2
FAIL (2026-01-13 14:59:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 13 14:58:20.405741809 (935h29m20.276824854s) [upload=818796]: Starting upload
Jan 13 14:58:20.405840697 (935h29m20.276923762s) [upload=818796]: Done starting upload
Jan 13 14:58:20.405953662 (935h29m20.277036697s) [upload=818796]: Uploading segments...
Jan 13 14:58:20.406134045 (935h29m20.27721709s) [upload=818796]: Got next segment. Inline: false
Jan 13 14:58:20.406171537 (935h29m20.277254582s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 13 14:58:20.406177257 (935h29m20.277260303s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 13 14:58:20.989941022 (935h29m20.861024067s) [seg_pos={0 0}, upload=818796]: Begin upload segment...
Jan 13 14:58:20.989998812 (935h29m20.861081857s) [seg_pos={0 0}, upload=818796]: Done begin upload segment.
Jan 13 14:58:20.990058015 (935h29m20.86114106s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.990069437 (935h29m20.861152472s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.990692603 (935h29m20.861775638s) [noise=true , address=145.79.227.14:4837 , piece_id=HL7VLA4IPL23MSEHGWQVQPV5BNO6NEWFDSPVZNYRIIFUFXXBLULQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991108856 (935h29m20.862191891s) [noise=true , address=145.79.227.11:4730 , piece_id=4QONQVZH4EHW44BN7MS5MZEKL5LCJ2WT4J4S6SOEYQ22VLDDQ5TQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991521741 (935h29m20.862604787s) [noise=true , address=145.79.227.18:4006 , piece_id=3OIZDHJ42VPXWSFC7O57U53EBYEB43C34AMVXXSYZDOGOOQ7JQ5Q, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991911605 (935h29m20.86299465s) [noise=true , address=145.79.227.19:4077 , piece_id=7K5RSWATDE47EWQRQ5PH5HU777QLCD5SVJPJY5LBYYJGEEHD6HDA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.992330562 (935h29m20.863413597s) [noise=true , address=145.79.227.46:4601 , piece_id=CEPWOW73BFZ7I5UEC2SMWWR6T2BGEHPG6B3WYIK23IP5CIN5OHKA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.992644180 (935h29m20.863727215s) [noise=true , address=145.79.227.44:4194 , piece_id=6V6P5EM6UMRSJ5VUWRRGD2LQX6K5V4NMWJQHW7MMZSBUVGPIFJ5A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.993069800 (935h29m20.864152835s) [noise=true , address=45.91.116.11:4119 , piece_id=XNAYXGAEJEL3TCNXG4MHZOGPFTFCYMSGQR2R7J3SNPHE4VZ6ANQQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.993449733 (935h29m20.864532768s) [noise=true , address=145.79.227.37:4565 , piece_id=J664HGQIMYYJBRCKYGSENJ4KWWEQWXTAMWCXJJMYCHDMMJ7UCTTA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.994061387 (935h29m20.865144422s) [noise=true , address=77.90.31.11:4556 , piece_id=NNJGC6WKYXOVVZZDXJELFPXWC5F4PITCIVCSPTGQECARIHVUK7OA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.995523001 (935h29m20.866606046s) [noise=true , address=145.79.227.49:4337 , piece_id=2MCT4GCPPRMO4CBEUSKADBKV6GMTSPKCF7CRYY3WQLTKIFOVQTVQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.996995013 (935h29m20.868078058s) [noise=true , address=145.79.227.34:4906 , piece_id=B4NT4ARTROLWSYPHAOHPKTDU4S7E3HXOQCNWZTVJJYM2BY22VT3A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.998321850 (935h29m20.869404885s) [noise=true , address=145.79.227.2:4115 , piece_id=LDKU6YULGG6GPHJW6JNFF22A4XZXSNMHXGJWV2EG3VH5H4ZSX6PQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.999884836 (935h29m20.870967881s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:21.003445065 (935h29m20.87452813s) [noise=true , address=45.91.116.4:4937 , piece_id=JJ72XOJHAA5DJSJJYP33PAJHVFWTYOWLPBVUM6TQNI2W6Y66QVWQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:22.858963677 (935h29m22.730046722s) [upload=818796]: Next returned nil segment
Jan 13 14:58:22.858978946 (935h29m22.730061991s) [upload=818796]: Waiting for error group managing segments...
Jan 13 14:58:23.170109204 (935h29m23.041192239s) [noise=true , address=145.79.227.44:4194 , piece_id=6V6P5EM6UMRSJ5VUWRRGD2LQX6K5V4NMWJQHW7MMZSBUVGPIFJ5A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.186162781 (935h29m23.057245816s) [noise=true , address=145.79.227.18:4006 , piece_id=3OIZDHJ42VPXWSFC7O57U53EBYEB43C34AMVXXSYZDOGOOQ7JQ5Q, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.194382592 (935h29m23.065465627s) [noise=true , address=145.79.227.11:4730 , piece_id=4QONQVZH4EHW44BN7MS5MZEKL5LCJ2WT4J4S6SOEYQ22VLDDQ5TQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.230397598 (935h29m23.101480633s) [noise=true , address=145.79.227.19:4077 , piece_id=7K5RSWATDE47EWQRQ5PH5HU777QLCD5SVJPJY5LBYYJGEEHD6HDA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.231165541 (935h29m23.102248576s) [noise=true , address=145.79.227.37:4565 , piece_id=J664HGQIMYYJBRCKYGSENJ4KWWEQWXTAMWCXJJMYCHDMMJ7UCTTA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.234866517 (935h29m23.105949563s) [noise=true , address=145.79.227.49:4337 , piece_id=2MCT4GCPPRMO4CBEUSKADBKV6GMTSPKCF7CRYY3WQLTKIFOVQTVQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.267169465 (935h29m23.1382525s) [noise=true , address=145.79.227.34:4906 , piece_id=B4NT4ARTROLWSYPHAOHPKTDU4S7E3HXOQCNWZTVJJYM2BY22VT3A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.299073002 (935h29m23.170156037s) [noise=true , address=145.79.227.2:4115 , piece_id=LDKU6YULGG6GPHJW6JNFF22A4XZXSNMHXGJWV2EG3VH5H4ZSX6PQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.572295861 (935h29m23.443378896s) [noise=true , address=45.91.116.4:4937 , piece_id=JJ72XOJHAA5DJSJJYP33PAJHVFWTYOWLPBVUM6TQNI2W6Y66QVWQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.819529393 (935h29m23.690612428s) [noise=true , address=145.79.227.14:4837 , piece_id=HL7VLA4IPL23MSEHGWQVQPV5BNO6NEWFDSPVZNYRIIFUFXXBLULQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.821950814 (935h29m23.693033859s) [noise=true , address=77.90.31.11:4556 , piece_id=NNJGC6WKYXOVVZZDXJELFPXWC5F4PITCIVCSPTGQECARIHVUK7OA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.938272061 (935h29m23.809355096s) [noise=true , address=145.79.227.46:4601 , piece_id=CEPWOW73BFZ7I5UEC2SMWWR6T2BGEHPG6B3WYIK23IP5CIN5OHKA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.992165478 (935h29m23.863248513s) [noise=true , address=45.91.116.11:4119 , piece_id=XNAYXGAEJEL3TCNXG4MHZOGPFTFCYMSGQR2R7J3SNPHE4VZ6ANQQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.992192278 (935h29m23.863275323s) [seg_pos={0 0}, upload=818796]: Segment reached optimal threshold of 13 pieces.
Jan 13 14:58:23.992481640 (935h29m23.863564675s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF
Jan 13 14:58:23.992490857 (935h29m23.863573892s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992496397 (935h29m23.863579443s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: read tcp 188.166.225.170:54712->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 14:58:23.992506046 (935h29m23.863589091s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992666491 (935h29m23.863749537s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF
Jan 13 14:58:23.992674987 (935h29m23.863758022s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992700126 (935h29m23.863783161s) [seg_pos={0 0}, upload=818796]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 13 14:58:23.992809093 (935h29m23.863892128s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 13 14:58:23.992816397 (935h29m23.863899432s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 13 14:58:24.315806947 (935h29m24.186889982s) [upload=818796]: Done uploading segments...
Jan 13 14:58:24.315825372 (935h29m24.186908408s) [upload=818796]: Upload finished. err: <nil>
Duration: 5.735512555s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000948619s trace:
https://jaeger.dev.storj.io/trace/53345c1dc086db56
FAIL (2026-01-13 14:59:14 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000964479s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X........................X................X.......] duration:
7.145163654s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:58:55 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 7.145215342s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002988732s trace:
https://jaeger.dev.storj.io/trace/70fcc11ecddb66b2
FAIL (2026-01-13 14:58:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 13 14:58:20.405741809 (935h29m20.276824854s) [upload=818796]: Starting upload
Jan 13 14:58:20.405840697 (935h29m20.276923762s) [upload=818796]: Done starting upload
Jan 13 14:58:20.405953662 (935h29m20.277036697s) [upload=818796]: Uploading segments...
Jan 13 14:58:20.406134045 (935h29m20.27721709s) [upload=818796]: Got next segment. Inline: false
Jan 13 14:58:20.406171537 (935h29m20.277254582s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 13 14:58:20.406177257 (935h29m20.277260303s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 13 14:58:20.989941022 (935h29m20.861024067s) [seg_pos={0 0}, upload=818796]: Begin upload segment...
Jan 13 14:58:20.989998812 (935h29m20.861081857s) [seg_pos={0 0}, upload=818796]: Done begin upload segment.
Jan 13 14:58:20.990058015 (935h29m20.86114106s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.990069437 (935h29m20.861152472s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.990692603 (935h29m20.861775638s) [noise=true , address=145.79.227.14:4837 , piece_id=HL7VLA4IPL23MSEHGWQVQPV5BNO6NEWFDSPVZNYRIIFUFXXBLULQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991108856 (935h29m20.862191891s) [noise=true , address=145.79.227.11:4730 , piece_id=4QONQVZH4EHW44BN7MS5MZEKL5LCJ2WT4J4S6SOEYQ22VLDDQ5TQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991521741 (935h29m20.862604787s) [noise=true , address=145.79.227.18:4006 , piece_id=3OIZDHJ42VPXWSFC7O57U53EBYEB43C34AMVXXSYZDOGOOQ7JQ5Q, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.991911605 (935h29m20.86299465s) [noise=true , address=145.79.227.19:4077 , piece_id=7K5RSWATDE47EWQRQ5PH5HU777QLCD5SVJPJY5LBYYJGEEHD6HDA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.992330562 (935h29m20.863413597s) [noise=true , address=145.79.227.46:4601 , piece_id=CEPWOW73BFZ7I5UEC2SMWWR6T2BGEHPG6B3WYIK23IP5CIN5OHKA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.992644180 (935h29m20.863727215s) [noise=true , address=145.79.227.44:4194 , piece_id=6V6P5EM6UMRSJ5VUWRRGD2LQX6K5V4NMWJQHW7MMZSBUVGPIFJ5A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.993069800 (935h29m20.864152835s) [noise=true , address=45.91.116.11:4119 , piece_id=XNAYXGAEJEL3TCNXG4MHZOGPFTFCYMSGQR2R7J3SNPHE4VZ6ANQQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.993449733 (935h29m20.864532768s) [noise=true , address=145.79.227.37:4565 , piece_id=J664HGQIMYYJBRCKYGSENJ4KWWEQWXTAMWCXJJMYCHDMMJ7UCTTA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.994061387 (935h29m20.865144422s) [noise=true , address=77.90.31.11:4556 , piece_id=NNJGC6WKYXOVVZZDXJELFPXWC5F4PITCIVCSPTGQECARIHVUK7OA, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.995523001 (935h29m20.866606046s) [noise=true , address=145.79.227.49:4337 , piece_id=2MCT4GCPPRMO4CBEUSKADBKV6GMTSPKCF7CRYY3WQLTKIFOVQTVQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.996995013 (935h29m20.868078058s) [noise=true , address=145.79.227.34:4906 , piece_id=B4NT4ARTROLWSYPHAOHPKTDU4S7E3HXOQCNWZTVJJYM2BY22VT3A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.998321850 (935h29m20.869404885s) [noise=true , address=145.79.227.2:4115 , piece_id=LDKU6YULGG6GPHJW6JNFF22A4XZXSNMHXGJWV2EG3VH5H4ZSX6PQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:20.999884836 (935h29m20.870967881s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:21.003445065 (935h29m20.87452813s) [noise=true , address=45.91.116.4:4937 , piece_id=JJ72XOJHAA5DJSJJYP33PAJHVFWTYOWLPBVUM6TQNI2W6Y66QVWQ, seg_pos={0 0}, upload=818796]: Uploading piece...
Jan 13 14:58:22.858963677 (935h29m22.730046722s) [upload=818796]: Next returned nil segment
Jan 13 14:58:22.858978946 (935h29m22.730061991s) [upload=818796]: Waiting for error group managing segments...
Jan 13 14:58:23.170109204 (935h29m23.041192239s) [noise=true , address=145.79.227.44:4194 , piece_id=6V6P5EM6UMRSJ5VUWRRGD2LQX6K5V4NMWJQHW7MMZSBUVGPIFJ5A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.186162781 (935h29m23.057245816s) [noise=true , address=145.79.227.18:4006 , piece_id=3OIZDHJ42VPXWSFC7O57U53EBYEB43C34AMVXXSYZDOGOOQ7JQ5Q, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.194382592 (935h29m23.065465627s) [noise=true , address=145.79.227.11:4730 , piece_id=4QONQVZH4EHW44BN7MS5MZEKL5LCJ2WT4J4S6SOEYQ22VLDDQ5TQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.230397598 (935h29m23.101480633s) [noise=true , address=145.79.227.19:4077 , piece_id=7K5RSWATDE47EWQRQ5PH5HU777QLCD5SVJPJY5LBYYJGEEHD6HDA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.231165541 (935h29m23.102248576s) [noise=true , address=145.79.227.37:4565 , piece_id=J664HGQIMYYJBRCKYGSENJ4KWWEQWXTAMWCXJJMYCHDMMJ7UCTTA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.234866517 (935h29m23.105949563s) [noise=true , address=145.79.227.49:4337 , piece_id=2MCT4GCPPRMO4CBEUSKADBKV6GMTSPKCF7CRYY3WQLTKIFOVQTVQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.267169465 (935h29m23.1382525s) [noise=true , address=145.79.227.34:4906 , piece_id=B4NT4ARTROLWSYPHAOHPKTDU4S7E3HXOQCNWZTVJJYM2BY22VT3A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.299073002 (935h29m23.170156037s) [noise=true , address=145.79.227.2:4115 , piece_id=LDKU6YULGG6GPHJW6JNFF22A4XZXSNMHXGJWV2EG3VH5H4ZSX6PQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.572295861 (935h29m23.443378896s) [noise=true , address=45.91.116.4:4937 , piece_id=JJ72XOJHAA5DJSJJYP33PAJHVFWTYOWLPBVUM6TQNI2W6Y66QVWQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.819529393 (935h29m23.690612428s) [noise=true , address=145.79.227.14:4837 , piece_id=HL7VLA4IPL23MSEHGWQVQPV5BNO6NEWFDSPVZNYRIIFUFXXBLULQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.821950814 (935h29m23.693033859s) [noise=true , address=77.90.31.11:4556 , piece_id=NNJGC6WKYXOVVZZDXJELFPXWC5F4PITCIVCSPTGQECARIHVUK7OA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.938272061 (935h29m23.809355096s) [noise=true , address=145.79.227.46:4601 , piece_id=CEPWOW73BFZ7I5UEC2SMWWR6T2BGEHPG6B3WYIK23IP5CIN5OHKA, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.992165478 (935h29m23.863248513s) [noise=true , address=45.91.116.11:4119 , piece_id=XNAYXGAEJEL3TCNXG4MHZOGPFTFCYMSGQR2R7J3SNPHE4VZ6ANQQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: <nil>
Jan 13 14:58:23.992192278 (935h29m23.863275323s) [seg_pos={0 0}, upload=818796]: Segment reached optimal threshold of 13 pieces.
Jan 13 14:58:23.992481640 (935h29m23.863564675s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV): protocol: expected piece hash; context canceled; EOF
Jan 13 14:58:23.992490857 (935h29m23.863573892s) [noise=true , address=145.79.227.20:4437 , piece_id=RTLU4KTWZFWMCPB6DD4TMTMPRNTS7SHCHJHNI3XPQPWLIGV36V5A, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992496397 (935h29m23.863579443s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: read tcp 188.166.225.170:54712->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 14:58:23.992506046 (935h29m23.863589091s) [noise=true , address=77.90.31.19:4841 , piece_id=4UIEHN5S3TISUWRRQNS3AZ4SJRKIXZMXHW6WBDSKGY7SFCHETBTQ, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992666491 (935h29m23.863749537s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF
Jan 13 14:58:23.992674987 (935h29m23.863758022s) [noise=true , address=145.79.227.16:4910 , piece_id=2HO3SUZUODVOMBQY6374WBA2OM3HIGVQCCD3IEK2KUX45NAUCO2A, seg_pos={0 0}, upload=818796]: Long tail cancellation due to optimal threshold
Jan 13 14:58:23.992700126 (935h29m23.863783161s) [seg_pos={0 0}, upload=818796]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 13 14:58:23.992809093 (935h29m23.863892128s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 13 14:58:23.992816397 (935h29m23.863899432s) [upload=818796]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 13 14:58:24.315806947 (935h29m24.186889982s) [upload=818796]: Done uploading segments...
Jan 13 14:58:24.315825372 (935h29m24.186908408s) [upload=818796]: Upload finished. err: <nil>
Duration: 30.003009471s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
8 out of 60 is failed (threshold=3) [...X....X................X..XX.............X......X........X] duration:
1m0.001319993s trace:
https://jaeger.dev.storj.io/trace/7441f704d9316e4d
FAIL (2026-01-13 14:58:34 UTC)
orbiter warning: context deadline exceeded
Duration: 1m0.001344489s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X........................X................X......] duration:
8.670806818s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:58:34 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 8.670829212s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
38 out of 60 is failed (threshold=3) [XX...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X......XXXXX] duration:
30.001417179s trace:
https://jaeger.dev.storj.io/trace/79b619221d6b8672
FAIL (2026-01-13 14:58:31 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001428129s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001712649s trace:
https://jaeger.dev.storj.io/trace/4d398e806e515286
FAIL (2026-01-13 14:58:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001739611s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X........................X................X.....] duration:
16.762524276s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:58:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 16.762550196s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
38 out of 60 is failed (threshold=3) [XXX...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X......XXXX] duration:
30.001540056s trace:
https://jaeger.dev.storj.io/trace/23b140e8c6b3eeba
FAIL (2026-01-13 14:58:00 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001565084s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
38 out of 60 is failed (threshold=3) [XXXX...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X......XXX] duration:
30.001841127s trace:
https://jaeger.dev.storj.io/trace/1c2203e555e63239
FAIL (2026-01-13 14:57:28 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001859431s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001211504s trace:
https://jaeger.dev.storj.io/trace/6331ef67a15d8e99
FAIL (2026-01-13 14:57:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001279373s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
7 out of 60 is failed (threshold=3) [....X....X................X..XX.............X......X........] duration:
34.38693827s trace:
https://jaeger.dev.storj.io/trace/538442d20e519577
FAIL (2026-01-13 14:57:09 UTC)
orbiter warning: context deadline exceeded
Duration: 34.387081572s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001461915s trace:
https://jaeger.dev.storj.io/trace/2a3098427e07a458
FAIL (2026-01-13 14:56:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001484788s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X........................X................X....] duration:
7.249051514s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:56:43 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 7.249076592s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [.XXXX...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X......XX] duration:
30.001286143s trace:
https://jaeger.dev.storj.io/trace/3f9e41383c80c694
FAIL (2026-01-13 14:56:15 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001306092s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X........................X................X...] duration:
23.60973284s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:56:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 23.609757498s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001200486s trace:
https://jaeger.dev.storj.io/trace/236a4b9d4dc46ee9
FAIL (2026-01-13 14:56:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001223118s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
8 out of 60 is failed (threshold=3) [X....X....X................X..XX.............X......X.......] duration:
36.338686165s trace:
https://jaeger.dev.storj.io/trace/538442d20e519577
FAIL (2026-01-13 14:56:03 UTC)
orbiter warning: context deadline exceeded
Duration: 36.338703538s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000861668s trace:
https://jaeger.dev.storj.io/trace/1a4eb8168b8dd10f
FAIL (2026-01-13 14:55:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000902536s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [X.XXXX...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X......X] duration:
30.000991946s trace:
https://jaeger.dev.storj.io/trace/35f3e94e9f1f65b6
FAIL (2026-01-13 14:55:41 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001006574s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X........................X................X..] duration:
8.117293706s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:55:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 8.117335407s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
8 out of 60 is failed (threshold=3) [.X....X....X................X..XX.............X......X......] duration:
53.148591011s trace:
https://jaeger.dev.storj.io/trace/538442d20e519577
FAIL (2026-01-13 14:55:26 UTC)
orbiter warning: context deadline exceeded
Duration: 53.148617203s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
4.999506079s trace:
https://jaeger.dev.storj.io/trace/2fcf217b81e8bd8a
FAIL (2026-01-13 14:55:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000752813s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X........................X................X.] duration:
27.442006795s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:54:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 27.442023065s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [X................X........................X................X] duration:
30.001165639s trace:
https://jaeger.dev.storj.io/trace/4600309651403a0c
FAIL (2026-01-13 14:54:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.001195256s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
36 out of 60 is failed (threshold=3) [.X.XXXX...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X......] duration:
23.420274808s trace:
https://jaeger.dev.storj.io/trace/5deb65c5b87681e1
FAIL (2026-01-13 14:54:22 UTC)
orbiter warning: context deadline exceeded
Duration: 23.420299756s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001694807s trace:
https://jaeger.dev.storj.io/trace/5c3e75e728cd5402
FAIL (2026-01-13 14:53:55 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001716909s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [X.X....X....X................X..XX.............X......X.....] duration:
27.756258095s trace:
https://jaeger.dev.storj.io/trace/538442d20e519577
FAIL (2026-01-13 14:53:52 UTC)
orbiter warning: context deadline exceeded
Duration: 27.756285165s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X................X........................X................] duration:
5.619060029s trace:
https://jaeger.dev.storj.io/trace/2c7a68c9178b5ce
FAIL (2026-01-13 14:53:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 5.619082422s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
36 out of 60 is failed (threshold=3) [..X.XXXX...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X.....] duration:
24.622627724s trace:
https://jaeger.dev.storj.io/trace/5deb65c5b87681e1
FAIL (2026-01-13 14:53:12 UTC)
orbiter warning: context deadline exceeded
Duration: 24.622655426s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001526959s trace:
https://jaeger.dev.storj.io/trace/436c0d4c138ca429
FAIL (2026-01-13 14:53:08 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001556765s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001563726s trace:
https://jaeger.dev.storj.io/trace/3487525aa2ab0d83
FAIL (2026-01-13 14:52:49 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001584134s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [.X.X....X....X................X..XX.............X......X....] duration:
21.268927358s trace:
https://jaeger.dev.storj.io/trace/538442d20e519577
FAIL (2026-01-13 14:52:45 UTC)
orbiter warning: context deadline exceeded
Duration: 21.268951733s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X................X........................X...............] duration:
9.833589097s trace:
https://jaeger.dev.storj.io/trace/2c7a68c9178b5ce
FAIL (2026-01-13 14:52:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 9.833617379s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000824529s trace:
https://jaeger.dev.storj.io/trace/3787b4b8ddeed929
FAIL (2026-01-13 14:52:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000855378s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [..X.X....X....X................X..XX.............X......X...] duration:
41.207589071s trace:
https://jaeger.dev.storj.io/trace/538442d20e519577
FAIL (2026-01-13 14:52:07 UTC)
orbiter warning: context deadline exceeded
Duration: 41.207617706s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [X..X.XXXX...XXXXXXX..XXX.XXXX.X....XXX.XXX.XXXXXX.XXX..X....] duration:
25.882116744s trace:
https://jaeger.dev.storj.io/trace/5deb65c5b87681e1
FAIL (2026-01-13 14:52:06 UTC)
orbiter warning: context deadline exceeded
Duration: 25.88214116s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X................X........................X..............] duration:
7.985939752s trace:
https://jaeger.dev.storj.io/trace/2c7a68c9178b5ce
FAIL (2026-01-13 14:52:03 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 7.985967805s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000807287s trace:
https://jaeger.dev.storj.io/trace/25a186875d5ad4ef
FAIL (2026-01-13 14:51:35 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000828568s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X................X........................X.............] duration:
7.1015585s trace:
https://jaeger.dev.storj.io/trace/2c7a68c9178b5ce
FAIL (2026-01-13 14:51:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 7.101593607s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001973955s trace:
https://jaeger.dev.storj.io/trace/76c3fc95dd2c1ec4
FAIL (2026-01-13 14:51:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.00199207s
core
uplink
us-select-1
us1-placement-20
|