Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 864307 reports (Page 11696 of 17287)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
5.960724125s
trace: 
https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc
FAIL (2025-12-08 16:59:34 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.96107816s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..............X............................X................]
duration: 
6.64645746s
trace: 
https://jaeger.dev.storj.io/trace/418daf3273797203
FAIL (2025-12-08 16:59:33 UTC) 
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 6.64648946s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration: 
707.505453ms
remote: 
"tcp:35.212.10.183:443"
target: 
https://us1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/76a069d29660539a
FAIL (2025-12-08 16:59:08 UTC) 
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 707.542274ms core satellite us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration: 
473.519407ms
remote: 
"tcp:35.207.121.91:443"
target: 
https://eu1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/6c02152d3764cef5
FAIL (2025-12-08 16:58:57 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 473.567059ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [X...........................................................]
duration: 
2.016871922s
trace: 
https://jaeger.dev.storj.io/trace/4dad09bb52e33232
FAIL (2025-12-08 16:58:50 UTC) 
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.01698033s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [..X...X.X...................................................]
duration: 
7.805431083s
trace: 
https://jaeger.dev.storj.io/trace/20c661c94f160c60
FAIL (2025-12-08 16:58:49 UTC) 
orbiter warning: context deadline exceeded
Duration: 7.805474816s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
20 out of 60 is failed (threshold=6) [.X.X.XX...X.X.X.X.....X....XXXX......XX...X........XXX...X..]
duration: 
3.470210023s
trace: 
https://jaeger.dev.storj.io/trace/3de63f0ed71cc7b9
FAIL (2025-12-08 16:58:49 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.470234019s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...............X............................X...............]
duration: 
5.839917716s
trace: 
https://jaeger.dev.storj.io/trace/418daf3273797203
FAIL (2025-12-08 16:58:33 UTC) 
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.839947061s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
20 out of 60 is failed (threshold=6) [..X.X.XX...X.X.X.X.....X....XXXX......XX...X........XXX...X.]
duration: 
3.520171398s
trace: 
https://jaeger.dev.storj.io/trace/3de63f0ed71cc7b9
FAIL (2025-12-08 16:58:33 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.520193871s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration: 
11.810019158s
trace: 
https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc
FAIL (2025-12-08 16:58:29 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 11.810048575s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................X...................]
duration: 
474.17747ms
remote: 
"tcp:35.207.121.91:443"
target: 
https://eu1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/6c02152d3764cef5
FAIL (2025-12-08 16:58:26 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 474.196486ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration: 
2.016888503s
trace: 
https://jaeger.dev.storj.io/trace/4dad09bb52e33232
FAIL (2025-12-08 16:58:12 UTC) 
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.016926785s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [X...........................................................]
duration: 
16.750148443s
trace: 
https://jaeger.dev.storj.io/trace/13568c7eb15b2369
FAIL (2025-12-08 16:58:06 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded
======LOGS======
Dec  8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload
Dec  8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload
Dec  8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments...
Dec  8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false
Dec  8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment...
Dec  8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment.
Dec  8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912   , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971   , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870   , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511   , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555     , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014   , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582   , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049   , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771     , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807     , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662     , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438   , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158   , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment
Dec  8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments...
Dec  8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158   , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971   , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555     , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511   , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912   , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014   , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049   , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771     , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438   , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807     , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662     , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582   , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870   , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces.
Dec  8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF
Dec  8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF
Dec  8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled
Dec  8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec  8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments...
Dec  8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil>
Duration: 16.750176277s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [...X...X.X..................................................]
duration: 
9.911187406s
trace: 
https://jaeger.dev.storj.io/trace/20c661c94f160c60
FAIL (2025-12-08 16:58:06 UTC) 
orbiter warning: context deadline exceeded
Duration: 9.911212654s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration: 
5.976766911s
remote: 
"tcp:35.212.10.183:443"
target: 
https://us1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/76a069d29660539a
FAIL (2025-12-08 16:58:02 UTC) 
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 5.976796017s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
20 out of 60 is failed (threshold=6) [...X.X.XX...X.X.X.X.....X....XXXX......XX...X........XXX...X]
duration: 
5.000892151s
trace: 
https://jaeger.dev.storj.io/trace/3de63f0ed71cc7b9
FAIL (2025-12-08 16:57:52 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000914596s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration: 
2.08154327s
trace: 
https://jaeger.dev.storj.io/trace/4dad09bb52e33232
FAIL (2025-12-08 16:57:51 UTC) 
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.081561925s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [................X............................X..............]
duration: 
5.887090733s
trace: 
https://jaeger.dev.storj.io/trace/418daf3273797203
FAIL (2025-12-08 16:57:49 UTC) 
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.887119158s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration: 
5.988180259s
trace: 
https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc
FAIL (2025-12-08 16:57:48 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.988345524s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.................X............................X.............]
duration: 
7.659679744s
trace: 
https://jaeger.dev.storj.io/trace/418daf3273797203
FAIL (2025-12-08 16:57:30 UTC) 
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 7.659707096s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [XX..........................................................]
duration: 
5.774628931s
trace: 
https://jaeger.dev.storj.io/trace/13568c7eb15b2369
FAIL (2025-12-08 16:57:21 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded
======LOGS======
Dec  8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload
Dec  8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload
Dec  8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments...
Dec  8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false
Dec  8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment...
Dec  8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment.
Dec  8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912   , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971   , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870   , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511   , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555     , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014   , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582   , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049   , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771     , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807     , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662     , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438   , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158   , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment
Dec  8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments...
Dec  8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158   , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971   , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555     , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511   , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912   , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014   , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049   , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771     , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438   , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807     , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662     , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582   , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870   , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces.
Dec  8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF
Dec  8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF
Dec  8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled
Dec  8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec  8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments...
Dec  8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil>
Duration: 5.774658697s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
466.748874ms
remote: 
"tcp:35.207.121.91:443"
target: 
https://eu1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/6c02152d3764cef5
FAIL (2025-12-08 16:57:16 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 466.779694ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [....X...X.X.................................................]
duration: 
13.912126692s
trace: 
https://jaeger.dev.storj.io/trace/20c661c94f160c60
FAIL (2025-12-08 16:57:08 UTC) 
orbiter warning: context deadline exceeded
Duration: 13.912154895s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration: 
712.815216ms
remote: 
"tcp:35.212.10.183:443"
target: 
https://us1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/76a069d29660539a
FAIL (2025-12-08 16:57:03 UTC) 
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 712.845091ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.XX.........................................................]
duration: 
5.754426845s
trace: 
https://jaeger.dev.storj.io/trace/13568c7eb15b2369
FAIL (2025-12-08 16:57:00 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded
======LOGS======
Dec  8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload
Dec  8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload
Dec  8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments...
Dec  8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false
Dec  8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment...
Dec  8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment.
Dec  8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912   , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971   , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870   , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511   , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555     , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014   , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582   , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049   , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771     , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807     , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662     , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438   , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158   , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment
Dec  8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments...
Dec  8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158   , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971   , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555     , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511   , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912   , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014   , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049   , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771     , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438   , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807     , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662     , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582   , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870   , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces.
Dec  8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF
Dec  8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF
Dec  8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled
Dec  8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec  8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments...
Dec  8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil>
Duration: 5.754479175s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
19 out of 60 is failed (threshold=6) [....X.X.XX...X.X.X.X.....X....XXXX......XX...X........XXX...]
duration: 
3.433530448s
trace: 
https://jaeger.dev.storj.io/trace/666ba61ce252e387
FAIL (2025-12-08 16:56:54 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.433555415s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...X........................................................]
duration: 
2.053907665s
trace: 
https://jaeger.dev.storj.io/trace/4dad09bb52e33232
FAIL (2025-12-08 16:56:52 UTC) 
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.05393148s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................................X...]
duration: 
694.351334ms
remote: 
"tcp:35.212.10.183:443"
target: 
https://us1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/76a069d29660539a
FAIL (2025-12-08 16:56:45 UTC) 
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 694.374898ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................................X........]
duration: 
6.020120397s
trace: 
https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc
FAIL (2025-12-08 16:56:43 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.020150645s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [.....X...X.X................................................]
duration: 
6.848460856s
trace: 
https://jaeger.dev.storj.io/trace/20c661c94f160c60
FAIL (2025-12-08 16:56:41 UTC) 
orbiter warning: context deadline exceeded
Duration: 6.84849379s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..................X............................X............]
duration: 
6.00029658s
trace: 
https://jaeger.dev.storj.io/trace/418daf3273797203
FAIL (2025-12-08 16:56:24 UTC) 
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 6.000326188s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
19 out of 60 is failed (threshold=6) [.....X.X.XX...X.X.X.X.....X....XXXX......XX...X........XXX..]
duration: 
3.471377696s
trace: 
https://jaeger.dev.storj.io/trace/666ba61ce252e387
FAIL (2025-12-08 16:56:20 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.471394449s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration: 
5.925849536s
trace: 
https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc
FAIL (2025-12-08 16:56:11 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.925880455s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
471.251908ms
remote: 
"tcp:35.207.121.91:443"
target: 
https://eu1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/6c02152d3764cef5
FAIL (2025-12-08 16:56:08 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 471.281846ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration: 
1.990484135s
trace: 
https://jaeger.dev.storj.io/trace/4dad09bb52e33232
FAIL (2025-12-08 16:56:06 UTC) 
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 1.99051906s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...................X............................X...........]
duration: 
5.864722172s
trace: 
https://jaeger.dev.storj.io/trace/418daf3273797203
FAIL (2025-12-08 16:55:53 UTC) 
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.864746007s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [......X...X.X...............................................]
duration: 
10.772246961s
trace: 
https://jaeger.dev.storj.io/trace/20c661c94f160c60
FAIL (2025-12-08 16:55:48 UTC) 
orbiter warning: context deadline exceeded
Duration: 10.772275333s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..XX........................................................]
duration: 
5.713130995s
trace: 
https://jaeger.dev.storj.io/trace/13568c7eb15b2369
FAIL (2025-12-08 16:55:46 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded
======LOGS======
Dec  8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload
Dec  8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload
Dec  8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments...
Dec  8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false
Dec  8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment...
Dec  8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment.
Dec  8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912   , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971   , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870   , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511   , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555     , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014   , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582   , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049   , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771     , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807     , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662     , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438   , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158   , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece...
Dec  8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment
Dec  8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments...
Dec  8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158   , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971   , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555     , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511   , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912   , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014   , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049   , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771     , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438   , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807     , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662     , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582   , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870   , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil>
Dec  8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces.
Dec  8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF
Dec  8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979   , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF
Dec  8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906   , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled
Dec  8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941   , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold
Dec  8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec  8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments...
Dec  8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil>
Duration: 5.713190377s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration: 
5.777561455s
trace: 
https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc
FAIL (2025-12-08 16:55:45 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.777611511s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration: 
692.000497ms
remote: 
"tcp:35.212.10.183:443"
target: 
https://us1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/76a069d29660539a
FAIL (2025-12-08 16:55:38 UTC) 
orbiter warning: Get "https://us1.storj.io/login": EOF
Duration: 692.025145ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
19 out of 60 is failed (threshold=6) [......X.X.XX...X.X.X.X.....X....XXXX......XX...X........XXX.]
duration: 
3.578523092s
trace: 
https://jaeger.dev.storj.io/trace/666ba61ce252e387
FAIL (2025-12-08 16:55:37 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.578552298s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
477.374577ms
remote: 
"tcp:35.207.121.91:443"
target: 
https://eu1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/6c02152d3764cef5
FAIL (2025-12-08 16:55:22 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 477.40688ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [X...........................................................]
duration: 
5.42503246s
trace: 
https://jaeger.dev.storj.io/trace/5d817b557064ae10
FAIL (2025-12-08 16:55:20 UTC) 
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 5.425065933s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [....................X............................X..........]
duration: 
6.898090149s
trace: 
https://jaeger.dev.storj.io/trace/418daf3273797203
FAIL (2025-12-08 16:55:16 UTC) 
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 6.898119705s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [.......X...X.X..............................................]
duration: 
11.429482168s
trace: 
https://jaeger.dev.storj.io/trace/20c661c94f160c60
FAIL (2025-12-08 16:55:14 UTC) 
orbiter warning: context deadline exceeded
Duration: 11.429514099s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration: 
2.070596185s
trace: 
https://jaeger.dev.storj.io/trace/4dad09bb52e33232
FAIL (2025-12-08 16:55:05 UTC) 
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.070624641s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration: 
5.791334574s
trace: 
https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc
FAIL (2025-12-08 16:55:01 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.791371394s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
466.277066ms
remote: 
"tcp:35.207.121.91:443"
target: 
https://eu1.storj.io/login
trace: 
https://jaeger.dev.storj.io/trace/6c02152d3764cef5
FAIL (2025-12-08 16:55:00 UTC) 
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 466.301112ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.....................X............................X.........]
duration: 
5.856182907s
trace: 
https://jaeger.dev.storj.io/trace/418daf3273797203
FAIL (2025-12-08 16:54:45 UTC) 
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.856213765s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration: 
5.062323578s
trace: 
https://jaeger.dev.storj.io/trace/5d817b557064ae10
FAIL (2025-12-08 16:54:44 UTC) 
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 5.062344399s core uplink eu1