Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 4.992279597s trace: https://jaeger.dev.storj.io/trace/5d817b557064ae10 FAIL (2025-12-08 16:53:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.992320094s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [.X......X.X.XX...X.X.X.X.....X....XXXX......XX...X........XX] duration: 5.001184s trace: https://jaeger.dev.storj.io/trace/4aeb51c75ebc2321 FAIL (2025-12-08 16:53:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001198249s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.05251473s trace: https://jaeger.dev.storj.io/trace/5d817b557064ae10 FAIL (2025-12-08 16:53:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.052545309s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X...X.X............................................] duration: 16.829864981s trace: https://jaeger.dev.storj.io/trace/20c661c94f160c60 FAIL (2025-12-08 16:53:22 UTC) orbiter warning: context deadline exceeded Duration: 16.829892784s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.039502856s trace: https://jaeger.dev.storj.io/trace/4dad09bb52e33232 FAIL (2025-12-08 16:53:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.03953165s core uplink us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 465.949243ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6c02152d3764cef5 FAIL (2025-12-08 16:53:08 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 465.983827ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X...X.X...........................................] duration: 6.066121632s trace: https://jaeger.dev.storj.io/trace/20c661c94f160c60 FAIL (2025-12-08 16:52:50 UTC) orbiter warning: context deadline exceeded Duration: 6.066154464s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 5.820938685s trace: https://jaeger.dev.storj.io/trace/13568c7eb15b2369 FAIL (2025-12-08 16:52:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded ======LOGS====== Dec 8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload Dec 8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload Dec 8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments... Dec 8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false Dec 8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment... Dec 8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment. Dec 8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment Dec 8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments... Dec 8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces. Dec 8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled Dec 8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments... Dec 8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil> Duration: 5.820965546s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.047019247s trace: https://jaeger.dev.storj.io/trace/4dad09bb52e33232 FAIL (2025-12-08 16:52:46 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.047037082s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X............................X.......] duration: 5.893882777s trace: https://jaeger.dev.storj.io/trace/418daf3273797203 FAIL (2025-12-08 16:52:44 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.893908445s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.841445372s trace: https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc FAIL (2025-12-08 16:52:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.841475601s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [..X......X.X.XX...X.X.X.X.....X....XXXX......XX...X........X] duration: 5.001794708s trace: https://jaeger.dev.storj.io/trace/4c68f44cdedae367 FAIL (2025-12-08 16:52:40 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001808955s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X...X.X..........................................] duration: 14.092345098s trace: https://jaeger.dev.storj.io/trace/20c661c94f160c60 FAIL (2025-12-08 16:52:31 UTC) orbiter warning: context deadline exceeded Duration: 14.092372801s edge gateway us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 474.947997ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6c02152d3764cef5 FAIL (2025-12-08 16:52:20 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 474.974618ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X............................X......] duration: 6.08242567s trace: https://jaeger.dev.storj.io/trace/418daf3273797203 FAIL (2025-12-08 16:52:19 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.082454394s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.388194763s trace: https://jaeger.dev.storj.io/trace/5d817b557064ae10 FAIL (2025-12-08 16:52:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.388238287s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.13329857s trace: https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc FAIL (2025-12-08 16:52:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.133327375s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.134167126s trace: https://jaeger.dev.storj.io/trace/4dad09bb52e33232 FAIL (2025-12-08 16:51:57 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.134204036s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X...X.X.........................................] duration: 18.609546908s trace: https://jaeger.dev.storj.io/trace/20c661c94f160c60 FAIL (2025-12-08 16:51:51 UTC) orbiter warning: context deadline exceeded Duration: 18.609577515s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 18 out of 60 is failed (threshold=6) [X..X......X.X.XX...X.X.X.X.....X....XXXX......XX...X........] duration: 3.467108046s trace: https://jaeger.dev.storj.io/trace/450d7df9d8d51f5c FAIL (2025-12-08 16:51:49 UTC) orbiter warning: context deadline exceeded Duration: 3.467127774s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.000446942s trace: https://jaeger.dev.storj.io/trace/705a9a7864a3a1cc FAIL (2025-12-08 16:51:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000469946s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 476.596937ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6c02152d3764cef5 FAIL (2025-12-08 16:51:46 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 476.615121ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 5.832077249s trace: https://jaeger.dev.storj.io/trace/13568c7eb15b2369 FAIL (2025-12-08 16:51:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded ======LOGS====== Dec 8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload Dec 8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload Dec 8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments... Dec 8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false Dec 8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment... Dec 8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment. Dec 8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment Dec 8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments... Dec 8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces. Dec 8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled Dec 8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments... Dec 8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil> Duration: 5.832108569s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 470.993106ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6c02152d3764cef5 FAIL (2025-12-08 16:51:28 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 471.026719ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X............................X.....] duration: 6.21049316s trace: https://jaeger.dev.storj.io/trace/418daf3273797203 FAIL (2025-12-08 16:51:25 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.210526214s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.958413879s trace: https://jaeger.dev.storj.io/trace/5d817b557064ae10 FAIL (2025-12-08 16:51:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.958447995s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 5.778979267s trace: https://jaeger.dev.storj.io/trace/13568c7eb15b2369 FAIL (2025-12-08 16:51:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded ======LOGS====== Dec 8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload Dec 8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload Dec 8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments... Dec 8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false Dec 8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment... Dec 8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment. Dec 8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment Dec 8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments... Dec 8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces. Dec 8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled Dec 8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments... Dec 8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil> Duration: 5.779021608s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X............................X....] duration: 6.935031265s trace: https://jaeger.dev.storj.io/trace/418daf3273797203 FAIL (2025-12-08 16:51:02 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.935066049s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.02886798s trace: https://jaeger.dev.storj.io/trace/4dad09bb52e33232 FAIL (2025-12-08 16:51:00 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.02889426s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [XX..X......X.X.XX...X.X.X.X.....X....XXXX......XX...X.......] duration: 3.513712829s trace: https://jaeger.dev.storj.io/trace/450d7df9d8d51f5c FAIL (2025-12-08 16:50:49 UTC) orbiter warning: context deadline exceeded Duration: 3.513743787s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 5.916461257s trace: https://jaeger.dev.storj.io/trace/13568c7eb15b2369 FAIL (2025-12-08 16:50:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded ======LOGS====== Dec 8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload Dec 8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload Dec 8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments... Dec 8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false Dec 8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment... Dec 8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment. Dec 8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment Dec 8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments... Dec 8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces. Dec 8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled Dec 8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments... Dec 8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil> Duration: 5.916490243s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X...X.X........................................] duration: 12.697640617s trace: https://jaeger.dev.storj.io/trace/20c661c94f160c60 FAIL (2025-12-08 16:50:33 UTC) orbiter warning: context deadline exceeded Duration: 12.697733984s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.083412936s trace: https://jaeger.dev.storj.io/trace/5d817b557064ae10 FAIL (2025-12-08 16:50:29 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.083443736s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 468.227089ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6c02152d3764cef5 FAIL (2025-12-08 16:50:15 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 468.268869ms core satellite eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [.XX..X......X.X.XX...X.X.X.X.....X....XXXX......XX...X......] duration: 3.570535916s trace: https://jaeger.dev.storj.io/trace/450d7df9d8d51f5c FAIL (2025-12-08 16:50:09 UTC) orbiter warning: context deadline exceeded Duration: 3.570556865s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.226113032s trace: https://jaeger.dev.storj.io/trace/690f79ef204fee2 FAIL (2025-12-08 16:50:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.226146395s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X............................X...] duration: 6.134659747s trace: https://jaeger.dev.storj.io/trace/418daf3273797203 FAIL (2025-12-08 16:50:08 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.134761952s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.059098549s trace: https://jaeger.dev.storj.io/trace/5d817b557064ae10 FAIL (2025-12-08 16:50:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.059116093s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.022023902s trace: https://jaeger.dev.storj.io/trace/4dad09bb52e33232 FAIL (2025-12-08 16:50:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.022059128s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 5.907723804s trace: https://jaeger.dev.storj.io/trace/13568c7eb15b2369 FAIL (2025-12-08 16:49:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, Piece ID: U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA) context deadline exceeded; piecestore: (Node ID: 1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2, Piece ID: QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA) context deadline exceeded; piecestore: (Node ID: 12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, Piece ID: KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ) context deadline exceeded; piecestore: (Node ID: 122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd, Piece ID: U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q) context deadline exceeded; piecestore: (Node ID: 1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, Piece ID: FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA) context deadline exceeded ======LOGS====== Dec 8 16:15:19.690262294 (72h46m19.561345339s) [upload=63694]: Starting upload Dec 8 16:15:19.690357154 (72h46m19.56144022s) [upload=63694]: Done starting upload Dec 8 16:15:19.690425354 (72h46m19.561508409s) [upload=63694]: Uploading segments... Dec 8 16:15:19.690652296 (72h46m19.561735341s) [upload=63694]: Got next segment. Inline: false Dec 8 16:15:19.690693895 (72h46m19.56177694s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 16:15:19.690700889 (72h46m19.561783934s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 16:15:20.501121517 (72h46m20.372204572s) [seg_pos={0 0}, upload=63694]: Begin upload segment... Dec 8 16:15:20.501188935 (72h46m20.372271981s) [seg_pos={0 0}, upload=63694]: Done begin upload segment. Dec 8 16:15:20.501225655 (72h46m20.3723087s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501311268 (72h46m20.372394313s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.501987676 (72h46m20.373070722s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502073379 (72h46m20.373156424s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502559184 (72h46m20.373642229s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.502903350 (72h46m20.373986385s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503199825 (72h46m20.37428287s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503205956 (72h46m20.374289001s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503484487 (72h46m20.374567532s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503757176 (72h46m20.374840221s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.503773727 (72h46m20.374856772s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504114126 (72h46m20.375197161s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.504441298 (72h46m20.375524343s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.505240540 (72h46m20.376323585s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506022409 (72h46m20.377105454s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:20.506709457 (72h46m20.377792502s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Uploading piece... Dec 8 16:15:22.339915069 (72h46m22.210998114s) [upload=63694]: Next returned nil segment Dec 8 16:15:22.339932321 (72h46m22.211015366s) [upload=63694]: Waiting for error group managing segments... Dec 8 16:15:22.655133540 (72h46m22.526216575s) [noise=true , address=145.79.227.43:4158 , piece_id=QN7JC2XQK6FKMIYD2WXQ7GMDILEWDUO2HXZLZERVJ24WWIMHFOVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.660462928 (72h46m22.531545983s) [noise=true , address=145.79.227.17:4971 , piece_id=KRCKO7NXT2XOYK4QHVJK5UIU246TVB45EE7ELVUT365XTJ7RHKJQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.683969820 (72h46m22.555052855s) [noise=true , address=77.90.31.11:4555 , piece_id=LZ4YCICB4QQVLQAUZD6ZFABXLYSRKC4OFZESDVUGIOFJMZBRMMSA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.685188641 (72h46m22.556271686s) [noise=true , address=145.79.227.22:4511 , piece_id=RT3ULMIM24LMC4UASFJYVAOHIKJBBGLFYJP3LBJCUL6I532MTSGA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.686713104 (72h46m22.557796149s) [noise=true , address=145.79.227.16:4912 , piece_id=NIW3LT24E4LPJ5QYJVQOAR43S23JLDDOXZ6NVOURZNDTCCTLLPJA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.698627942 (72h46m22.569710987s) [noise=true , address=145.79.227.39:4014 , piece_id=U7SKMZGV33HMSQLQIFIBZ6WNYC7JJ2CENSK5LCW3KVMP53T7467Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.713359143 (72h46m22.584442188s) [noise=true , address=145.79.227.40:4049 , piece_id=VX3PNKMHR75TNJLKRBLYS3KT42ZTPT4X6I5QS2AKNMGDQDVE4WDA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.731975212 (72h46m22.603058257s) [noise=true , address=77.90.31.17:4771 , piece_id=R6PLE6VLZNL23TJC6V6MRBLJP6PKB2DDGQMPPGLMM23WN6J7SH5Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.741125236 (72h46m22.612208281s) [noise=true , address=145.79.227.20:4438 , piece_id=U3FCNUY4ASY3ZGX7ZY26GE2NA52GJNKJMW7XKZKALT2MWBCZMHFA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.773771311 (72h46m22.644854346s) [noise=true , address=77.90.31.18:4807 , piece_id=7FXKUHBJT7AHDC4PHCZ73Q62GDSOUFRFIVAD337ORGE7YUTAULVA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:22.906364795 (72h46m22.777447841s) [noise=true , address=77.90.31.14:4662 , piece_id=BO6DQNLFNMG6HAPKOAG2DHWDD3YMX46IAYGDVQG7THC5EVZORJRA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:23.367795705 (72h46m23.23887874s) [noise=true , address=145.79.227.24:4582 , piece_id=FGYLRBVDMMLYWTTKLC3B2P2MHTECHEBH2DJOOKAHBR6TBAMKFBXA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582400944 (72h46m24.453483979s) [noise=true , address=145.79.227.33:4870 , piece_id=IK7NDJD5GNFMWB26JYOMCSNIAT5TTTQOUXB2VFYSNRGIQ2MVMXAQ, seg_pos={0 0}, upload=63694]: Done uploading piece. err: <nil> Dec 8 16:15:24.582421023 (72h46m24.453504068s) [seg_pos={0 0}, upload=63694]: Segment reached optimal threshold of 13 pieces. Dec 8 16:15:24.582652363 (72h46m24.453735408s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582659086 (72h46m24.453742121s) [noise=true , address=145.79.227.38:4979 , piece_id=HCELMHS3GNLCKHFCQU3V45M4OETQZPL5MQJBUOUF5VPA44HXZW2Q, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.582740842 (72h46m24.453823877s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF Dec 8 16:15:24.582753055 (72h46m24.45383609s) [noise=true , address=145.79.227.34:4906 , piece_id=AIZQB5ZLXPCLPT5Q7NLNSI3FPBPAMBVUIXKZCTA3ML7L3XP2UY6A, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583044900 (72h46m24.454127935s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni): protocol: context canceled; context canceled Dec 8 16:15:24.583052926 (72h46m24.454135961s) [noise=true , address=145.79.227.29:4941 , piece_id=GJQXPA7WEZUTVJNELRBJVTU4LIGXYD7XLEPR5SWF4NBWWMXBW2SA, seg_pos={0 0}, upload=63694]: Long tail cancellation due to optimal threshold Dec 8 16:15:24.583071441 (72h46m24.454154486s) [seg_pos={0 0}, upload=63694]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 16:15:24.583162014 (72h46m24.454245059s) [upload=63694]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 16:15:24.583171562 (72h46m24.454254627s) [upload=63694]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 16:15:25.042230695 (72h46m24.91331374s) [upload=63694]: Done uploading segments... Dec 8 16:15:25.042258869 (72h46m24.913341914s) [upload=63694]: Upload finished. err: <nil> Duration: 5.907761946s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.008564443s trace: https://jaeger.dev.storj.io/trace/4dad09bb52e33232 FAIL (2025-12-08 16:49:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.008595362s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X............................X..] duration: 5.863573982s trace: https://jaeger.dev.storj.io/trace/418daf3273797203 FAIL (2025-12-08 16:49:39 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.863604681s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X...X.X.......................................] duration: 16.967014799s trace: https://jaeger.dev.storj.io/trace/20c661c94f160c60 FAIL (2025-12-08 16:49:29 UTC) orbiter warning: context deadline exceeded Duration: 16.96703609s edge gateway us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 467.570027ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6c02152d3764cef5 FAIL (2025-12-08 16:49:24 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 467.598522ms core satellite eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.913421263s trace: https://jaeger.dev.storj.io/trace/690f79ef204fee2 FAIL (2025-12-08 16:49:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.913450569s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.32776693s trace: https://jaeger.dev.storj.io/trace/5d817b557064ae10 FAIL (2025-12-08 16:49:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.327799032s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X............................X.] duration: 6.571320743s trace: https://jaeger.dev.storj.io/trace/418daf3273797203 FAIL (2025-12-08 16:49:07 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.571339249s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [..XX..X......X.X.XX...X.X.X.X.....X....XXXX......XX...X.....] duration: 3.545810415s trace: https://jaeger.dev.storj.io/trace/450d7df9d8d51f5c FAIL (2025-12-08 16:49:05 UTC) orbiter warning: context deadline exceeded Duration: 3.545833759s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X.X.........................................................] duration: 6.56796081s trace: https://jaeger.dev.storj.io/trace/690f79ef204fee2 FAIL (2025-12-08 16:49:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.567990447s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.044820815s trace: https://jaeger.dev.storj.io/trace/4dad09bb52e33232 FAIL (2025-12-08 16:49:02 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.044851574s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)