Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [...................X...X.......XX...........................] duration: 3.434451718s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 08:00:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.434578648s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 676.010366ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 08:00:13 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 676.041285ms core satellite us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 474.51531ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3a746afe6cedeccc FAIL (2025-12-08 08:00:12 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 474.55179ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X...........X.........] duration: 8.127583615s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 07:59:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.12760769s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.705957871s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:59:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.705990261s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [......XXX..........XX......X.....................XX.........] duration: 5.933822989s trace: https://jaeger.dev.storj.io/trace/5e0d0482a82d8f09 FAIL (2025-12-08 07:59:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.933852787s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.14966822s remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3a746afe6cedeccc FAIL (2025-12-08 07:59:22 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 1.149696526s core satellite eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [....................X...X.......XX..........................] duration: 3.34786797s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 07:59:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.347898757s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.714400726s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:59:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.71444001s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [.......XXX..........XX......X.....................XX........] duration: 5.977250362s trace: https://jaeger.dev.storj.io/trace/5e0d0482a82d8f09 FAIL (2025-12-08 07:59:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.977278305s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 853.242599ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 07:59:04 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 853.286493ms core satellite us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 466.248146ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3a746afe6cedeccc FAIL (2025-12-08 07:58:59 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 466.280338ms core satellite eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.....................X...X.......XX.........................] duration: 3.434653296s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 07:58:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.434680698s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 478.658358ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3a746afe6cedeccc FAIL (2025-12-08 07:58:36 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 478.71676ms core satellite eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [........XXX..........XX......X.....................XX.......] duration: 5.96097298s trace: https://jaeger.dev.storj.io/trace/5e0d0482a82d8f09 FAIL (2025-12-08 07:58:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.961018186s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X...........X........] duration: 6.283397299s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 07:58:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.283425692s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.69349514s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:58:29 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.693525509s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 692.937837ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 07:58:26 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 692.960833ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.928477321s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:58:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.928495806s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [......................X...X.......XX........................] duration: 3.434193893s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 07:57:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.434223609s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 696.337382ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 07:57:52 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 696.433224ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X...........X.......] duration: 5.833789094s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 07:57:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.83381886s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [.........XXX..........XX......X.....................XX......] duration: 5.957340732s trace: https://jaeger.dev.storj.io/trace/5e0d0482a82d8f09 FAIL (2025-12-08 07:57:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.95737123s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.631079896s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:57:29 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.631114923s core uplink us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 468.535461ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3a746afe6cedeccc FAIL (2025-12-08 07:57:22 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 468.574236ms core satellite eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.......................X...X.......XX.......................] duration: 3.527064597s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 07:57:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.527086188s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 690.913925ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 07:57:03 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 690.949092ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.719359799s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:56:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.719393876s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 694.069993ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 07:56:46 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 694.098027ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X...........X......] duration: 7.306186956s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 07:56:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.30621617s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [..........XXX..........XX......X.....................XX.....] duration: 5.993316776s trace: https://jaeger.dev.storj.io/trace/5e0d0482a82d8f09 FAIL (2025-12-08 07:56:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.993342946s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 470.11443ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3a746afe6cedeccc FAIL (2025-12-08 07:56:30 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 470.143304ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X...........X.....] duration: 7.916186876s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 07:56:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.916215739s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.93185798s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:56:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.931888438s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [........................X...X.......XX......................] duration: 3.403967022s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 07:56:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.403992942s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.916397117s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:55:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.916444907s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.244941018s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 07:55:53 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1.244969593s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.........................X...X.......XX.....................] duration: 3.451527208s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 07:55:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.451555112s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [..........................X...X.......XX....................] duration: 3.509654561s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 07:55:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.509685571s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [...........XXX..........XX......X.....................XX....] duration: 5.842583213s trace: https://jaeger.dev.storj.io/trace/5e0d0482a82d8f09 FAIL (2025-12-08 07:55:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.842613088s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 474.761417ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3a746afe6cedeccc FAIL (2025-12-08 07:55:15 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 474.795894ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X...........X....] duration: 5.957083635s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 07:55:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.957123199s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 683.426857ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 07:54:58 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 683.460111ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [...........................X...X.......XX...................] duration: 3.385276494s trace: https://jaeger.dev.storj.io/trace/28e59d7fae0aa278 FAIL (2025-12-08 07:54:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.385305949s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.720844175s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:54:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.720875254s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X...........X...] duration: 7.224946991s trace: https://jaeger.dev.storj.io/trace/6fbc0248558ad673 FAIL (2025-12-08 07:54:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 07:51:49.892373053 (64h22m49.763456099s) [upload=56436]: Starting upload Dec 8 07:51:49.892470558 (64h22m49.763553603s) [upload=56436]: Done starting upload Dec 8 07:51:49.892577121 (64h22m49.763660176s) [upload=56436]: Uploading segments... Dec 8 07:51:49.892739571 (64h22m49.763822606s) [upload=56436]: Got next segment. Inline: false Dec 8 07:51:49.892803042 (64h22m49.763886087s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 07:51:49.892810626 (64h22m49.763893671s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 07:51:50.139750947 (64h22m50.010833992s) [seg_pos={0 0}, upload=56436]: Begin upload segment... Dec 8 07:51:50.139806774 (64h22m50.010889819s) [seg_pos={0 0}, upload=56436]: Done begin upload segment. Dec 8 07:51:50.139840288 (64h22m50.010923333s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.139892166 (64h22m50.010975211s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.140602369 (64h22m50.011685414s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.141877286 (64h22m50.012960331s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.142886528 (64h22m50.013969563s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143398483 (64h22m50.014481528s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.143786251 (64h22m50.014869296s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144207654 (64h22m50.015290699s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.144614459 (64h22m50.015697494s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.145229349 (64h22m50.016312394s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146391893 (64h22m50.017474938s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.146973060 (64h22m50.018056105s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.147665980 (64h22m50.018749025s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.148271602 (64h22m50.019354637s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.149087727 (64h22m50.020170772s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:50.151023432 (64h22m50.022106477s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Uploading piece... Dec 8 07:51:51.761342963 (64h22m51.632426008s) [upload=56436]: Next returned nil segment Dec 8 07:51:51.761356038 (64h22m51.632439083s) [upload=56436]: Waiting for error group managing segments... Dec 8 07:51:52.143112877 (64h22m52.014195912s) [noise=true , address=145.79.227.42:4122 , piece_id=5YUJVB6L5LYLRBJ2475TVR5UY7NWIWTOE7KLKQJAXKOZRTGXL5IQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.143778344 (64h22m52.014861389s) [noise=true , address=145.79.227.25:4618 , piece_id=5NBPSN653OJAOTT5SQYUCHASNWGR7EFCFIAMUHYH3M7VILCUIAHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146079326 (64h22m52.017162371s) [noise=true , address=145.79.227.20:4439 , piece_id=3AQ7WAXEFXGY6VGOQQACWGUGWDUDRAYIWXUQFBSZXWHFPVLMBIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.146479507 (64h22m52.017562542s) [noise=true , address=145.79.227.22:4510 , piece_id=MURUKN5W3JWOHKZGIDJ3NAF5TCHFOVM2A46QFIMLUP6JKQXGZIWQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.155737106 (64h22m52.026820151s) [noise=true , address=145.79.227.39:4015 , piece_id=4TBSZGVUKZRXFHSU3C2NSJ2H26ZKMMURPNJFEQGS2ICQI6KZUNKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.161614518 (64h22m52.032697553s) [noise=true , address=145.79.227.23:4547 , piece_id=BCYPKLT75XINURN3XAXXBALSQOHSYB4PIUEVAOLI4OGBUSEPGKOA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.166235817 (64h22m52.037318862s) [noise=true , address=145.79.227.28:4727 , piece_id=XHE4AX4UFAA53UOTMI5TDTA2GQXM5QMWQDVKSGUGOQIXF6JA7PVA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.274077770 (64h22m52.145160815s) [noise=true , address=77.90.31.14:4663 , piece_id=KRLEX4OSLJJVKHVEOVAQALC374PIN3SK2L6BM63OVCAWZCS5NIHQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.311177544 (64h22m52.182260579s) [noise=true , address=45.91.116.5:4297 , piece_id=JYAFY55C5EYMVOYCF3LY25UKALYL76NR5SN5DKH3RB67WKGR62WQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.352570024 (64h22m52.223653069s) [noise=true , address=77.90.31.10:4519 , piece_id=BWYJYFKLJPOXDUYYNGS6OXZ4N3J62CRLSRKMIDBJNEUZB54IWEKQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.493961551 (64h22m52.365044586s) [noise=true , address=145.79.227.24:4582 , piece_id=ZVY2X2XMRLDJA74AL4UMYY5A6MCEO4L2GUI4G77CXHM54CL6XTCA, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.494609204 (64h22m52.365692249s) [noise=true , address=145.79.227.44:4194 , piece_id=7HLBO2SUUG5ZFYGMTMWZ4XMN5VO4LQRVVTNQ46CZOBU3MB32EO6A, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522301065 (64h22m52.3933841s) [noise=true , address=145.79.227.26:4655 , piece_id=KAK4VED4HFJXM6WO3ICYAUBWVHCQRKW4ACETAGAZYCHKJCLV6JRQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: <nil> Dec 8 07:51:52.522323438 (64h22m52.393406483s) [seg_pos={0 0}, upload=56436]: Segment reached optimal threshold of 13 pieces. Dec 8 07:51:52.522550460 (64h22m52.393633495s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17o881pUMuG7K2dv83k7RkrJCrmM7kgUiWesgam4GEw21KVUn7): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522558455 (64h22m52.3936415s) [noise=true , address=145.79.227.29:4942 , piece_id=TOG6LFCQT55I7C7AS4BB7TSUBAOHWBYBADVAVD7RO72ZQ6KQFLYQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522657554 (64h22m52.393740599s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40528->77.90.31.12:4590: use of closed network connection Dec 8 07:51:52.522668415 (64h22m52.39375145s) [noise=true , address=77.90.31.12:4590 , piece_id=JVYF4PSPZWQCRSBZVTAHNNQ3IYARN4KERCMCYPA7KADOAGVSHECQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522900286 (64h22m52.393983331s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 07:51:52.522956193 (64h22m52.394039258s) [noise=true , address=145.79.227.21:4475 , piece_id=WH2XZJM5DYWHII55EKRD5F2UYCRD7M66TJ5OETEKKOJHNPEI27KQ, seg_pos={0 0}, upload=56436]: Long tail cancellation due to optimal threshold Dec 8 07:51:52.522986951 (64h22m52.394069996s) [seg_pos={0 0}, upload=56436]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 07:51:52.523097702 (64h22m52.394180737s) [upload=56436]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 07:51:52.523136586 (64h22m52.394219631s) [upload=56436]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 07:52:28.774033712 (64h23m28.645116757s) [upload=56436]: Done uploading segments... Dec 8 07:52:28.774096702 (64h23m28.645179747s) [upload=56436]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.224973792s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 465.49441ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3a746afe6cedeccc FAIL (2025-12-08 07:54:29 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 465.523457ms core satellite eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 972.82072ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3eabec942a864841 FAIL (2025-12-08 07:54:19 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 972.836238ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [............XXX..........XX......X.....................XX...] duration: 5.829413533s trace: https://jaeger.dev.storj.io/trace/5e0d0482a82d8f09 FAIL (2025-12-08 07:54:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.829445123s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.88999022s trace: https://jaeger.dev.storj.io/trace/1e636cafd6f171bd FAIL (2025-12-08 07:54:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.890008104s core uplink us1

Orbiter Check History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)