Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.1132332s FAIL (2025-10-06 22:03:15 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.113270211s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 702.354502ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 22:02:47 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 702.382565ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.784571173s FAIL (2025-10-06 22:02:36 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 6.784605568s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.273413644s FAIL (2025-10-06 22:02:29 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.273445726s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 740.068385ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 22:01:36 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 740.099294ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.257501131s FAIL (2025-10-06 22:01:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 6.257614358s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.299315956s FAIL (2025-10-06 22:01:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.29934926s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 724.06263ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 22:00:51 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 724.091235ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.53023725s FAIL (2025-10-06 22:00:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.530274342s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.142838095s FAIL (2025-10-06 22:00:22 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 6.142874304s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 703.207156ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 22:00:12 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 703.237494ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.569661097s FAIL (2025-10-06 21:59:41 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.569693779s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 706.620504ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:59:41 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 706.650542ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.668521272s FAIL (2025-10-06 21:59:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.668559634s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 719.259283ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:59:04 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 719.287105ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.917591141s FAIL (2025-10-06 21:58:42 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.91762167s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.162185804s FAIL (2025-10-06 21:58:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.162216972s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.867063368s FAIL (2025-10-06 21:58:20 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.867152529s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 712.931241ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:58:02 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 712.961189ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.200652213s FAIL (2025-10-06 21:57:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.200709591s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.580821703s FAIL (2025-10-06 21:57:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.580876177s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 766.140623ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:57:18 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 766.172805ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.898149312s FAIL (2025-10-06 21:57:12 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.898186713s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.05784504s FAIL (2025-10-06 21:57:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.057882752s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.426921409s FAIL (2025-10-06 21:56:18 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.426973408s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 723.317437ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:56:06 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 723.352304ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.647012693s FAIL (2025-10-06 21:56:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.647043643s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.929903626s FAIL (2025-10-06 21:56:00 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.929946337s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 725.095584ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:55:11 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 725.164173ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.706912912s FAIL (2025-10-06 21:54:57 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.706943488s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.23191901s FAIL (2025-10-06 21:54:49 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.231949308s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 720.643907ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:54:47 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 720.690927ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.009175015s FAIL (2025-10-06 21:54:03 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 6.009206404s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 696.111394ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:53:42 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 696.137764ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.528407386s FAIL (2025-10-06 21:53:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.528442203s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.980735224s FAIL (2025-10-06 21:53:15 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.980796602s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.105747017s FAIL (2025-10-06 21:53:13 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.105778116s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.92688059s FAIL (2025-10-06 21:52:54 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.926927829s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.298761429s FAIL (2025-10-06 21:52:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.298823779s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 691.861271ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:52:47 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 691.89265ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 700.93663ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:52:20 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 700.985395ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.346183602s FAIL (2025-10-06 21:51:58 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.34620939s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.857557928s FAIL (2025-10-06 21:51:56 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.857596s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 694.313671ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:51:40 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 694.34496ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.971175946s FAIL (2025-10-06 21:51:07 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.971211373s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.385058508s FAIL (2025-10-06 21:50:57 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :10.893937348 (320h14m56.356029831s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894116319 (320h14m56.356208812s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894442981 (320h14m56.356535464s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894517913 (320h14m56.356610386s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894828475 (320h14m56.356920948s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.894901423 (320h14m56.356993907s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895157502 (320h14m56.357249975s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895248334 (320h14m56.357340807s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895461119 (320h14m56.357553592s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895584485 (320h14m56.357676958s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895740581 (320h14m56.357833054s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.895970800 (320h14m56.358063273s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896095197 (320h14m56.35818768s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896436026 (320h14m56.358528499s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896447097 (320h14m56.35853958s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896471643 (320h14m56.358564126s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:10.896779309 (320h14m56.358871792s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Uploading piece... Oct 6 21:46:12.279095460 (320h14m57.741187944s) [upload=281874]: Next returned nil segment Oct 6 21:46:12.279171024 (320h14m57.741263517s) [upload=281874]: Waiting for error group managing segments... Oct 6 21:46:12.659282936 (320h14m58.12137541s) [noise=true , address=64.49.13.155:4923 , piece_id=R3ELJKAXYUNUDNNCVGDD3TSIPLRGBISHCBL6BRIMS7PTPZ3H7QSQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.745941981 (320h14m58.208034464s) [noise=true , address=145.79.227.41:4104 , piece_id=HZTHMQOHUAAJ7GOIQQVZGHDL7TURBLH7CWR4SMD6DAAMJFBZ6SXQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.757164832 (320h14m58.219257305s) [noise=true , address=145.79.227.27:4709 , piece_id=V2OIC66X6V775N77SEF6DXL5G2O23NTBXBKU3327DXOB2RQUD5QA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.759881254 (320h14m58.221973737s) [noise=true , address=145.79.227.22:4526 , piece_id=4G3YMBW7GYPYMYKJHAFXWBANMQ3ZYBPWEJXNYBBGMDEIPYVPO53Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:12.770054335 (320h14m58.232146808s) [noise=true , address=145.79.227.51:4429 , piece_id=RRVWEPAHC3PVI6E4AHIFLE3OBLMFRFLUZ2A46OGVSLXUFX6OUN2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.090820895 (320h14m58.552913378s) [noise=true , address=45.91.116.6:4993 , piece_id=5QLDYVFHUNQNDAUB36XNSRMKQMZOQMWVVUIOI7YLREH2UWTUNB5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.137972199 (320h14m58.600064682s) [noise=true , address=45.91.116.4:4958 , piece_id=ZXQW5UT3EMAH7E26XMHCPKDCAFTMI3V533E7OM5QZ46XGRAHLLCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.155198151 (320h14m58.617290624s) [noise=true , address=77.90.31.21:4881 , piece_id=UM7H6WJJNW2QHNN253Y3NUFPTNU7ZRTJRYPGXGMUBWIC4AUERNOA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.185240577 (320h14m58.64733306s) [noise=true , address=77.90.31.15:4716 , piece_id=VVWRPUZ4XB5H3GKWWVUBY2ULSPUUTWEA5FOBRBEY2SBNX6YLG2VQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.208195237 (320h14m58.67028772s) [noise=true , address=45.91.116.13:4185 , piece_id=GRLAPG6AUGWKTI7OL5N74GPL7PLX4367CHIRZUZ7BVTYDVGLRBLQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.210035230 (320h14m58.672127713s) [noise=true , address=45.91.116.10:4092 , piece_id=VMSNXZ4CHAA6DWBBGPNHNCL6SADAMEOFBTAYCSWFWBANVTQ5ROPA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.212687631 (320h14m58.674780104s) [noise=true , address=77.90.31.19:4847 , piece_id=W7T4AUGV5MIY7V7RU63HAHNOYFKRAVW2EYMLXW7W3JOLK6UCNRCQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.215839582 (320h14m58.677932065s) [noise=true , address=45.91.116.14:4214 , piece_id=NKFMCOSXTSTBTVGJHOTXILCVHF7TAESHIB456YEI32HCBUJZZF5A, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232182503 (320h14m58.694274986s) [noise=true , address=77.90.31.16:4758 , piece_id=TVIQCBKLSRJWTDWZ4WM5TEHWA7OR5WUMNZY2D6SOII2XZ57R4P2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: <nil> Oct 6 21:46:13.232217209 (320h14m58.694309692s) [seg_pos={0 0}, upload=281874]: Segment reached optimal threshold of 14 pieces. Oct 6 21:46:13.232357165 (320h14m58.694449648s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232366903 (320h14m58.694459386s) [noise=true , address=77.90.31.13:4659 , piece_id=3LMCEUOZ3DPQ7XSW5DSM5VWZYHPMYU2GVEGGYEDSPCEOISP7AIHQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232453358 (320h14m58.694545841s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232477885 (320h14m58.694570368s) [noise=true , address=77.90.31.18:4815 , piece_id=22FZWT53BFXPMZIEWMHE6JEZG5BLTZROQFRLRAOIXVFKH7LABE2Q, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232497182 (320h14m58.694589665s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232508423 (320h14m58.694600906s) [noise=true , address=45.91.116.10:4107 , piece_id=KQC3RPR2SEA5UJICTPTOS2HA2GWIGTWOVGSIZNMIPF4PW53HEGAQ, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232588004 (320h14m58.694680487s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127RBQsp1SwQU6yWh6Y48QF3QCzeJxEGjob8gzF3LRutRZXA6A9): protocol: expected piece hash; context canceled; EOF Oct 6 21:46:13.232596701 (320h14m58.694689184s) [noise=true , address=45.91.116.5:4314 , piece_id=NJCYDZNYP7IP7Y24WLIZ5EEC67DQDPNKOSNAKWQ3ZKRFH2TY3NUA, seg_pos={0 0}, upload=281874]: Long tail cancellation due to optimal threshold Oct 6 21:46:13.232651124 (320h14m58.694743608s) [seg_pos={0 0}, upload=281874]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 6 21:46:13.232793385 (320h14m58.694885868s) [upload=281874]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 6 21:46:13.232800609 (320h14m58.694893092s) [upload=281874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 6 21:46:13.565002502 (320h14m59.027094976s) [upload=281874]: Done uploading segments... Oct 6 21:46:13.565029424 (320h14m59.027121907s) [upload=281874]: Upload finished. err: <nil> Duration: 6.385092191s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.649413532s FAIL (2025-10-06 21:50:50 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.649497781s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 703.21022ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:50:39 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 703.242722ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.076668504s FAIL (2025-10-06 21:50:19 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 6.076702328s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 690.676995ms remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-10-06 21:50:09 UTC) orbiter warning: Get "https://us1.storj.io/login": context deadline exceeded Duration: 690.71188ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)