Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.187953966s FAIL (2025-09-22 08:46:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.188057934s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.154563351s FAIL (2025-09-22 08:46:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.154593207s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.960083836s FAIL (2025-09-22 08:45:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.960121639s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.949647151s FAIL (2025-09-22 08:44:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.949679852s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.011779712s FAIL (2025-09-22 08:43:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.011817574s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.066401366s FAIL (2025-09-22 08:42:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.066439488s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.91660478s FAIL (2025-09-22 08:42:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.916642953s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.227077404s FAIL (2025-09-22 08:40:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.227108332s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.988905355s FAIL (2025-09-22 08:40:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.988941544s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.916715011s FAIL (2025-09-22 08:39:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.916792618s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.250575926s FAIL (2025-09-22 08:39:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.250611415s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.852115793s FAIL (2025-09-22 08:38:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.852144177s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.995423093s FAIL (2025-09-22 08:37:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.995465854s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.818845615s FAIL (2025-09-22 08:37:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.818887535s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2m32.517957272s FAIL (2025-09-22 08:37:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 2m32.517981719s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.014110122s FAIL (2025-09-22 06:32:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.014213187s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.912561974s FAIL (2025-09-22 06:32:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.912595118s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.264977204s FAIL (2025-09-22 06:31:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.265015016s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.996516943s FAIL (2025-09-22 06:30:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.996542782s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.945278743s FAIL (2025-09-22 06:29:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.945329899s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.99448357s FAIL (2025-09-22 06:28:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.994565226s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.992307901s FAIL (2025-09-22 06:27:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.992344471s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.820865114s FAIL (2025-09-22 06:27:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.820891785s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.843415158s FAIL (2025-09-22 06:26:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.843450547s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.865288905s FAIL (2025-09-22 06:25:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.865327189s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.813713939s FAIL (2025-09-22 06:24:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.813748033s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.017996664s FAIL (2025-09-22 06:24:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.018026851s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.817411582s FAIL (2025-09-22 06:23:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.817445829s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.957495278s FAIL (2025-09-22 06:23:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.957516388s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.001304449s FAIL (2025-09-22 06:22:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.001370184s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.072680773s FAIL (2025-09-22 06:22:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.07271166s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.105206751s FAIL (2025-09-22 06:22:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.105256106s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 6.386061874s FAIL (2025-09-22 06:21:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.386941358s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.238777132s FAIL (2025-09-22 06:21:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.238816206s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.996640719s FAIL (2025-09-22 06:20:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.996670004s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 5.96051634s FAIL (2025-09-22 06:20:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.960539024s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 6.309757522s FAIL (2025-09-22 06:19:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.30978722s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.906431133s FAIL (2025-09-22 06:19:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.906480968s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.767356769s FAIL (2025-09-22 06:19:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.767394682s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..XX.......................................................] duration: 6.362225133s FAIL (2025-09-22 06:19:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.362247406s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.052608121s FAIL (2025-09-22 06:18:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.052642226s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X..XX......................................................] duration: 6.470593113s FAIL (2025-09-22 06:18:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.470626988s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.878672653s FAIL (2025-09-22 06:18:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.878699565s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X..XX.....................................................] duration: 6.061004367s FAIL (2025-09-22 06:17:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.061023996s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.837739061s FAIL (2025-09-22 06:17:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 5.837789637s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X..XX....................................................] duration: 6.094084912s FAIL (2025-09-22 06:16:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.094111784s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X..XX...................................................] duration: 6.156793107s FAIL (2025-09-22 06:16:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.156824175s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.205830257s FAIL (2025-09-22 06:16:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.205865883s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X....X..XX..................................................] duration: 6.122895191s FAIL (2025-09-22 06:15:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.122923284s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.012231154s FAIL (2025-09-22 06:15:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 2s) [upload=330833]: Uploading segments... Sep 22 05:51:55.902608216 (376h23m31.942181336s) [upload=330833]: Got next segment. Inline: false Sep 22 05:51:55.902685893 (376h23m31.942259023s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:51:55.902708546 (376h23m31.942281666s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:51:56.375352169 (376h23m32.414925299s) [seg_pos={0 0}, upload=330833]: Begin upload segment... Sep 22 05:51:56.375418115 (376h23m32.414991235s) [seg_pos={0 0}, upload=330833]: Done begin upload segment. Sep 22 05:51:56.375452561 (376h23m32.415025681s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.375912828 (376h23m32.415485948s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376324120 (376h23m32.41589725s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376616948 (376h23m32.416190078s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.376879808 (376h23m32.416452928s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377214887 (376h23m32.416788017s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377646509 (376h23m32.417219639s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.377982438 (376h23m32.417555568s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.378470187 (376h23m32.418043317s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379031836 (376h23m32.418604956s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379330215 (376h23m32.418903345s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379611781 (376h23m32.419184911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.379869241 (376h23m32.419442361s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380204179 (376h23m32.419777309s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380463063 (376h23m32.420036193s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380702598 (376h23m32.420275728s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.380935932 (376h23m32.420509062s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:56.381176571 (376h23m32.420749691s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Uploading piece... Sep 22 05:51:57.946190192 (376h23m33.985763312s) [upload=330833]: Next returned nil segment Sep 22 05:51:57.946209800 (376h23m33.98578293s) [upload=330833]: Waiting for error group managing segments... Sep 22 05:51:58.344684210 (376h23m34.38425734s) [noise=true , address=77.90.31.21:4883 , piece_id=QI7LGJSFWB7U2MBRVOL76AL7LJJC6X56OJOHHA4JBL63DTJN4KRA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.381657254 (376h23m34.421230384s) [noise=true , address=77.90.31.10:4538 , piece_id=WNGAG4JRTPWMYBQINBS2UZJ7JTZK3CW7Q6P5KBMBNFDAEZNEWSXQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.395656781 (376h23m34.435229911s) [noise=true , address=77.90.31.11:4578 , piece_id=GTVJW6EGUQOWKX5BSWVZBKAP7FPUF2QPTZ6S2W3VE3LSJUPF7JLA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:58.445158071 (376h23m34.484731201s) [noise=true , address=77.90.31.13:4629 , piece_id=RNX2KC2LXAOUTXVVEUE2254NW4UK72FAW7TGUU6GI2LU4UH5Q5SA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.925034767 (376h23m35.964607887s) [noise=true , address=145.79.227.45:4248 , piece_id=M2QITJM43TM3KS7MXZB47TV6HYR5DPLHQUC3Y2U4S6OMMADAIPJA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.936962209 (376h23m35.976535339s) [noise=true , address=145.79.227.33:4879 , piece_id=5R4OCMXP5S32R76Y7SJN3TXQEWZFNSUWYZN7AHC3GU5MIPOESY5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:51:59.962628813 (376h23m36.002201933s) [noise=true , address=145.79.227.47:4296 , piece_id=HFS2LYSXDPISYBQHGTCZRWCXIO3SMCZEVQ7ZJIOABG5GPP42UJCA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:00.490661637 (376h23m36.530234767s) [noise=true , address=145.79.227.20:4465 , piece_id=Y2AKJHEAXNNZKJWR7ZO5GFVDKV7MEE234RWOTSEHXVGR7VBW7QOQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:01.223072967 (376h23m37.262646097s) [noise=true , address=145.79.227.32:4841 , piece_id=WNWQ7TXHPWINOUHYEVDUZHVLOT57SIEQ3Z5SWGCLBQSC2RRAQALQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:03.119796170 (376h23m39.1593693s) [noise=true , address=145.79.227.27:4690 , piece_id=6GEEBJJNFS267ISIPUFAYOD252MXJWGISMXVYXYNQFOYZPVPVRZQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.142296984 (376h23m40.181870104s) [noise=true , address=145.79.227.35:4481 , piece_id=QZOZQ227TXK5KD7G5KSQAWXF4EQNYVRIV3FCP3XMDCSEAL7JGIVQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:04.361619565 (376h23m40.401192685s) [noise=true , address=145.79.227.49:4342 , piece_id=NX3SDZYUUYMGLXLF4GR4KOB5IZAKJ4IIZUHC4GIVEKHXHLCQHSXA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:07.291950974 (376h23m43.331524114s) [noise=true , address=145.79.227.39:4023 , piece_id=3C35OO7477TEWOB6TULP4FVTRR7RUC5WJWYUSY33VIOGQVKPRZ5A, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601224939 (376h23m45.640798079s) [noise=true , address=145.79.227.24:4615 , piece_id=TGZFPLQ5ME3ADHTZW5TMO3JS4MWVF4UYMMSW7MNY4DQ7I7FYDJYA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: <nil> Sep 22 05:52:09.601263913 (376h23m45.640837044s) [seg_pos={0 0}, upload=330833]: Segment reached optimal threshold of 14 pieces. Sep 22 05:52:09.601468373 (376h23m45.641041503s) [noise=true , address=145.79.227.46:4605 , piece_id=XXD53ZCXKF3T6DEO7NK5SNM5B5PF7NZV76MCOEB77RVWJD2TDE5Q, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V5BkzF8va6TqxQgHwDHhVCfEWWfnwJH4F7dZn84yYWiYDAJwc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601732566 (376h23m45.641305696s) [noise=true , address=145.79.227.23:4564 , piece_id=AKGQGTUIHCE6VPIYHNJH2E2REGWOSRSKDGT55ND5V4HIXD456OUA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF Sep 22 05:52:09.601902690 (376h23m45.641475831s) [noise=true , address=145.79.227.40:4067 , piece_id=UBOC7SQJ2STOQV6VPPYQIB4QQHY5WCW2CCRFDYX743VEYHLD74QA, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BPYCUuXmyUAZWEgWk2GWTnmT4Sh2pvnvHLHaFaArX3iSvkrnq): protocol: rpc: dial tcp 145.79.227.40:4067: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:52:09.602135443 (376h23m45.641708573s) [noise=true , address=145.79.227.28:4753 , piece_id=QSXWFACC3AXPVE3S7YGD25GRYB5GOYJEQ4PJREYDIUWBEZQ7QIFQ, seg_pos={0 0}, upload=330833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zzW2z6noGQT6xdSmwSQBNYwip6gZjnmqZg7qdb6BP3nHyCLFz): protocol: read tcp 188.166.225.170:41906->145.79.227.28:4753: use of closed network connection; context canceled Sep 22 05:52:09.602165270 (376h23m45.6417384s) [seg_pos={0 0}, upload=330833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 05:52:09.602266022 (376h23m45.641839142s) [upload=330833]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 05:52:09.602271552 (376h23m45.641844682s) [upload=330833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 05:52:09.924504215 (376h23m45.964077345s) [upload=330833]: Done uploading segments... Sep 22 05:52:09.924529453 (376h23m45.964102594s) [upload=330833]: Upload finished. err: <nil> Duration: 6.012264929s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)