Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.001282171s FAIL (2025-09-22 16:00:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001300244s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.000896544s FAIL (2025-09-22 16:00:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000924246s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001464441s FAIL (2025-09-22 15:59:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001490319s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.114441286s FAIL (2025-09-22 09:20:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.114477535s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.01219267s FAIL (2025-09-22 09:19:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.012225242s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.059465468s FAIL (2025-09-22 09:18:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.059500324s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.910838443s FAIL (2025-09-22 09:18:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.91086263s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.987792596s FAIL (2025-09-22 09:17:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.987830576s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.822960816s FAIL (2025-09-22 09:17:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.823001432s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.851355014s FAIL (2025-09-22 09:16:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.851391995s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.868789848s FAIL (2025-09-22 09:15:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.868822659s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.971615792s FAIL (2025-09-22 09:14:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.971651282s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.060739043s FAIL (2025-09-22 09:13:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.060773419s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.20357224s FAIL (2025-09-22 09:13:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.203615012s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.218367691s FAIL (2025-09-22 09:11:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.218419309s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.888140087s FAIL (2025-09-22 09:11:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.888172367s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.066773314s FAIL (2025-09-22 09:10:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.066809441s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.36280986s FAIL (2025-09-22 09:09:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.362851128s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.057823709s FAIL (2025-09-22 09:08:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.057859778s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.166009628s FAIL (2025-09-22 09:07:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.166041588s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.296218096s FAIL (2025-09-22 09:07:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.296249815s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.966705689s FAIL (2025-09-22 09:06:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.966738352s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.165735488s FAIL (2025-09-22 09:05:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.165766447s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.180933628s FAIL (2025-09-22 09:05:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.18100797s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.97556217s FAIL (2025-09-22 09:04:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.975601565s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.132427946s FAIL (2025-09-22 09:03:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.132459917s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.398783886s FAIL (2025-09-22 09:03:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.398817781s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.993427268s FAIL (2025-09-22 09:02:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.993464129s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.431192288s FAIL (2025-09-22 09:01:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.43124046s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.073355857s FAIL (2025-09-22 09:00:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.073394813s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.090826387s FAIL (2025-09-22 09:00:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.090877594s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.991657889s FAIL (2025-09-22 08:58:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.991700529s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.0919438s FAIL (2025-09-22 08:58:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.091973937s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.11899838s FAIL (2025-09-22 08:57:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.119028928s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.097499279s FAIL (2025-09-22 08:56:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.097536218s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.848417478s FAIL (2025-09-22 08:56:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.848451513s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.01409434s FAIL (2025-09-22 08:55:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.0141309s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.057584135s FAIL (2025-09-22 08:55:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.057672043s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.951998896s FAIL (2025-09-22 08:53:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.952040486s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.809662188s FAIL (2025-09-22 08:53:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.809696635s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.012323323s FAIL (2025-09-22 08:52:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.01235788s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.097037439s FAIL (2025-09-22 08:51:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.097075342s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.933756413s FAIL (2025-09-22 08:50:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.933789285s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.95625877s FAIL (2025-09-22 08:50:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.956292864s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.596667586s FAIL (2025-09-22 08:49:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.596765222s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.938029567s FAIL (2025-09-22 08:49:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.938066328s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.992206743s FAIL (2025-09-22 08:48:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.992242181s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.922884454s FAIL (2025-09-22 08:47:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.922921986s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.187953966s FAIL (2025-09-22 08:46:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.188057934s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.154563351s FAIL (2025-09-22 08:46:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 236]: Starting upload Sep 22 08:34:49.813993169 (379h6m25.853566299s) [upload=333236]: Done starting upload Sep 22 08:34:49.814319820 (379h6m25.85389294s) [upload=333236]: Uploading segments... Sep 22 08:34:49.814362502 (379h6m25.853935622s) [upload=333236]: Got next segment. Inline: false Sep 22 08:34:49.814387339 (379h6m25.853960469s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 08:34:49.814391858 (379h6m25.853964988s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 08:34:50.314525027 (379h6m26.354098157s) [seg_pos={0 0}, upload=333236]: Begin upload segment... Sep 22 08:34:50.314597876 (379h6m26.354171006s) [seg_pos={0 0}, upload=333236]: Done begin upload segment. Sep 22 08:34:50.314629987 (379h6m26.354203117s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314669422 (379h6m26.354242552s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.314726952 (379h6m26.354300082s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315236582 (379h6m26.354809712s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315280285 (379h6m26.354853415s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315731745 (379h6m26.355304865s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.315857174 (379h6m26.355430304s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316146956 (379h6m26.355720086s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316337027 (379h6m26.355910157s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316548871 (379h6m26.356122001s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.316958320 (379h6m26.35653145s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317111272 (379h6m26.356684402s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.317415942 (379h6m26.356989072s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.318040190 (379h6m26.35761332s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322256098 (379h6m26.361829218s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.322880167 (379h6m26.362453307s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.323902704 (379h6m26.363475824s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:50.324359474 (379h6m26.363932604s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Uploading piece... Sep 22 08:34:51.796958375 (379h6m27.836531505s) [upload=333236]: Next returned nil segment Sep 22 08:34:51.796977121 (379h6m27.836550241s) [upload=333236]: Waiting for error group managing segments... Sep 22 08:34:52.189294679 (379h6m28.228867809s) [noise=true , address=145.79.227.34:4911 , piece_id=NZ7LBN4K7ACN7LSFRTPXVQZMFSFD63L66RWTCO4MSSQQ6KNRK4RA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.193762205 (379h6m28.233335336s) [noise=true , address=145.79.227.23:4567 , piece_id=HOFETDEJ43N7YIR6VZKOCCZBQRKEXEJ2HBXX6GGJPIW4KJCOHYWQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.198595699 (379h6m28.238168819s) [noise=true , address=145.79.227.31:4819 , piece_id=SPIOCGLYVX4MNQMOL6CQ4FJORUMPVGKEIKZWV5WNJPP6GDVFLRBQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.206663983 (379h6m28.246237113s) [noise=true , address=145.79.227.49:4354 , piece_id=ZGIWYG56G3R6RATIEPB76XBYO33JZ2UGEG3OKKR5YPXXWNEJ4FLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207147714 (379h6m28.246720834s) [noise=true , address=145.79.227.22:4521 , piece_id=3BFFC7WR3EOH6C7LEVKHIGCWO2WPEU5TVBEFSTDTUZYOLCXEPTEA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.207636886 (379h6m28.247210006s) [noise=true , address=145.79.227.27:4689 , piece_id=4W7VSGXFNXTCL2VXWVHEMDLRFI72JEYO3DWB44QSWRJODFT2KCSA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.218519058 (379h6m28.258092198s) [noise=true , address=145.79.227.46:4611 , piece_id=UVVJNMZZWCJKKJN3DSY4MO442HOKZHCUSGOAZ5DK4FLA2TAJS4WA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.222393986 (379h6m28.261967116s) [noise=true , address=145.79.227.25:4629 , piece_id=FRCXYSOKF7K2V2Q6LBJMQK2EKJDER7BUVQSA5QPYHSJMAZKMQPPA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.223861079 (379h6m28.263434199s) [noise=true , address=145.79.227.48:4309 , piece_id=RNTWBHZL2SJPE4J6VP66WZ4OWBRLB6DEAXRSVLA5EBPQ3BPDQDLQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.225445306 (379h6m28.265018436s) [noise=true , address=145.79.227.46:4610 , piece_id=JPX3I6DVKWEIGBWDBEL3SSJGAR4BMUZCZYDBFTB7QXD6GCBPLIIA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229039520 (379h6m28.26861265s) [noise=true , address=145.79.227.52:4470 , piece_id=HG525OYIYCFER4YB7QST5OCJAWTJINJH2GLMBAS63VUG77IBHM2Q, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.229561905 (379h6m28.269135035s) [noise=true , address=145.79.227.33:4876 , piece_id=C6Z6BBLVO3Z3MAC3QQ2OEGMH36H6OPJRQ2JJ6FH4NK6TN25UBFZQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236347156 (379h6m28.275920286s) [noise=true , address=145.79.227.39:4039 , piece_id=IDLSESGYRWIVPWBFO44HSQ6EPDCH2G2RBURZDHC4TQ754QEJKBEQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236510777 (379h6m28.276083907s) [noise=true , address=145.79.227.52:4457 , piece_id=DVRF6VX27UDRXY3355GJSSWGAGRF33Z7GLTW6N6OJQOPCYJAICCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: <nil> Sep 22 08:34:52.236537929 (379h6m28.276111059s) [seg_pos={0 0}, upload=333236]: Segment reached optimal threshold of 14 pieces. Sep 22 08:34:52.236836328 (379h6m28.276409448s) [noise=true , address=77.90.31.15:4726 , piece_id=NHGCOTPR6DHQJNZ3CLOIWHBZUW5VEKR37IC3562WHYPYBCZNBERQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kMaukCkCJSc3ukAZu3thLgzXGGzNq44dGyEjCPqoY3PSYVEm3): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236851376 (379h6m28.276424506s) [noise=true , address=45.91.116.10:4100 , piece_id=VEIZ4LDQWGQWC326KNUBNPBWKN7V3GRMC4FWKWUTLQWX5UFLMCYQ, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PQzzS3ZUKXCpiPHqTokRAC9MUuU8QQp7fJTDydmYehhs21YBn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236922181 (379h6m28.276495311s) [noise=true , address=45.91.116.11:4151 , piece_id=A47UONVVCSVCJERX4ZNSW35YUBM4XIUKJ6IRK3NMLEV6XKHBMFVA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13V8hQxkV4kuinaNsJzW8FYqUaRWrsrLy4FG9UtanaT7F6jkgC): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236942019 (379h6m28.276515149s) [noise=true , address=77.90.31.19:4875 , piece_id=KFWN6GDFRCL5VQTQ2ZA4J7RVPQQ56ZLRVDYNJJ2V2EBVL227ASCA, seg_pos={0 0}, upload=333236]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF Sep 22 08:34:52.236958890 (379h6m28.276532021s) [seg_pos={0 0}, upload=333236]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 22 08:34:52.237056967 (379h6m28.276630097s) [upload=333236]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 08:34:52.237062538 (379h6m28.276635668s) [upload=333236]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 08:37:21.605027831 (379h8m57.644600961s) [upload=333236]: Done uploading segments... Sep 22 08:37:21.605056465 (379h8m57.644629595s) [upload=333236]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.154593207s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)