Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.792966385s FAIL (2025-10-01 10:59:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.792992094s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.281220909s FAIL (2025-10-01 10:59:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.281259993s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.146112055s FAIL (2025-10-01 10:58:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.146142403s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.884819933s FAIL (2025-10-01 10:58:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.884848557s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.121497334s FAIL (2025-10-01 10:58:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.121528574s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 7.463432735s FAIL (2025-10-01 10:57:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 7.463464755s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.398166686s FAIL (2025-10-01 10:57:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.39820565s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.240377725s FAIL (2025-10-01 10:57:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.240406548s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 7.018766539s FAIL (2025-10-01 10:56:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 7.018794724s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.051679865s FAIL (2025-10-01 10:56:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.051710215s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 7.601898522s FAIL (2025-10-01 10:56:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 7.601935041s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.469058419s FAIL (2025-10-01 10:55:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.469105678s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.28652473s FAIL (2025-10-01 10:55:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.286555248s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.758338244s FAIL (2025-10-01 10:55:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.758369854s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.253973852s FAIL (2025-10-01 10:55:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.254009099s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 8.031879516s FAIL (2025-10-01 10:54:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 8.031914802s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.494099218s FAIL (2025-10-01 10:54:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.494133924s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.169247328s FAIL (2025-10-01 10:53:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.169282306s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.324772692s FAIL (2025-10-01 10:53:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.324807608s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.078787267s FAIL (2025-10-01 10:53:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.07882057s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.192156442s FAIL (2025-10-01 10:52:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.192189986s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.968235023s FAIL (2025-10-01 10:51:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.968268788s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.147135524s FAIL (2025-10-01 10:51:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.147168796s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.969790617s FAIL (2025-10-01 10:51:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.969889124s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.068240445s FAIL (2025-10-01 10:50:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.068288207s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.670555394s FAIL (2025-10-01 10:50:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.670587064s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 7.735711004s FAIL (2025-10-01 10:50:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 7.735796016s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.865425313s FAIL (2025-10-01 10:49:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.865462203s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.161241454s FAIL (2025-10-01 10:49:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.161294365s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.201771822s FAIL (2025-10-01 10:49:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.2018131s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.980721784s FAIL (2025-10-01 10:48:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.980752771s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.100845259s FAIL (2025-10-01 10:48:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.100878243s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.434385831s FAIL (2025-10-01 10:47:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.434417591s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.955318075s FAIL (2025-10-01 10:47:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.955355628s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 7.263104585s FAIL (2025-10-01 10:47:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 7.263132627s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.100769123s FAIL (2025-10-01 10:47:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.100802476s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.115233397s FAIL (2025-10-01 10:47:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 6.115269004s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.772796641s FAIL (2025-10-01 10:46:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.772828992s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.995283327s FAIL (2025-10-01 10:46:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 5.995307204s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.188597206s FAIL (2025-10-01 10:46:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== =true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299496859 (188h34m55.761589342s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299680920 (188h34m55.761773393s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299859530 (188h34m55.761952003s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300010808 (188h34m55.762103291s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300316280 (188h34m55.762408753s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300435416 (188h34m55.762527889s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300644905 (188h34m55.762737388s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300943654 (188h34m55.763036137s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:11.148771168 (188h34m56.610863641s) [upload=165815]: Next returned nil segment Oct 1 10:06:11.148794543 (188h34m56.610887026s) [upload=165815]: Waiting for error group managing segments... Oct 1 10:06:11.543538480 (188h34m57.005630963s) [noise=true , address=81.171.14.70:4030 , piece_id=N3P3CG4I5D6RJXECSOBZ7CVO4GVES5JDLEVL6V43DU7BEXKZ6BJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.552441062 (188h34m57.014533545s) [noise=true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.555578596 (188h34m57.017671079s) [noise=true , address=81.171.14.70:4028 , piece_id=6XNCWV3O7XV3GIVCVOGBIMPQA2VM77LZNZ6HLFXCU53SJ4QEBSTQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.566697730 (188h34m57.028790213s) [noise=true , address=89.149.201.147:4005 , piece_id=DQYTPVQGKT5FLNAAXG5U5UQYTI5WY4GI3UNDOHFCZLFLB2F5BYJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.578985097 (188h34m57.04107758s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.582315389 (188h34m57.044407872s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.615749233 (188h34m57.077841706s) [noise=true , address=89.149.201.147:4007 , piece_id=RKU53CZH35BHHL77N3UXYLV3CK52LSG7DZK3RCM4IFSFVST7GI6A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.617455963 (188h34m57.079548436s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.618945099 (188h34m57.081037582s) [noise=true , address=89.149.201.147:4022 , piece_id=Y4OSIOZKVBJB7R3TKJLP3C6BWE4GZUJO4WZY7LMB3DUXQYHU5B5Q, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.068222739 (188h34m57.530315212s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.086889553 (188h34m57.548982036s) [noise=true , address=89.149.201.147:4020 , piece_id=YL6HCW5R77RON5A75YRZUC4N5DP57EDTIKGFVWP5OIEZPOSAAUBQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.180653097 (188h34m57.64274558s) [noise=true , address=185.167.204.205:4015 , piece_id=LSGDFWPG2CZWHTZU6YUVCQIS5UX6TMIWEXGQAQAOS7A2KMAB7AKQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.205440056 (188h34m57.667532529s) [noise=true , address=185.167.204.206:4039 , piece_id=MDEOC77GHPRFHLN4BAJ6QCRNVPHYTABWLPI75KDNLTSGJZTOGKMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.210683852 (188h34m57.672776335s) [noise=true , address=185.167.204.206:4055 , piece_id=EJFFUJ3TPYYML5ZOSOWR6FD3OHBUBSLLQWBS56TB6PUA7UW33KEQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212561427 (188h34m57.6746539s) [noise=true , address=185.167.204.205:4012 , piece_id=VUGA4WIYVUV4WNBMWHYCPJ7IGOUDZZT22R7AW6WMJRVLTMSQ52GA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212970826 (188h34m57.675063299s) [noise=true , address=185.167.204.206:4068 , piece_id=GS4AHBS6VUOTEGV7MZU2DSJN4UIWEM2GCKQ5DPU3GDXUMQW6RIUA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.235824784 (188h34m57.697917257s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.275613560 (188h34m57.737706053s) [noise=true , address=185.167.204.205:4030 , piece_id=ZWJ63EJYHBV3CEBSU6YLZGY7G7POGWWU5KJFWWP2VSXE7FUNFNLQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.281262998 (188h34m57.743355481s) [noise=true , address=185.167.204.206:4048 , piece_id=6RDCYE2D52KW6QGWMWMZOK6BVH4WGRW3ZKJGRJ6FRYQ2DGPXM4ZQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.312769241 (188h34m57.774861714s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.322053741 (188h34m57.784146224s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.357654070 (188h34m57.819746553s) [noise=true , address=185.167.204.206:4037 , piece_id=VZUH3WYP2RLN7ZFEOD5OPBFTFGEF7HBQFIMOOXBSJ74WIFD4ZIDA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:07:09.636747715 (188h35m55.098840198s) [noise=true , address=185.167.204.206:4062 , piece_id=CIFCWAKYL5ZUCYUY7PH5QDNVAM7J2SDPJWWA7OVMAZLD7QB6EOHA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636813550 (188h35m55.098906033s) [noise=true , address=185.167.204.206:4041 , piece_id=43VBYGDEHKZNYYBA3H66Q4F4YJEDD4KC322WWLIVE6OQPUWHQ5HQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636950752 (188h35m55.099043225s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636971632 (188h35m55.099064115s) [noise=true , address=185.167.204.205:4022 , piece_id=3Z3Q4C3QG4VDYNP2OAXYLGSMIVGT5TPP7533I35M6WPHAXE5NWZA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637158407 (188h35m55.09925089s) [noise=true , address=185.167.204.205:4029 , piece_id=LUGDVQHXTNR26AGMCCBRGS6TSVO6IENMJAJEE4R7236PYVF4VPSQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:48710->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637184437 (188h35m55.09927693s) [noise=true , address=185.167.204.206:4056 , piece_id=GPAASMVYD2WLD3TVOFGOIAYGN7XHWQ75G34OUFSFVQST7OL5I6FQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637221858 (188h35m55.099314331s) [seg_pos={0 0}, upload=165815]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Oct 1 10:07:09.805394932 (188h35m55.267487415s) [upload=165815]: Done uploading segments... Oct 1 10:07:09.805424849 (188h35m55.267517332s) [upload=165815]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 5.188633806s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.064756551s FAIL (2025-10-01 10:46:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 6.064793221s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 10.373409061s FAIL (2025-10-01 10:45:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 10.373442503s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.874918138s FAIL (2025-10-01 10:45:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 5.874936554s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.288101798s FAIL (2025-10-01 10:45:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== =true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299496859 (188h34m55.761589342s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299680920 (188h34m55.761773393s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299859530 (188h34m55.761952003s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300010808 (188h34m55.762103291s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300316280 (188h34m55.762408753s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300435416 (188h34m55.762527889s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300644905 (188h34m55.762737388s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300943654 (188h34m55.763036137s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:11.148771168 (188h34m56.610863641s) [upload=165815]: Next returned nil segment Oct 1 10:06:11.148794543 (188h34m56.610887026s) [upload=165815]: Waiting for error group managing segments... Oct 1 10:06:11.543538480 (188h34m57.005630963s) [noise=true , address=81.171.14.70:4030 , piece_id=N3P3CG4I5D6RJXECSOBZ7CVO4GVES5JDLEVL6V43DU7BEXKZ6BJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.552441062 (188h34m57.014533545s) [noise=true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.555578596 (188h34m57.017671079s) [noise=true , address=81.171.14.70:4028 , piece_id=6XNCWV3O7XV3GIVCVOGBIMPQA2VM77LZNZ6HLFXCU53SJ4QEBSTQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.566697730 (188h34m57.028790213s) [noise=true , address=89.149.201.147:4005 , piece_id=DQYTPVQGKT5FLNAAXG5U5UQYTI5WY4GI3UNDOHFCZLFLB2F5BYJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.578985097 (188h34m57.04107758s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.582315389 (188h34m57.044407872s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.615749233 (188h34m57.077841706s) [noise=true , address=89.149.201.147:4007 , piece_id=RKU53CZH35BHHL77N3UXYLV3CK52LSG7DZK3RCM4IFSFVST7GI6A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.617455963 (188h34m57.079548436s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.618945099 (188h34m57.081037582s) [noise=true , address=89.149.201.147:4022 , piece_id=Y4OSIOZKVBJB7R3TKJLP3C6BWE4GZUJO4WZY7LMB3DUXQYHU5B5Q, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.068222739 (188h34m57.530315212s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.086889553 (188h34m57.548982036s) [noise=true , address=89.149.201.147:4020 , piece_id=YL6HCW5R77RON5A75YRZUC4N5DP57EDTIKGFVWP5OIEZPOSAAUBQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.180653097 (188h34m57.64274558s) [noise=true , address=185.167.204.205:4015 , piece_id=LSGDFWPG2CZWHTZU6YUVCQIS5UX6TMIWEXGQAQAOS7A2KMAB7AKQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.205440056 (188h34m57.667532529s) [noise=true , address=185.167.204.206:4039 , piece_id=MDEOC77GHPRFHLN4BAJ6QCRNVPHYTABWLPI75KDNLTSGJZTOGKMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.210683852 (188h34m57.672776335s) [noise=true , address=185.167.204.206:4055 , piece_id=EJFFUJ3TPYYML5ZOSOWR6FD3OHBUBSLLQWBS56TB6PUA7UW33KEQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212561427 (188h34m57.6746539s) [noise=true , address=185.167.204.205:4012 , piece_id=VUGA4WIYVUV4WNBMWHYCPJ7IGOUDZZT22R7AW6WMJRVLTMSQ52GA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212970826 (188h34m57.675063299s) [noise=true , address=185.167.204.206:4068 , piece_id=GS4AHBS6VUOTEGV7MZU2DSJN4UIWEM2GCKQ5DPU3GDXUMQW6RIUA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.235824784 (188h34m57.697917257s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.275613560 (188h34m57.737706053s) [noise=true , address=185.167.204.205:4030 , piece_id=ZWJ63EJYHBV3CEBSU6YLZGY7G7POGWWU5KJFWWP2VSXE7FUNFNLQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.281262998 (188h34m57.743355481s) [noise=true , address=185.167.204.206:4048 , piece_id=6RDCYE2D52KW6QGWMWMZOK6BVH4WGRW3ZKJGRJ6FRYQ2DGPXM4ZQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.312769241 (188h34m57.774861714s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.322053741 (188h34m57.784146224s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.357654070 (188h34m57.819746553s) [noise=true , address=185.167.204.206:4037 , piece_id=VZUH3WYP2RLN7ZFEOD5OPBFTFGEF7HBQFIMOOXBSJ74WIFD4ZIDA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:07:09.636747715 (188h35m55.098840198s) [noise=true , address=185.167.204.206:4062 , piece_id=CIFCWAKYL5ZUCYUY7PH5QDNVAM7J2SDPJWWA7OVMAZLD7QB6EOHA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636813550 (188h35m55.098906033s) [noise=true , address=185.167.204.206:4041 , piece_id=43VBYGDEHKZNYYBA3H66Q4F4YJEDD4KC322WWLIVE6OQPUWHQ5HQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636950752 (188h35m55.099043225s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636971632 (188h35m55.099064115s) [noise=true , address=185.167.204.205:4022 , piece_id=3Z3Q4C3QG4VDYNP2OAXYLGSMIVGT5TPP7533I35M6WPHAXE5NWZA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637158407 (188h35m55.09925089s) [noise=true , address=185.167.204.205:4029 , piece_id=LUGDVQHXTNR26AGMCCBRGS6TSVO6IENMJAJEE4R7236PYVF4VPSQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:48710->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637184437 (188h35m55.09927693s) [noise=true , address=185.167.204.206:4056 , piece_id=GPAASMVYD2WLD3TVOFGOIAYGN7XHWQ75G34OUFSFVQST7OL5I6FQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637221858 (188h35m55.099314331s) [seg_pos={0 0}, upload=165815]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Oct 1 10:07:09.805394932 (188h35m55.267487415s) [upload=165815]: Done uploading segments... Oct 1 10:07:09.805424849 (188h35m55.267517332s) [upload=165815]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 5.288135133s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.002405472s FAIL (2025-10-01 10:45:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr, Piece ID: G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ) context deadline exceeded; piecestore: (Node ID: 1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf, Piece ID: USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA) context deadline exceeded; piecestore: (Node ID: 1uD5YHqzjrr7kVJTpca8KCQUCmRkFwN5hD1ZnCLvDhnSiaofrw, Piece ID: 7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA) context deadline exceeded; piecestore: (Node ID: 12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, Piece ID: ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q) context deadline exceeded; piecestore: (Node ID: 1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN, Piece ID: E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA) context deadline exceeded ======LOGS====== 0:44:37.126088283 (189h13m22.588180766s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.126919957 (189h13m22.58901243s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127278329 (189h13m22.589370812s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127659435 (189h13m22.589751908s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.127672409 (189h13m22.589764892s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128061571 (189h13m22.590154044s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128078363 (189h13m22.590170836s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128369947 (189h13m22.59046242s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128434220 (189h13m22.590526693s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128678595 (189h13m22.590771068s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.128815686 (189h13m22.590908159s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129172877 (189h13m22.59126535s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129382146 (189h13m22.591474629s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129449022 (189h13m22.591541505s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.129911804 (189h13m22.592004277s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:37.130338707 (189h13m22.59243119s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Uploading piece... Oct 1 10:44:38.589303876 (189h13m24.051396359s) [upload=166383]: Next returned nil segment Oct 1 10:44:38.589326108 (189h13m24.051418591s) [upload=166383]: Waiting for error group managing segments... Oct 1 10:44:38.968030163 (189h13m24.430122637s) [noise=true , address=145.79.227.41:4104 , piece_id=7ORQCYH567J5GSXDKNBTA2G72HOCUXCXMAFVZG5BLSRRAI6WB3IA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.982488484 (189h13m24.444580967s) [noise=true , address=145.79.227.35:4503 , piece_id=JX2VTYY7HX6JTRWJH3EURYPAGQMA76B74DDARNQR2INSVBLHPV7Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.990618987 (189h13m24.45271147s) [noise=true , address=145.79.227.18:4039 , piece_id=JYUDRPYG7444LGJXFS6V6A2QX4XA3BH5OCK56VO4OQW42YH5TSBQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:38.998483612 (189h13m24.460576095s) [noise=true , address=145.79.227.2:4127 , piece_id=GABSX6NWZVBGMBRFVD2NDOWSMJ5SIIT3LI4VXSRBBCNJLW5VMPWA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:39.844979412 (189h13m25.307071895s) [noise=true , address=77.90.31.13:4658 , piece_id=2MPUII2VYY4WNE5IDN52UJEWKVWPEMO2KJMCP67H46W3T6BGR35A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.044708856 (189h13m25.506801339s) [noise=true , address=77.90.31.17:4785 , piece_id=E5EUEXTV6MWDK6NGBCZPYP6WAGCE5KJ47QVIYWTNCR63P24WUXAA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.048022405 (189h13m25.510114899s) [noise=true , address=77.90.31.21:4907 , piece_id=NKE5GUBTXMSF4GDCCTLQZEVLCLYTJDC7MJKTRIWPW33SGMLTIXGQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.247673790 (189h13m25.709766263s) [noise=true , address=45.91.116.14:4219 , piece_id=G5NFR5YDKCTYHNMQV3FM7FMQPT4K6KFVJDEXPE5IZTGREGJJNPNQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:40.841439834 (189h13m26.303532307s) [noise=true , address=77.90.31.18:4819 , piece_id=3PT6XV7QV3PKHTDSONNZO3V3GLNZZAJLOJUEUFKKNTWZQREEE74Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:47.220383026 (189h13m32.682475499s) [noise=true , address=77.90.31.11:4570 , piece_id=ZKKVD7W4V67YNF4LSS3P2SWB2HZCWBJ2H62YQCEBUYDXLIKBI46Q, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:48.662123466 (189h13m34.124215939s) [noise=true , address=45.91.116.10:4115 , piece_id=USVPBH3HC2T4QWA5WDYH5YHIY3XQZVGSYW6PZXBTET753A3UMIHA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.138536238 (189h13m34.600628711s) [noise=true , address=45.91.116.5:4317 , piece_id=7IBBCTMFVVZTLLQ4JHDVUT6PL4RCOKQSMQI4KM5YSKTMADJ2Q7UA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:44:49.514478805 (189h13m34.976571278s) [noise=true , address=77.90.31.12:4618 , piece_id=K5QTUAQJUMJ7EMWSKZCHZTPA4MLE53MGXN4ULBTCVQMSS4TVP6UQ, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087070412 (189h13m45.549162896s) [noise=true , address=45.91.116.13:4167 , piece_id=JNGSLREPN6KNIJYUNFTYT5WJI7XJCIWUFTKW456BJOUEC4G4KT2A, seg_pos={0 0}, upload=166383]: Done uploading piece. err: <nil> Oct 1 10:45:00.087093807 (189h13m45.54918629s) [seg_pos={0 0}, upload=166383]: Segment reached optimal threshold of 14 pieces. Oct 1 10:45:00.087248301 (189h13m45.549340774s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087257269 (189h13m45.549349752s) [noise=true , address=77.90.31.15:4730 , piece_id=PDBH6CVE5FLZLVKCGBUOUB3J5NJJMGWAS7XEKPP7ANBFA6HTY6ZA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087462049 (189h13m45.549554532s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Oct 1 10:45:00.087469994 (189h13m45.549562477s) [noise=true , address=77.90.31.10:4548 , piece_id=DC6KKO5JB75YPRLMZV5CLPR7YXBJYS52NNLMNQWYFBF7S723Z4MA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087622814 (189h13m45.549715298s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL): protocol: read tcp 188.166.225.170:33636->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087629297 (189h13m45.54972177s) [noise=true , address=77.90.31.19:4857 , piece_id=DPX4UBURRK52M75WG7IUPRPGHEIGRGA3RVC3TUOBGUW7I27BNORA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087737844 (189h13m45.549830327s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r): protocol: read tcp 188.166.225.170:46338->77.90.31.16:4745: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:45:00.087745178 (189h13m45.549837651s) [noise=true , address=77.90.31.16:4745 , piece_id=OFCBJ7CYQFICUTFIK2OHSJ2HHMQHCCOHPD33ZVFEHKIIETX2DLRA, seg_pos={0 0}, upload=166383]: Long tail cancellation due to optimal threshold Oct 1 10:45:00.087797337 (189h13m45.54988982s) [seg_pos={0 0}, upload=166383]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 1 10:45:00.087870897 (189h13m45.54996338s) [upload=166383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:45:00.087875687 (189h13m45.54996817s) [upload=166383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:45:00.426221511 (189h13m45.888313994s) [upload=166383]: Done uploading segments... Oct 1 10:45:00.426247481 (189h13m45.888339954s) [upload=166383]: Upload finished. err: <nil> Duration: 1m0.002430309s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.09708171s FAIL (2025-10-01 10:45:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== =true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299496859 (188h34m55.761589342s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299680920 (188h34m55.761773393s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299859530 (188h34m55.761952003s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300010808 (188h34m55.762103291s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300316280 (188h34m55.762408753s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300435416 (188h34m55.762527889s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300644905 (188h34m55.762737388s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300943654 (188h34m55.763036137s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:11.148771168 (188h34m56.610863641s) [upload=165815]: Next returned nil segment Oct 1 10:06:11.148794543 (188h34m56.610887026s) [upload=165815]: Waiting for error group managing segments... Oct 1 10:06:11.543538480 (188h34m57.005630963s) [noise=true , address=81.171.14.70:4030 , piece_id=N3P3CG4I5D6RJXECSOBZ7CVO4GVES5JDLEVL6V43DU7BEXKZ6BJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.552441062 (188h34m57.014533545s) [noise=true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.555578596 (188h34m57.017671079s) [noise=true , address=81.171.14.70:4028 , piece_id=6XNCWV3O7XV3GIVCVOGBIMPQA2VM77LZNZ6HLFXCU53SJ4QEBSTQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.566697730 (188h34m57.028790213s) [noise=true , address=89.149.201.147:4005 , piece_id=DQYTPVQGKT5FLNAAXG5U5UQYTI5WY4GI3UNDOHFCZLFLB2F5BYJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.578985097 (188h34m57.04107758s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.582315389 (188h34m57.044407872s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.615749233 (188h34m57.077841706s) [noise=true , address=89.149.201.147:4007 , piece_id=RKU53CZH35BHHL77N3UXYLV3CK52LSG7DZK3RCM4IFSFVST7GI6A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.617455963 (188h34m57.079548436s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.618945099 (188h34m57.081037582s) [noise=true , address=89.149.201.147:4022 , piece_id=Y4OSIOZKVBJB7R3TKJLP3C6BWE4GZUJO4WZY7LMB3DUXQYHU5B5Q, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.068222739 (188h34m57.530315212s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.086889553 (188h34m57.548982036s) [noise=true , address=89.149.201.147:4020 , piece_id=YL6HCW5R77RON5A75YRZUC4N5DP57EDTIKGFVWP5OIEZPOSAAUBQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.180653097 (188h34m57.64274558s) [noise=true , address=185.167.204.205:4015 , piece_id=LSGDFWPG2CZWHTZU6YUVCQIS5UX6TMIWEXGQAQAOS7A2KMAB7AKQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.205440056 (188h34m57.667532529s) [noise=true , address=185.167.204.206:4039 , piece_id=MDEOC77GHPRFHLN4BAJ6QCRNVPHYTABWLPI75KDNLTSGJZTOGKMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.210683852 (188h34m57.672776335s) [noise=true , address=185.167.204.206:4055 , piece_id=EJFFUJ3TPYYML5ZOSOWR6FD3OHBUBSLLQWBS56TB6PUA7UW33KEQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212561427 (188h34m57.6746539s) [noise=true , address=185.167.204.205:4012 , piece_id=VUGA4WIYVUV4WNBMWHYCPJ7IGOUDZZT22R7AW6WMJRVLTMSQ52GA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212970826 (188h34m57.675063299s) [noise=true , address=185.167.204.206:4068 , piece_id=GS4AHBS6VUOTEGV7MZU2DSJN4UIWEM2GCKQ5DPU3GDXUMQW6RIUA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.235824784 (188h34m57.697917257s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.275613560 (188h34m57.737706053s) [noise=true , address=185.167.204.205:4030 , piece_id=ZWJ63EJYHBV3CEBSU6YLZGY7G7POGWWU5KJFWWP2VSXE7FUNFNLQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.281262998 (188h34m57.743355481s) [noise=true , address=185.167.204.206:4048 , piece_id=6RDCYE2D52KW6QGWMWMZOK6BVH4WGRW3ZKJGRJ6FRYQ2DGPXM4ZQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.312769241 (188h34m57.774861714s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.322053741 (188h34m57.784146224s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.357654070 (188h34m57.819746553s) [noise=true , address=185.167.204.206:4037 , piece_id=VZUH3WYP2RLN7ZFEOD5OPBFTFGEF7HBQFIMOOXBSJ74WIFD4ZIDA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:07:09.636747715 (188h35m55.098840198s) [noise=true , address=185.167.204.206:4062 , piece_id=CIFCWAKYL5ZUCYUY7PH5QDNVAM7J2SDPJWWA7OVMAZLD7QB6EOHA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636813550 (188h35m55.098906033s) [noise=true , address=185.167.204.206:4041 , piece_id=43VBYGDEHKZNYYBA3H66Q4F4YJEDD4KC322WWLIVE6OQPUWHQ5HQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636950752 (188h35m55.099043225s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636971632 (188h35m55.099064115s) [noise=true , address=185.167.204.205:4022 , piece_id=3Z3Q4C3QG4VDYNP2OAXYLGSMIVGT5TPP7533I35M6WPHAXE5NWZA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637158407 (188h35m55.09925089s) [noise=true , address=185.167.204.205:4029 , piece_id=LUGDVQHXTNR26AGMCCBRGS6TSVO6IENMJAJEE4R7236PYVF4VPSQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:48710->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637184437 (188h35m55.09927693s) [noise=true , address=185.167.204.206:4056 , piece_id=GPAASMVYD2WLD3TVOFGOIAYGN7XHWQ75G34OUFSFVQST7OL5I6FQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637221858 (188h35m55.099314331s) [seg_pos={0 0}, upload=165815]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Oct 1 10:07:09.805394932 (188h35m55.267487415s) [upload=165815]: Done uploading segments... Oct 1 10:07:09.805424849 (188h35m55.267517332s) [upload=165815]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 5.097113128s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002286692s FAIL (2025-10-01 10:45:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ng upload Oct 1 10:44:38.100984552 (189h13m23.563077035s) [upload=166385]: Done starting upload Oct 1 10:44:38.101160097 (189h13m23.56325258s) [upload=166385]: Uploading segments... Oct 1 10:44:38.101289592 (189h13m23.563382076s) [upload=166385]: Got next segment. Inline: false Oct 1 10:44:38.101332054 (189h13m23.563424527s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 1 10:44:38.101338436 (189h13m23.563430909s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 10:44:38.623254835 (189h13m24.085347318s) [seg_pos={0 0}, upload=166385]: Begin upload segment... Oct 1 10:44:38.623330789 (189h13m24.085423263s) [seg_pos={0 0}, upload=166385]: Done begin upload segment. Oct 1 10:44:38.623705824 (189h13m24.085798307s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.624563456 (189h13m24.086655939s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.625171174 (189h13m24.087263657s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626301125 (189h13m24.088393608s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.626999705 (189h13m24.089092178s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628386156 (189h13m24.090478629s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.628801727 (189h13m24.0908942s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630138412 (189h13m24.092230885s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630349654 (189h13m24.092442127s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630581516 (189h13m24.092673989s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630942282 (189h13m24.093034755s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.630972410 (189h13m24.093064893s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.631532917 (189h13m24.09362539s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.632780884 (189h13m24.094873387s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.633516594 (189h13m24.095609067s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:38.634413763 (189h13m24.096506236s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Uploading piece... Oct 1 10:44:40.310734440 (189h13m25.772826923s) [upload=166385]: Next returned nil segment Oct 1 10:44:40.310758174 (189h13m25.772850647s) [upload=166385]: Waiting for error group managing segments... Oct 1 10:44:40.590364679 (189h13m26.052457152s) [noise=true , address=145.79.227.4:4187 , piece_id=2O4DE6T4A5KHGSXCUJBW4WJ7EPTP5ZJAKNDODUMEDYHURWBWEWUA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.590664289 (189h13m26.052756772s) [noise=true , address=145.79.227.19:4077 , piece_id=IJKDBI5UXAKEENZLNTZTBDMV626CNBKUZ4PW5AU3S43INP3N7NHA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:40.624407392 (189h13m26.086499875s) [noise=true , address=145.79.227.13:4801 , piece_id=4B62A6SAG4IM7ZOLDAL4DVDGMK7AWZCEFOEPZ6EYLP37HYLWQS7Q, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.222974900 (189h13m26.685067383s) [noise=true , address=77.90.31.16:4735 , piece_id=3NEYVNXISVJCKUEB7JJV7RMST2CLJPPI7GYJMW3EJ5VBSHKMR5BA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.374404931 (189h13m26.836497414s) [noise=true , address=45.91.116.4:4939 , piece_id=TA6EEZLZ7Q7VDFTWOT2VZRYZIYF4VOLCO6CQPM6UUEGZIY6OJWTQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:41.387266582 (189h13m26.849359065s) [noise=true , address=45.91.116.14:4191 , piece_id=R5SU63NYJ2PHQLO4TQJHZ726RIL4CQ6O7M2E2EN2IHKIQXFCEP3A, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.381574917 (189h13m27.8436674s) [noise=true , address=45.91.116.7:4010 , piece_id=W43FYECQAF3QMQDJHNDE6Z7Y4QRPTMKSDWNWCQRVF7XHKTE2RZCA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.386755320 (189h13m27.848847803s) [noise=true , address=77.90.31.13:4627 , piece_id=O7JKGMKQPZ6WEOUU4YBSSPYHT4OCBVZYMNQTIZWZX2XUXMBHE6IQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:42.487002611 (189h13m27.949095084s) [noise=true , address=77.90.31.15:4697 , piece_id=L7VSDQ7NU3NUPMHTDGFT2RN7EANMRWZRERW6VJFNZHXEHLQBQ7AQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:43.682231227 (189h13m29.1443237s) [noise=true , address=45.91.116.6:4974 , piece_id=3P7ZLMF3ZAGN5CATN3HDGIMRHFBOOQF4RSWQ2Z2M3ZNWO22ZPZXQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.534742232 (189h13m30.996834715s) [noise=true , address=77.90.31.18:4807 , piece_id=2TPLRA7ZSKYQFUNBGYZZPZVYROMBIQYJCRNJ6EGO4H74ACW7VSQQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:45.994102022 (189h13m31.456194505s) [noise=true , address=77.90.31.18:4805 , piece_id=CCQQOB3NZQ5HA5HQEOCSUGTWLLO7FWETURPPDJ664QVBSEBA5BIQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143313854 (189h13m33.605406327s) [noise=true , address=45.91.116.10:4081 , piece_id=RXXKUJVAEPMULMER3PGUGUPSP4BAULXZDZFPEFQTFHTPME44MYWQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: <nil> Oct 1 10:44:48.143353499 (189h13m33.605445982s) [seg_pos={0 0}, upload=166385]: Segment reached optimal threshold of 13 pieces. Oct 1 10:44:48.143615017 (189h13m33.60570749s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: read tcp 188.166.225.170:34490->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143644924 (189h13m33.605737427s) [noise=true , address=77.90.31.21:4879 , piece_id=YX3JQAWDGDKRIKE3Z7PFISTOGI4W7M4MUWAKFVG7HZ5XIATXRAHQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143718073 (189h13m33.605810556s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: read tcp 188.166.225.170:52302->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143725999 (189h13m33.605818472s) [noise=true , address=45.91.116.11:4118 , piece_id=S3N6JJ4R4PZLZA7LZA6RNJWJTT5XH77EVNVLV2D4N7XXVAPXF3WA, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143779500 (189h13m33.605872003s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: read tcp 188.166.225.170:41790->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:44:48.143789359 (189h13m33.605881832s) [noise=true , address=45.91.116.8:4047 , piece_id=QD4B5JBDVZMW4TSRMKZG4KONOQDHKWDQNYYYRJNHOWU33OHYQGMQ, seg_pos={0 0}, upload=166385]: Long tail cancellation due to optimal threshold Oct 1 10:44:48.143805220 (189h13m33.605897703s) [seg_pos={0 0}, upload=166385]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 1 10:44:48.144003718 (189h13m33.606096201s) [upload=166385]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 1 10:44:48.144012484 (189h13m33.606104967s) [upload=166385]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 1 10:44:49.248259973 (189h13m34.710352446s) [upload=166385]: Done uploading segments... Oct 1 10:44:49.248281383 (189h13m34.710373856s) [upload=166385]: Upload finished. err: <nil> Duration: 30.00231185s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 4.909019432s FAIL (2025-10-01 10:44:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== =true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299496859 (188h34m55.761589342s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299680920 (188h34m55.761773393s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299859530 (188h34m55.761952003s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300010808 (188h34m55.762103291s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300316280 (188h34m55.762408753s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300435416 (188h34m55.762527889s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300644905 (188h34m55.762737388s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300943654 (188h34m55.763036137s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:11.148771168 (188h34m56.610863641s) [upload=165815]: Next returned nil segment Oct 1 10:06:11.148794543 (188h34m56.610887026s) [upload=165815]: Waiting for error group managing segments... Oct 1 10:06:11.543538480 (188h34m57.005630963s) [noise=true , address=81.171.14.70:4030 , piece_id=N3P3CG4I5D6RJXECSOBZ7CVO4GVES5JDLEVL6V43DU7BEXKZ6BJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.552441062 (188h34m57.014533545s) [noise=true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.555578596 (188h34m57.017671079s) [noise=true , address=81.171.14.70:4028 , piece_id=6XNCWV3O7XV3GIVCVOGBIMPQA2VM77LZNZ6HLFXCU53SJ4QEBSTQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.566697730 (188h34m57.028790213s) [noise=true , address=89.149.201.147:4005 , piece_id=DQYTPVQGKT5FLNAAXG5U5UQYTI5WY4GI3UNDOHFCZLFLB2F5BYJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.578985097 (188h34m57.04107758s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.582315389 (188h34m57.044407872s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.615749233 (188h34m57.077841706s) [noise=true , address=89.149.201.147:4007 , piece_id=RKU53CZH35BHHL77N3UXYLV3CK52LSG7DZK3RCM4IFSFVST7GI6A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.617455963 (188h34m57.079548436s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.618945099 (188h34m57.081037582s) [noise=true , address=89.149.201.147:4022 , piece_id=Y4OSIOZKVBJB7R3TKJLP3C6BWE4GZUJO4WZY7LMB3DUXQYHU5B5Q, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.068222739 (188h34m57.530315212s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.086889553 (188h34m57.548982036s) [noise=true , address=89.149.201.147:4020 , piece_id=YL6HCW5R77RON5A75YRZUC4N5DP57EDTIKGFVWP5OIEZPOSAAUBQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.180653097 (188h34m57.64274558s) [noise=true , address=185.167.204.205:4015 , piece_id=LSGDFWPG2CZWHTZU6YUVCQIS5UX6TMIWEXGQAQAOS7A2KMAB7AKQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.205440056 (188h34m57.667532529s) [noise=true , address=185.167.204.206:4039 , piece_id=MDEOC77GHPRFHLN4BAJ6QCRNVPHYTABWLPI75KDNLTSGJZTOGKMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.210683852 (188h34m57.672776335s) [noise=true , address=185.167.204.206:4055 , piece_id=EJFFUJ3TPYYML5ZOSOWR6FD3OHBUBSLLQWBS56TB6PUA7UW33KEQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212561427 (188h34m57.6746539s) [noise=true , address=185.167.204.205:4012 , piece_id=VUGA4WIYVUV4WNBMWHYCPJ7IGOUDZZT22R7AW6WMJRVLTMSQ52GA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212970826 (188h34m57.675063299s) [noise=true , address=185.167.204.206:4068 , piece_id=GS4AHBS6VUOTEGV7MZU2DSJN4UIWEM2GCKQ5DPU3GDXUMQW6RIUA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.235824784 (188h34m57.697917257s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.275613560 (188h34m57.737706053s) [noise=true , address=185.167.204.205:4030 , piece_id=ZWJ63EJYHBV3CEBSU6YLZGY7G7POGWWU5KJFWWP2VSXE7FUNFNLQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.281262998 (188h34m57.743355481s) [noise=true , address=185.167.204.206:4048 , piece_id=6RDCYE2D52KW6QGWMWMZOK6BVH4WGRW3ZKJGRJ6FRYQ2DGPXM4ZQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.312769241 (188h34m57.774861714s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.322053741 (188h34m57.784146224s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.357654070 (188h34m57.819746553s) [noise=true , address=185.167.204.206:4037 , piece_id=VZUH3WYP2RLN7ZFEOD5OPBFTFGEF7HBQFIMOOXBSJ74WIFD4ZIDA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:07:09.636747715 (188h35m55.098840198s) [noise=true , address=185.167.204.206:4062 , piece_id=CIFCWAKYL5ZUCYUY7PH5QDNVAM7J2SDPJWWA7OVMAZLD7QB6EOHA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636813550 (188h35m55.098906033s) [noise=true , address=185.167.204.206:4041 , piece_id=43VBYGDEHKZNYYBA3H66Q4F4YJEDD4KC322WWLIVE6OQPUWHQ5HQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636950752 (188h35m55.099043225s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636971632 (188h35m55.099064115s) [noise=true , address=185.167.204.205:4022 , piece_id=3Z3Q4C3QG4VDYNP2OAXYLGSMIVGT5TPP7533I35M6WPHAXE5NWZA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637158407 (188h35m55.09925089s) [noise=true , address=185.167.204.205:4029 , piece_id=LUGDVQHXTNR26AGMCCBRGS6TSVO6IENMJAJEE4R7236PYVF4VPSQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:48710->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637184437 (188h35m55.09927693s) [noise=true , address=185.167.204.206:4056 , piece_id=GPAASMVYD2WLD3TVOFGOIAYGN7XHWQ75G34OUFSFVQST7OL5I6FQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637221858 (188h35m55.099314331s) [seg_pos={0 0}, upload=165815]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Oct 1 10:07:09.805394932 (188h35m55.267487415s) [upload=165815]: Done uploading segments... Oct 1 10:07:09.805424849 (188h35m55.267517332s) [upload=165815]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 4.909040843s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 4.938216413s FAIL (2025-10-01 10:43:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== =true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299496859 (188h34m55.761589342s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299680920 (188h34m55.761773393s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299859530 (188h34m55.761952003s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300010808 (188h34m55.762103291s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300316280 (188h34m55.762408753s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300435416 (188h34m55.762527889s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300644905 (188h34m55.762737388s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300943654 (188h34m55.763036137s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:11.148771168 (188h34m56.610863641s) [upload=165815]: Next returned nil segment Oct 1 10:06:11.148794543 (188h34m56.610887026s) [upload=165815]: Waiting for error group managing segments... Oct 1 10:06:11.543538480 (188h34m57.005630963s) [noise=true , address=81.171.14.70:4030 , piece_id=N3P3CG4I5D6RJXECSOBZ7CVO4GVES5JDLEVL6V43DU7BEXKZ6BJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.552441062 (188h34m57.014533545s) [noise=true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.555578596 (188h34m57.017671079s) [noise=true , address=81.171.14.70:4028 , piece_id=6XNCWV3O7XV3GIVCVOGBIMPQA2VM77LZNZ6HLFXCU53SJ4QEBSTQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.566697730 (188h34m57.028790213s) [noise=true , address=89.149.201.147:4005 , piece_id=DQYTPVQGKT5FLNAAXG5U5UQYTI5WY4GI3UNDOHFCZLFLB2F5BYJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.578985097 (188h34m57.04107758s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.582315389 (188h34m57.044407872s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.615749233 (188h34m57.077841706s) [noise=true , address=89.149.201.147:4007 , piece_id=RKU53CZH35BHHL77N3UXYLV3CK52LSG7DZK3RCM4IFSFVST7GI6A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.617455963 (188h34m57.079548436s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.618945099 (188h34m57.081037582s) [noise=true , address=89.149.201.147:4022 , piece_id=Y4OSIOZKVBJB7R3TKJLP3C6BWE4GZUJO4WZY7LMB3DUXQYHU5B5Q, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.068222739 (188h34m57.530315212s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.086889553 (188h34m57.548982036s) [noise=true , address=89.149.201.147:4020 , piece_id=YL6HCW5R77RON5A75YRZUC4N5DP57EDTIKGFVWP5OIEZPOSAAUBQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.180653097 (188h34m57.64274558s) [noise=true , address=185.167.204.205:4015 , piece_id=LSGDFWPG2CZWHTZU6YUVCQIS5UX6TMIWEXGQAQAOS7A2KMAB7AKQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.205440056 (188h34m57.667532529s) [noise=true , address=185.167.204.206:4039 , piece_id=MDEOC77GHPRFHLN4BAJ6QCRNVPHYTABWLPI75KDNLTSGJZTOGKMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.210683852 (188h34m57.672776335s) [noise=true , address=185.167.204.206:4055 , piece_id=EJFFUJ3TPYYML5ZOSOWR6FD3OHBUBSLLQWBS56TB6PUA7UW33KEQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212561427 (188h34m57.6746539s) [noise=true , address=185.167.204.205:4012 , piece_id=VUGA4WIYVUV4WNBMWHYCPJ7IGOUDZZT22R7AW6WMJRVLTMSQ52GA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212970826 (188h34m57.675063299s) [noise=true , address=185.167.204.206:4068 , piece_id=GS4AHBS6VUOTEGV7MZU2DSJN4UIWEM2GCKQ5DPU3GDXUMQW6RIUA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.235824784 (188h34m57.697917257s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.275613560 (188h34m57.737706053s) [noise=true , address=185.167.204.205:4030 , piece_id=ZWJ63EJYHBV3CEBSU6YLZGY7G7POGWWU5KJFWWP2VSXE7FUNFNLQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.281262998 (188h34m57.743355481s) [noise=true , address=185.167.204.206:4048 , piece_id=6RDCYE2D52KW6QGWMWMZOK6BVH4WGRW3ZKJGRJ6FRYQ2DGPXM4ZQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.312769241 (188h34m57.774861714s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.322053741 (188h34m57.784146224s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.357654070 (188h34m57.819746553s) [noise=true , address=185.167.204.206:4037 , piece_id=VZUH3WYP2RLN7ZFEOD5OPBFTFGEF7HBQFIMOOXBSJ74WIFD4ZIDA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:07:09.636747715 (188h35m55.098840198s) [noise=true , address=185.167.204.206:4062 , piece_id=CIFCWAKYL5ZUCYUY7PH5QDNVAM7J2SDPJWWA7OVMAZLD7QB6EOHA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636813550 (188h35m55.098906033s) [noise=true , address=185.167.204.206:4041 , piece_id=43VBYGDEHKZNYYBA3H66Q4F4YJEDD4KC322WWLIVE6OQPUWHQ5HQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636950752 (188h35m55.099043225s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636971632 (188h35m55.099064115s) [noise=true , address=185.167.204.205:4022 , piece_id=3Z3Q4C3QG4VDYNP2OAXYLGSMIVGT5TPP7533I35M6WPHAXE5NWZA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637158407 (188h35m55.09925089s) [noise=true , address=185.167.204.205:4029 , piece_id=LUGDVQHXTNR26AGMCCBRGS6TSVO6IENMJAJEE4R7236PYVF4VPSQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:48710->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637184437 (188h35m55.09927693s) [noise=true , address=185.167.204.206:4056 , piece_id=GPAASMVYD2WLD3TVOFGOIAYGN7XHWQ75G34OUFSFVQST7OL5I6FQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637221858 (188h35m55.099314331s) [seg_pos={0 0}, upload=165815]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Oct 1 10:07:09.805394932 (188h35m55.267487415s) [upload=165815]: Done uploading segments... Oct 1 10:07:09.805424849 (188h35m55.267517332s) [upload=165815]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 4.938274642s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 4.907018823s FAIL (2025-10-01 10:43:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== =true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299496859 (188h34m55.761589342s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299680920 (188h34m55.761773393s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.299859530 (188h34m55.761952003s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300010808 (188h34m55.762103291s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300316280 (188h34m55.762408753s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300435416 (188h34m55.762527889s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300644905 (188h34m55.762737388s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:10.300943654 (188h34m55.763036137s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Uploading piece... Oct 1 10:06:11.148771168 (188h34m56.610863641s) [upload=165815]: Next returned nil segment Oct 1 10:06:11.148794543 (188h34m56.610887026s) [upload=165815]: Waiting for error group managing segments... Oct 1 10:06:11.543538480 (188h34m57.005630963s) [noise=true , address=81.171.14.70:4030 , piece_id=N3P3CG4I5D6RJXECSOBZ7CVO4GVES5JDLEVL6V43DU7BEXKZ6BJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.552441062 (188h34m57.014533545s) [noise=true , address=81.171.14.70:4045 , piece_id=IL4IP5ZALROAZTBLBQEV6Q6PWVEC2QJ7WGYS2HLTOOUOORDSKTJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.555578596 (188h34m57.017671079s) [noise=true , address=81.171.14.70:4028 , piece_id=6XNCWV3O7XV3GIVCVOGBIMPQA2VM77LZNZ6HLFXCU53SJ4QEBSTQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.566697730 (188h34m57.028790213s) [noise=true , address=89.149.201.147:4005 , piece_id=DQYTPVQGKT5FLNAAXG5U5UQYTI5WY4GI3UNDOHFCZLFLB2F5BYJQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.578985097 (188h34m57.04107758s) [noise=true , address=89.149.201.147:4010 , piece_id=VZLR7SY3F4YKCGO2JMTQ64GL4K7ASJBA2MDEWD5WCDB535EBX7LQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.582315389 (188h34m57.044407872s) [noise=true , address=81.171.14.70:4034 , piece_id=SGKC3F4DG5IXXY2MXY57X7YRKBJYOCN3DARTPANMITTCLU6OZD5A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.615749233 (188h34m57.077841706s) [noise=true , address=89.149.201.147:4007 , piece_id=RKU53CZH35BHHL77N3UXYLV3CK52LSG7DZK3RCM4IFSFVST7GI6A, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.617455963 (188h34m57.079548436s) [noise=true , address=89.149.201.147:4014 , piece_id=L33PCWDEOI65X4E2YQU63B43KU7E6VJIUYAAO7YKUTWOEN77W3TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:11.618945099 (188h34m57.081037582s) [noise=true , address=89.149.201.147:4022 , piece_id=Y4OSIOZKVBJB7R3TKJLP3C6BWE4GZUJO4WZY7LMB3DUXQYHU5B5Q, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.068222739 (188h34m57.530315212s) [noise=true , address=81.171.14.70:4025 , piece_id=PZDA5AYY74RUHP42LDQGHOWFRHSQPPXRSKTJ3VSSMSEETXAQBNUQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.086889553 (188h34m57.548982036s) [noise=true , address=89.149.201.147:4020 , piece_id=YL6HCW5R77RON5A75YRZUC4N5DP57EDTIKGFVWP5OIEZPOSAAUBQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.180653097 (188h34m57.64274558s) [noise=true , address=185.167.204.205:4015 , piece_id=LSGDFWPG2CZWHTZU6YUVCQIS5UX6TMIWEXGQAQAOS7A2KMAB7AKQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.205440056 (188h34m57.667532529s) [noise=true , address=185.167.204.206:4039 , piece_id=MDEOC77GHPRFHLN4BAJ6QCRNVPHYTABWLPI75KDNLTSGJZTOGKMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.210683852 (188h34m57.672776335s) [noise=true , address=185.167.204.206:4055 , piece_id=EJFFUJ3TPYYML5ZOSOWR6FD3OHBUBSLLQWBS56TB6PUA7UW33KEQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212561427 (188h34m57.6746539s) [noise=true , address=185.167.204.205:4012 , piece_id=VUGA4WIYVUV4WNBMWHYCPJ7IGOUDZZT22R7AW6WMJRVLTMSQ52GA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.212970826 (188h34m57.675063299s) [noise=true , address=185.167.204.206:4068 , piece_id=GS4AHBS6VUOTEGV7MZU2DSJN4UIWEM2GCKQ5DPU3GDXUMQW6RIUA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.235824784 (188h34m57.697917257s) [noise=true , address=185.167.204.205:4027 , piece_id=B5XUX6WXSV66VLBY6VEERYXBBIMC5QBEGZ3F63DRH2WU3VIRGNMA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.275613560 (188h34m57.737706053s) [noise=true , address=185.167.204.205:4030 , piece_id=ZWJ63EJYHBV3CEBSU6YLZGY7G7POGWWU5KJFWWP2VSXE7FUNFNLQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.281262998 (188h34m57.743355481s) [noise=true , address=185.167.204.206:4048 , piece_id=6RDCYE2D52KW6QGWMWMZOK6BVH4WGRW3ZKJGRJ6FRYQ2DGPXM4ZQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.312769241 (188h34m57.774861714s) [noise=true , address=185.167.204.205:4010 , piece_id=E4FLH23MXXRI74D2BQKZBY4UOAVAEMISBHIWFCS36ZUSH23QSSFA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.322053741 (188h34m57.784146224s) [noise=true , address=185.167.204.206:4064 , piece_id=HDSMJGHWTURP4BBZNG2XET6LZBTCYYE4ATCODK2IFZ5WQ6VNV6IA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:06:12.357654070 (188h34m57.819746553s) [noise=true , address=185.167.204.206:4037 , piece_id=VZUH3WYP2RLN7ZFEOD5OPBFTFGEF7HBQFIMOOXBSJ74WIFD4ZIDA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: <nil> Oct 1 10:07:09.636747715 (188h35m55.098840198s) [noise=true , address=185.167.204.206:4062 , piece_id=CIFCWAKYL5ZUCYUY7PH5QDNVAM7J2SDPJWWA7OVMAZLD7QB6EOHA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636813550 (188h35m55.098906033s) [noise=true , address=185.167.204.206:4041 , piece_id=43VBYGDEHKZNYYBA3H66Q4F4YJEDD4KC322WWLIVE6OQPUWHQ5HQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636950752 (188h35m55.099043225s) [noise=true , address=185.167.204.205:4032 , piece_id=EYE5SCFVUBEZM4AQGA6U4B7CCMKGO6URSK6VGKRYQG7GYR4MK6TA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.636971632 (188h35m55.099064115s) [noise=true , address=185.167.204.205:4022 , piece_id=3Z3Q4C3QG4VDYNP2OAXYLGSMIVGT5TPP7533I35M6WPHAXE5NWZA, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: rpc: dial tcp 185.167.204.205:4022: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637158407 (188h35m55.09925089s) [noise=true , address=185.167.204.205:4029 , piece_id=LUGDVQHXTNR26AGMCCBRGS6TSVO6IENMJAJEE4R7236PYVF4VPSQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:48710->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637184437 (188h35m55.09927693s) [noise=true , address=185.167.204.206:4056 , piece_id=GPAASMVYD2WLD3TVOFGOIAYGN7XHWQ75G34OUFSFVQST7OL5I6FQ, seg_pos={0 0}, upload=165815]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 10:07:09.637221858 (188h35m55.099314331s) [seg_pos={0 0}, upload=165815]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Oct 1 10:07:09.805394932 (188h35m55.267487415s) [upload=165815]: Done uploading segments... Oct 1 10:07:09.805424849 (188h35m55.267517332s) [upload=165815]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 4.907051757s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)