Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
3.506626146s
FAIL (2025-10-23 23:39:53 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.506657466s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
3.491855376s
FAIL (2025-10-23 23:38:46 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.491889862s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.473647847s
FAIL (2025-10-23 23:38:13 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.473682101s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.43895347s
FAIL (2025-10-23 23:37:09 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.438985321s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
3.379830189s
FAIL (2025-10-23 23:36:06 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.37986247s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
3.069313942s
FAIL (2025-10-23 23:35:27 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.069342367s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.407324796s
FAIL (2025-10-23 23:34:43 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.407347819s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m52.322051748s
FAIL (2025-10-23 23:34:40 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1m52.322087076s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.997855632s
FAIL (2025-10-23 22:17:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.997895467s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.966800954s
FAIL (2025-10-23 22:16:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.966839949s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.951434662s
FAIL (2025-10-23 22:15:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.951465341s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.908161258s
FAIL (2025-10-23 22:15:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.908202597s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.049449262s
FAIL (2025-10-23 22:14:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.049481491s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.99938651s
FAIL (2025-10-23 22:14:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.999415343s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.953966746s
FAIL (2025-10-23 22:14:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.953994859s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.983551938s
FAIL (2025-10-23 22:13:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.983586193s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.98366156s
FAIL (2025-10-23 22:11:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.983693521s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.028361102s
FAIL (2025-10-23 22:10:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.028399295s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.087041833s
FAIL (2025-10-23 22:10:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.087083864s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.904552015s
FAIL (2025-10-23 22:10:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.904585018s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.023659299s
FAIL (2025-10-23 22:08:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.023690819s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.107760897s
FAIL (2025-10-23 22:08:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.107789332s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.979308377s
FAIL (2025-10-23 22:07:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.979344597s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.843993731s
FAIL (2025-10-23 22:06:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.84401922s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.900257601s
FAIL (2025-10-23 22:06:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.900375657s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.990500484s
FAIL (2025-10-23 22:05:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.990539958s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.975837893s
FAIL (2025-10-23 22:04:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.975870246s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.918727829s
FAIL (2025-10-23 22:04:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.918762493s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.910360677s
FAIL (2025-10-23 22:03:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.910390273s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.955673993s
FAIL (2025-10-23 22:02:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.955713528s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.020029188s
FAIL (2025-10-23 22:01:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.020056478s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.875599306s
FAIL (2025-10-23 22:01:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.875631236s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.9064472s
FAIL (2025-10-23 22:00:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.906485984s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.001082681s
FAIL (2025-10-23 21:59:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.001121886s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.877234209s
FAIL (2025-10-23 21:57:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.877269455s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.916219545s
FAIL (2025-10-23 21:56:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.916251726s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.818994472s
FAIL (2025-10-23 21:55:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.819027796s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.854067385s
FAIL (2025-10-23 21:54:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.854110308s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.034057392s
FAIL (2025-10-23 21:54:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.03421913s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.908816562s
FAIL (2025-10-23 21:53:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.908850687s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.880352767s
FAIL (2025-10-23 21:52:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.880389907s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.991988426s
FAIL (2025-10-23 21:51:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.992065343s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.95706768s
FAIL (2025-10-23 21:51:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.957096005s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.973843341s
FAIL (2025-10-23 21:50:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.973904829s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.857010499s
FAIL (2025-10-23 21:49:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.857051458s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
6.083637882s
FAIL (2025-10-23 21:48:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.083671787s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
6.05306645s
FAIL (2025-10-23 21:47:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.053098232s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.969216016s
FAIL (2025-10-23 21:46:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.969248427s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
6.021661157s
FAIL (2025-10-23 21:45:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.021695221s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.948079272s
FAIL (2025-10-23 21:44:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
727h58m33.304693777s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:47.843590197 (727h58m33.30568268s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Uploading piece...
Oct 23 21:29:49.656197062 (727h58m35.118289545s) [upload=640326]: Next returned nil segment
Oct 23 21:29:49.656290871 (727h58m35.118383384s) [upload=640326]: Waiting for error group managing segments...
Oct 23 21:29:49.983347076 (727h58m35.445439559s) [noise=true , address=45.91.116.4:4939 , piece_id=CJKTJPB2ADFMQ3DTHAQO46STDDP4X2VQITYJGABTOTQZGX2UBKHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: <nil>
Oct 23 21:30:16.901106207 (727h59m2.3631987s) [noise=true , address=145.79.227.23:4547 , piece_id=OC5LVZN4VIIXF3VIWJNX2KYMCEGO2O4WL5WZMU2SLFRHDKDAKJPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1UjJbodRCRm3E63TrzfhbjwFpCmCtfCLS34sQFi1gDJbEwJiKW, address:145.79.227.23:4547): protocol: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37358->145.79.227.23:4547: use of closed network connection
Oct 23 21:30:16.901132667 (727h59m2.36322515s) [noise=true , address=145.79.227.16:4912 , piece_id=FZNS5G32S4RN5SBEW6VYO6XBRAYKY3ID7LKSL6WZHH7LM6FTMOBQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46882->145.79.227.16:4912: use of closed network connection
Oct 23 21:30:16.901212499 (727h59m2.363304982s) [noise=true , address=145.79.227.11:4729 , piece_id=56FEAUDVJQ4RBKSDJTPQZXLAFFBP665MFYRUDH5XIHJPIJVU5HGA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33344->145.79.227.11:4729: use of closed network connection
Oct 23 21:30:16.901220875 (727h59m2.363313358s) [noise=true , address=145.79.227.9:4365 , piece_id=MOP24PVN4ESM5ZYIDK7ELEGSYDIF2FJTCTNWBVSOVL4SANUEIBPQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38824->145.79.227.9:4365: use of closed network connection
Oct 23 21:30:16.901270289 (727h59m2.363362762s) [noise=true , address=145.79.227.8:4331 , piece_id=P5YZMIPIQQPBMK4II2FQW36OEZ5CFZ34I36IRFGZYNYA2LGPASQA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34366->145.79.227.8:4331: use of closed network connection
Oct 23 21:30:16.901331906 (727h59m2.363424379s) [noise=true , address=145.79.227.3:4151 , piece_id=G2QVKKUFDZYWJPAOQXBTBRDMIPK64JH4DTUA47U3WY7S22GIOETA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42378->145.79.227.3:4151: use of closed network connection
Oct 23 21:30:16.901353477 (727h59m2.36344596s) [noise=true , address=145.79.227.14:4840 , piece_id=YED4PA6IALTFJSU74ZS74SKKZDM5SMOZPJEMS3ZF7QKFO22KPVHQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: read tcp 188.166.225.170:36864->145.79.227.14:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901387402 (727h59m2.363479885s) [noise=true , address=145.79.227.17:4972 , piece_id=JCMOATTCGYWNQ5XLAO75GPTFMG65WOSSLXQNCOQVCO322GUS6VHA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57378->145.79.227.17:4972: use of closed network connection
Oct 23 21:30:16.901438759 (727h59m2.363531232s) [noise=true , address=145.79.227.20:4439 , piece_id=QJVIYKL5UT3V6DJ4P2VWEYJ6D4HMORZLH6KDP7JPWEMXNQCD6Z5A, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43582->145.79.227.20:4439: use of closed network connection
Oct 23 21:30:16.901490218 (727h59m2.363582701s) [noise=true , address=145.79.227.20:4438 , piece_id=3HIKSVVA3FPQCO6WYVHIL2QU4RG3OLSMIPGLJXYCGZBEJNQLVR2Q, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43542->145.79.227.20:4438: use of closed network connection
Oct 23 21:30:16.901564930 (727h59m2.363657413s) [noise=true , address=145.79.227.13:4803 , piece_id=UQVTPVZF4K7IHWJMJHBFB5C6OXZ3OW3VN7RXS6FVNO4JNXRIUGOQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44428->145.79.227.13:4803: use of closed network connection
Oct 23 21:30:16.901688997 (727h59m2.36378148s) [noise=true , address=145.79.227.10:4403 , piece_id=2SENLF7KXWKXI7GDWWKMVIOF3WWTDLSUW6Q6WUGQZO6JWDE64CUQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 188.166.225.170:35070->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901759391 (727h59m2.363851874s) [noise=true , address=145.79.227.4:4187 , piece_id=BPFDO3TKCNQ4RFYDEH3JTHCV7ZS3AJH2WGBQ4DQNPUJWQ3AIJFKA, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: read tcp 188.166.225.170:49456->145.79.227.4:4187: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 23 21:30:16.901772295 (727h59m2.363864768s) [noise=true , address=145.79.227.13:4801 , piece_id=SROQUYN2BNUZUT763HEM6HQOFSDJAS5FFLDEADK7VPL4WLYHXWEQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60366->145.79.227.13:4801: use of closed network connection
Oct 23 21:30:16.901938021 (727h59m2.364030504s) [noise=true , address=145.79.227.5:4222 , piece_id=7TLIRAXGHEIUZQYWUDYBIFBYR7NJLH4V7Q73BYYBPSLZOUNTZGGQ, seg_pos={0 0}, upload=640326]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: read tcp 188.166.225.170:43600->145.79.227.5:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Oct 23 21:30:16.901962407 (727h59m2.36405488s) [seg_pos={0 0}, upload=640326]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 23 21:30:17.144684341 (727h59m2.606776814s) [upload=640326]: Done uploading segments...
Oct 23 21:30:17.144715040 (727h59m2.606807513s) [upload=640326]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.948108998s
core
uplink
us-select-1
|