Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.00089888s
FAIL (2025-10-22 19:46:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Oct 22 19:46:08.553917014 (702h14m54.016009497s) [upload=617789]: Starting upload Oct 22 19:46:08.554018878 (702h14m54.016111361s) [upload=617789]: Done starting upload Oct 22 19:46:08.554130720 (702h14m54.016223214s) [upload=617789]: Uploading segments... Oct 22 19:46:08.554282179 (702h14m54.016374663s) [upload=617789]: Got next segment. Inline: false Oct 22 19:46:08.554339378 (702h14m54.016431861s) [upload=617789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 22 19:46:08.554345661 (702h14m54.016438144s) [upload=617789]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Oct 22 19:46:12.218068720 (702h14m57.680161193s) [upload=617789]: Next segment err: context deadline exceeded Oct 22 19:46:12.218143271 (702h14m57.680235754s) [upload=617789]: Done uploading segments... Oct 22 19:46:12.218159472 (702h14m57.680251955s) [upload=617789]: Upload finished. err: context deadline exceeded
Duration: 30.000930309s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.031867172s
FAIL (2025-10-22 06:01:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.031903452s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
6.041833798s
FAIL (2025-10-22 06:00:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.041867843s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.05239589s
FAIL (2025-10-22 06:00:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.052446626s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.93894443s
FAIL (2025-10-22 05:59:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.938982502s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.989793262s
FAIL (2025-10-22 05:58:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.98982353s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.841178354s
FAIL (2025-10-22 05:57:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.841210995s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.895095132s
FAIL (2025-10-22 05:56:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.895125389s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.813203531s
FAIL (2025-10-22 05:55:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.813236393s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.984636753s
FAIL (2025-10-22 05:54:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.984665658s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.947261586s
FAIL (2025-10-22 05:54:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.947305559s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.184656359s
FAIL (2025-10-22 05:53:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.184704792s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.133753769s
FAIL (2025-10-22 05:53:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.133786562s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.119538034s
FAIL (2025-10-22 05:52:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.119575063s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.069383972s
FAIL (2025-10-22 05:51:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.069415121s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.98865107s
FAIL (2025-10-22 05:50:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.988707327s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.9606444s
FAIL (2025-10-22 05:49:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.960667484s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.840906954s
FAIL (2025-10-22 05:48:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.840942833s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.998283249s
FAIL (2025-10-22 05:48:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.998444868s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.063272697s
FAIL (2025-10-22 05:47:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.06331056s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
6.088039083s
FAIL (2025-10-22 05:46:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.088071656s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.936638656s
FAIL (2025-10-22 05:45:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.936663543s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.891321623s
FAIL (2025-10-22 05:44:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.891357501s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.995102801s
FAIL (2025-10-22 05:43:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.995133279s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
6.029249081s
FAIL (2025-10-22 05:42:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.029275892s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.045861588s
FAIL (2025-10-22 05:42:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.045901984s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.007787203s
FAIL (2025-10-22 05:41:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.007819946s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.108266717s
FAIL (2025-10-22 05:41:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.108315198s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.034494773s
FAIL (2025-10-22 05:40:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.034529389s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.930451161s
FAIL (2025-10-22 05:39:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.930478504s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.893267517s
FAIL (2025-10-22 05:39:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.893299878s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.110698027s
FAIL (2025-10-22 05:38:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.110728144s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.048732445s
FAIL (2025-10-22 05:38:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.048763745s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.051235329s
FAIL (2025-10-22 05:37:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.051268751s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.983137617s
FAIL (2025-10-22 05:36:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.983170941s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
6.086556005s
FAIL (2025-10-22 05:35:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.086582827s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.974659986s
FAIL (2025-10-22 05:35:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.974695864s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
6.061412318s
FAIL (2025-10-22 05:34:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.061464126s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.950608798s
FAIL (2025-10-22 05:33:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.950640928s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
6.005810177s
FAIL (2025-10-22 05:33:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.00584386s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.967476484s
FAIL (2025-10-22 05:32:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.967536408s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.793476126s
FAIL (2025-10-22 05:31:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.793503338s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.99038673s
FAIL (2025-10-22 05:31:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.990418241s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.919142319s
FAIL (2025-10-22 05:30:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.919177416s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.988554937s
FAIL (2025-10-22 05:29:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.988587557s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.965845676s
FAIL (2025-10-22 05:28:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.965869873s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
6.192457806s
FAIL (2025-10-22 05:28:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.192496279s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.986404377s
FAIL (2025-10-22 05:27:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.986427031s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.099892079s
FAIL (2025-10-22 05:26:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.09992428s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.968509874s
FAIL (2025-10-22 05:25:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.968545471s
core
uplink
us-select-1
|