Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.045861588s
FAIL (2025-10-22 05:42:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.045901984s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.007787203s
FAIL (2025-10-22 05:41:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.007819946s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.108266717s
FAIL (2025-10-22 05:41:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.108315198s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.034494773s
FAIL (2025-10-22 05:40:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.034529389s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.930451161s
FAIL (2025-10-22 05:39:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.930478504s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.893267517s
FAIL (2025-10-22 05:39:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.893299878s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.110698027s
FAIL (2025-10-22 05:38:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.110728144s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.048732445s
FAIL (2025-10-22 05:38:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.048763745s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.051235329s
FAIL (2025-10-22 05:37:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.051268751s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.983137617s
FAIL (2025-10-22 05:36:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.983170941s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
6.086556005s
FAIL (2025-10-22 05:35:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.086582827s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.974659986s
FAIL (2025-10-22 05:35:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.974695864s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
6.061412318s
FAIL (2025-10-22 05:34:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.061464126s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.950608798s
FAIL (2025-10-22 05:33:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.950640928s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
6.005810177s
FAIL (2025-10-22 05:33:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.00584386s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.967476484s
FAIL (2025-10-22 05:32:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.967536408s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.793476126s
FAIL (2025-10-22 05:31:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.793503338s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.99038673s
FAIL (2025-10-22 05:31:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.990418241s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.919142319s
FAIL (2025-10-22 05:30:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.919177416s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.988554937s
FAIL (2025-10-22 05:29:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.988587557s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.965845676s
FAIL (2025-10-22 05:28:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.965869873s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
6.192457806s
FAIL (2025-10-22 05:28:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.192496279s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.986404377s
FAIL (2025-10-22 05:27:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.986427031s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.099892079s
FAIL (2025-10-22 05:26:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.09992428s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.968509874s
FAIL (2025-10-22 05:25:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.968545471s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
6.204039609s
FAIL (2025-10-22 05:25:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.204073995s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.894307417s
FAIL (2025-10-22 05:24:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.894336622s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.98955038s
FAIL (2025-10-22 05:24:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.989568704s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.008076946s
FAIL (2025-10-22 05:23:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.008111441s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
6.146104412s
FAIL (2025-10-22 05:21:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.146136784s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.083310838s
FAIL (2025-10-22 05:21:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.083346977s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.971997862s
FAIL (2025-10-22 05:20:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.972031627s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.040397231s
FAIL (2025-10-22 05:20:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.040503342s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
6.128329975s
FAIL (2025-10-22 05:19:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.128365674s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
6.038834056s
FAIL (2025-10-22 05:18:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.038887757s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.255044635s
FAIL (2025-10-22 05:17:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
996]: Next returned nil segment
Oct 22 05:17:24.982993809 (687h46m10.445086282s) [upload=604996]: Waiting for error group managing segments...
Oct 22 05:17:25.283496846 (687h46m10.745589319s) [noise=true , address=77.90.31.18:4805 , piece_id=X6YGZBNRQSUY6ZUZZJZFSP7FNNZELYFIHP6BBCNBT22MT323AATA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: <nil>
Oct 22 05:17:52.126858613 (687h46m37.588951096s) [noise=true , address=145.79.227.3:4150 , piece_id=2YV7BBAMOWIF4XXFIG22EJIRXHZ755VCKE65QE3WAMPA7RBFZRTQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33414->145.79.227.3:4150: use of closed network connection
Oct 22 05:17:52.126914951 (687h46m37.589007434s) [noise=true , address=145.79.227.4:4185 , piece_id=HUQA6K4U55KBP4IHLHYZ46YLXSWTZQKDN4KHRJTUGOXBQZWH7GFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:145.79.227.4:4185): protocol: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48198->145.79.227.4:4185: use of closed network connection
Oct 22 05:17:52.126988902 (687h46m37.589081375s) [noise=true , address=145.79.227.17:4972 , piece_id=OR7KPXW7G2JH67CQLZBN5Z6IISEGFZFGEPRAV3GJCU52VFLWTAIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34840->145.79.227.17:4972: use of closed network connection
Oct 22 05:17:52.127025391 (687h46m37.589117874s) [noise=true , address=145.79.227.16:4912 , piece_id=AADC65XQUPK77QFDLFDKA6FJA5Z3K4QYVBVN2EUQA3L3ITYNM64Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59320->145.79.227.16:4912: use of closed network connection
Oct 22 05:17:52.127065898 (687h46m37.589158381s) [noise=true , address=145.79.227.15:4875 , piece_id=NEGZ3XPJNKRNAMEM354RN5HYKEMBCCVRJKJNNB7ZEKPIR3C4XGFA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43366->145.79.227.15:4875: use of closed network connection
Oct 22 05:17:52.127143255 (687h46m37.589235738s) [noise=true , address=145.79.227.21:4475 , piece_id=XENUVK74ZPFN3LVNK7LTDRJGHI6XO4YKAPIHXDOWV2HYAF2B62TQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32830->145.79.227.21:4475: use of closed network connection
Oct 22 05:17:52.127148877 (687h46m37.58924137s) [noise=true , address=145.79.227.20:4439 , piece_id=F5VC6ZB6TUJKHGSHWIN3F4NSB6HN5Z26TS7GL2N4J22JQWJX2PVQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41574->145.79.227.20:4439: use of closed network connection
Oct 22 05:17:52.127221926 (687h46m37.589314399s) [noise=true , address=145.79.227.2:4114 , piece_id=UXEQEOPI7R4M4DE73ZXBM64RWQAKTRHFWFRFFSLCDRFWONC4K65Q, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54444->145.79.227.2:4114: use of closed network connection
Oct 22 05:17:52.127241973 (687h46m37.589334456s) [noise=true , address=145.79.227.10:4403 , piece_id=NP7OKKE4KZOFER3NVWV2EFPOJLSCEVPEHK4APXENUKEAEXHBN6UA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33084->145.79.227.10:4403: use of closed network connection
Oct 22 05:17:52.127310654 (687h46m37.589403127s) [noise=true , address=145.79.227.7:4295 , piece_id=PFQKXGXMPHIOSCLIFCV3D245U2C4UWH7MUOYN4JBQYSCBWWD3VBQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39352->145.79.227.7:4295: use of closed network connection
Oct 22 05:17:52.127330983 (687h46m37.589423456s) [noise=true , address=145.79.227.8:4331 , piece_id=ASH4XL5RVKLQAFVYJNE4BTS67AMMM3SI4PIUV6LZPCGTT2YBOFUQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1JCBWFkdqHkXb7CR2vdPeHWPuMRRoZT2HWqTa1zDwQ9gwfu8uU, address:145.79.227.8:4331): protocol: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->145.79.227.8:4331: use of closed network connection
Oct 22 05:17:52.127409983 (687h46m37.589502466s) [noise=true , address=145.79.227.3:4151 , piece_id=V3V2DXBJHFC2MMXIBF5Q4LVAAYAZ3DVYOGZV66TRJBMBMWU6Y7JQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39254->145.79.227.3:4151: use of closed network connection
Oct 22 05:17:52.127498863 (687h46m37.589591346s) [noise=true , address=145.79.227.5:4222 , piece_id=IKZJF5FXBWWNVRCMSW7ZBFHO5WSYM4MFIJHBIJWJ4FDX5OFPWSIQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42820->145.79.227.5:4222: use of closed network connection
Oct 22 05:17:52.127705076 (687h46m37.589797569s) [noise=true , address=145.79.227.19:4078 , piece_id=4WQ4ZWXOF5GV7VMW6NTOMKCGPYIFG3UKJBFBYPBJ3O5CCDMBGKMQ, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:36588->145.79.227.19:4078: use of closed network connection
Oct 22 05:17:52.127812320 (687h46m37.589904793s) [noise=true , address=145.79.227.19:4079 , piece_id=6SDO2Z7K7P3K66XKNQQXXL4D25LS6LWJV6PZ6H75SWPNVTHPVVVA, seg_pos={0 0}, upload=604996]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45752->145.79.227.19:4079: use of closed network connection
Oct 22 05:17:52.127842848 (687h46m37.589935321s) [seg_pos={0 0}, upload=604996]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Oct 22 05:17:52.380195007 (687h46m37.84228751s) [upload=604996]: Done uploading segments...
Oct 22 05:17:52.380265361 (687h46m37.842357864s) [upload=604996]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 30.255095833s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
629.392477ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:40:39 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 629.447822ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
656.50796ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:40:23 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 656.542797ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
663.878576ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:39:35 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 663.916047ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
4 out of 60 is failed (threshold=3) [XXXX........................................................] duration:
624.567369ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:38:31 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 624.623276ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
5 out of 60 is failed (threshold=3) [XXXXX.......................................................] duration:
630.058146ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:37:21 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 630.121277ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
6 out of 60 is failed (threshold=3) [XXXXXX......................................................] duration:
658.147472ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:37:01 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 658.188631ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
7 out of 60 is failed (threshold=3) [XXXXXXX.....................................................] duration:
629.144325ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:36:25 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 629.183631ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
7 out of 60 is failed (threshold=3) [.XXXXXXX....................................................] duration:
628.379858ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:35:49 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 628.405427ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
7 out of 60 is failed (threshold=3) [..XXXXXXX...................................................] duration:
655.475696ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:35:29 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 655.501484ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
7 out of 60 is failed (threshold=3) [...XXXXXXX..................................................] duration:
639.367953ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:35:09 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 639.38771ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
7 out of 60 is failed (threshold=3) [....XXXXXXX.................................................] duration:
626.668109ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:34:47 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 626.713205ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
7 out of 60 is failed (threshold=3) [.....XXXXXXX................................................] duration:
633.693667ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:33:47 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 633.728874ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
7 out of 60 is failed (threshold=3) [......XXXXXXX...............................................] duration:
626.75776ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:32:58 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 626.785364ms
core
website
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
7 out of 60 is failed (threshold=3) [.......XXXXXXX..............................................] duration:
630.843621ms remote:
"tcp:34.120.119.150:443" target:
https://version.storj.io/
FAIL (2025-10-21 21:32:42 UTC)
orbiter warning: Get "https://version.storj.io/": tls: failed to verify certificate: x509: certificate is valid for objectmount.com, www.objectmount.com, objectmount.ai, www.objectmount.ai, objectmount.io, www.objectmount.io, objectmount.net, www.objectmount.net, objectmount.org, www.objectmount.org, not version.storj.io
Duration: 630.871815ms
core
website
|