Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.680570146s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:56:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.680588982s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.709273174s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:55:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.709301498s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.770398084s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:54:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.770424715s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.673228413s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:53:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.673259453s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.69241331s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:53:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.69243883s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.702130873s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:52:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.702157014s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.656561868s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:51:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.656588338s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.691374636s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:50:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.691401116s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.70723745s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:50:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.707263089s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
5.677493004s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:49:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.677522041s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.716546516s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:49:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.716572105s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.697439392s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:47:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.697463858s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.732112172s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:47:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.73213692s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.727597901s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:46:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.727626786s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.880196795s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:45:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.880212355s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.767661411s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:44:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.767693312s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.74763624s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:43:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.74766688s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.672494191s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:43:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.672516945s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.708311125s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:43:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.708326736s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.792412106s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:42:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.79244056s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.756838225s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:41:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.756867482s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.743688573s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:40:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.743714563s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.738268443s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:39:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.738286226s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.700431307s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:38:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.700464501s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.772246987s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:38:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.772279159s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.792391436s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:37:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.792443447s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.769565021s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:36:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.769595941s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.699672286s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:35:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.699704318s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.805117195s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:34:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.805146141s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.705371074s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:34:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.705391784s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.721680589s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:33:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.721715257s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.781485048s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:32:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.781508742s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.768526511s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:31:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.768555748s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.786879908s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:30:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.786909636s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.755520339s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:29:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.755540559s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.713033805s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:28:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.71306286s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.746924553s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:27:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.746949761s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.773868863s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:26:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.773898551s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.673772366s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:26:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.673791373s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.821072304s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:25:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.821101308s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
7.000952367s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:24:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 7.000980331s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.748936316s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:23:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.748957176s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.738793037s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:22:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.738819088s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.673359324s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:21:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.673379802s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.783087403s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:21:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.783124805s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.770208537s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:20:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.770244707s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.761659812s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:19:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.761683897s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.744124009s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:18:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.744153746s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.68479055s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:17:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.684832109s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.799145975s trace:
https://jaeger.dev.storj.io/trace/2951772f2d2b4b96
FAIL (2026-04-13 12:16:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
oad=134592]: Uploading piece...
Apr 13 12:12:15.396994364 (140h26m2.216230388s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397399647 (140h26m2.216635671s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.397760342 (140h26m2.216997188s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398875966 (140h26m2.21811198s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.398993943 (140h26m2.218229967s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.399839084 (140h26m2.219075108s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.400219077 (140h26m2.219455101s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.401557791 (140h26m2.220793815s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.403009182 (140h26m2.222245206s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.404704194 (140h26m2.223940218s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.406989855 (140h26m2.226225879s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:15.407835447 (140h26m2.227071471s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Uploading piece...
Apr 13 12:12:17.216638057 (140h26m4.035874081s) [upload=134592]: Next returned nil segment
Apr 13 12:12:17.216656342 (140h26m4.035892366s) [upload=134592]: Waiting for error group managing segments...
Apr 13 12:12:17.505562076 (140h26m4.3247981s) [noise=true , address=77.90.31.18:4808 , piece_id=KIEH7YV7PE5OD7445MY5EKLFBOBA3T5MOBPHQAWSP75FDRDI3XBA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: <nil>
Apr 13 12:12:44.511796117 (140h26m31.331032141s) [noise=true , address=145.79.227.22:4512 , piece_id=DM2FNBXGQMQR2FZ4PTM2POOQODUULHJNEPTFIKDDLXQSYHBDWURQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.511851874 (140h26m31.331087899s) [noise=true , address=145.79.227.3:4154 , piece_id=33TGDB2XQPMGUDV4232E6NUK5SJDQD3OL4UONW6ZFHZFQLXMIBUQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12S7Xsfnti3QuD9apBq1sgSjmahnAYA6LYbXqyckbLY4UU84ZQF, address:145.79.227.3:4154): protocol: rpc: dial tcp 145.79.227.3:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512000792 (140h26m31.331236816s) [noise=true , address=145.79.227.5:4225 , piece_id=6WMLLIJZNMSDUKLUNAUBYK7T5LRY2WOGWCOXPHNCEYVPL4COE3SQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:145.79.227.5:4225): protocol: rpc: dial tcp 145.79.227.5:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512150771 (140h26m31.331386795s) [noise=true , address=145.79.227.37:4569 , piece_id=VZSVAQM5UN5YXQTDMVMNBWINKBQQ5V2FRXCA3SCY5AJZ2R6WXTSQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: rpc: dial tcp 145.79.227.37:4569: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512159589 (140h26m31.331395613s) [noise=true , address=145.79.227.28:4729 , piece_id=FTOX3BWOX6JUN4RRJNIZRBOBMW5SGDSRODJKFWXKOHI2AOCERTCQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:145.79.227.28:4729): protocol: rpc: dial tcp 145.79.227.28:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512334185 (140h26m31.331570209s) [noise=true , address=145.79.227.21:4475 , piece_id=26PHRV7RB2J5UWFTF6GTCGTZIWHWVE7FI3RIDWRMYDOKVZP6XO7A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk, address:145.79.227.21:4475): protocol: rpc: dial tcp 145.79.227.21:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512486009 (140h26m31.331722023s) [noise=true , address=145.79.227.8:4333 , piece_id=DQQAWMJXWDPQA5EJBP4S3VN5376ASHEYFEV3PYXF7CZC23AJFY3Q, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: rpc: dial tcp 145.79.227.8:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512612011 (140h26m31.331848035s) [noise=true , address=145.79.227.41:4089 , piece_id=ZCVIF3SQ2BDDHSHOHEORQWRETIYPWX7OFXS5565WMIEIY7VYXZMA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12L2DTyJJ3v7KRjA424PVwQn9mpeq5Pq4ZTCerhrStgqgc3cVFk, address:145.79.227.41:4089): protocol: rpc: dial tcp 145.79.227.41:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.512784945 (140h26m31.332020979s) [noise=true , address=145.79.227.20:4439 , piece_id=DBKBUVUD7NE423RT3MH6J6VQYTS5BPFHTBA4KVACV3EM3IHEPATQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1wgkbc3Mkej7supxhYMtUdBvn9t45i6kmAokAUkqFxEpehMjAn, address:145.79.227.20:4439): protocol: rpc: dial tcp 145.79.227.20:4439: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513142605 (140h26m31.332378629s) [noise=true , address=145.79.227.23:4551 , piece_id=3F5H6JCFJ3P55LUHTW5RFLZK32INHGKY32BKDTNH7ABZOXSZLACA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513166873 (140h26m31.332402897s) [noise=true , address=145.79.227.2:4114 , piece_id=LGIKDVJSIR4JDUPAXT67SQ6QGHJ6AM3HU6FNQJ4PSNSZ7HSS647A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513328615 (140h26m31.332564639s) [noise=true , address=145.79.227.17:4974 , piece_id=QFTSBRWIDKGPGV6XWYSZXALF7HAK7DEQXYKNDAIRXNF3X4OSER4A, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1aR2XEwckLo7ufnCtsmyG2PS3vNiqpZs9b66UhuH7vUixcePS1, address:145.79.227.17:4974): protocol: rpc: dial tcp 145.79.227.17:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513472662 (140h26m31.332708686s) [noise=true , address=145.79.227.42:4126 , piece_id=EBYJBXPMT53XKSE4WTQRJET5YFDADOIB2UQYCZGEXUTSQGGMZPDA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513628694 (140h26m31.332864718s) [noise=true , address=145.79.227.27:4695 , piece_id=XZ7KXYVJSLUDU25PAVL7JCBBE2F6NK75QEASOITWUBY64BHYA2JA, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y, address:145.79.227.27:4695): protocol: rpc: dial tcp 145.79.227.27:4695: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513664623 (140h26m31.332900647s) [noise=true , address=145.79.227.18:4010 , piece_id=4DPUJJMLWZ576AN3D66SBYYUMRB4MT43YQIRATHZ6J2TB7FNCFKQ, seg_pos={0 0}, upload=134592]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:145.79.227.18:4010): protocol: rpc: dial tcp 145.79.227.18:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 13 12:12:44.513705812 (140h26m31.332941836s) [seg_pos={0 0}, upload=134592]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Apr 13 12:12:44.747243340 (140h26m31.566479364s) [upload=134592]: Done uploading segments...
Apr 13 12:12:44.747294890 (140h26m31.566530914s) [upload=134592]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.799171706s
core
uplink
us-select-1
|