Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
4.643238323s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:47:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.643265715s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
4.658552445s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:45:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.658580928s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
4.696828025s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:45:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.696845359s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
4.587514964s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:44:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.587542745s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
4.293059093s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:43:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.29308913s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.165237884s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:42:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 5.165397277s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
4.666047309s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:41:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.666065564s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.183984984s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:40:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 5.184018247s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
4.682220937s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:39:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.682249562s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
4.789564829s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:39:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.789599504s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
4.790639274s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:38:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.790664482s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
4.256006907s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:37:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.256036915s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.711017723s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:36:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.711043944s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
4.625969074s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:35:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.625994664s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.617390283s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:34:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.617418759s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.704065832s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:33:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.70409127s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
4.216491134s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:33:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.216527092s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.672189139s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:32:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.672213505s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.113310236s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:32:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 5.113335052s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
4.30068421s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:31:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.300704939s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.756992242s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:30:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.757022671s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
4.629468155s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:30:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.629502561s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
4.673745488s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:29:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.673779683s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
4.740370478s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:28:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.740401648s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.103772974s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:27:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 5.103798593s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
4.244379968s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:26:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.244414334s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
4.668003892s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:26:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.668017939s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
4.652141399s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:25:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.652168239s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
4.678175372s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:24:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.678203605s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
56.64236445s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:23:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 56.64239123s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.594045135s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:22:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.594083939s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
4.764927809s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:21:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.764957796s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.582013563s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:20:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.582030647s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
4.269751034s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:20:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.26977992s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
4.604143195s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:18:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.604174354s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
4.724886961s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:18:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.724916107s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.746139567s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:17:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.74616227s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.670868889s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:16:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.670894949s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.270339056s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:15:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.270360678s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
9.870918763s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:15:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 9.870932469s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.168150009s trace:
https://jaeger.dev.storj.io/trace/7558e744ce4160c7
FAIL (2025-12-25 21:14:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
piece...
Dec 25 21:13:56.771132713 (485h44m56.642215748s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771290233 (485h44m56.642373268s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771424147 (485h44m56.642507182s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.771655458 (485h44m56.642738493s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772080678 (485h44m56.643163713s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772389887 (485h44m56.643472922s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.772690830 (485h44m56.643773865s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773055754 (485h44m56.644138789s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:56.773366186 (485h44m56.644449221s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Uploading piece...
Dec 25 21:13:57.595106368 (485h44m57.466189413s) [upload=426336]: Next returned nil segment
Dec 25 21:13:57.595119322 (485h44m57.466202357s) [upload=426336]: Waiting for error group managing segments...
Dec 25 21:13:57.976476392 (485h44m57.847559437s) [noise=true , address=81.171.14.70:4028 , piece_id=N5PE7WM3LXALODMWG4PE5GJY4JTC4LE55EIYFG3E2ATIFIQ7REUQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.984058819 (485h44m57.855141864s) [noise=true , address=185.167.204.205:4022 , piece_id=XQTN7N662BPAJN2HAGJVNB7KV4HVJ3MDHI52K6VVQXYWJ6OQ2FLA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.985179434 (485h44m57.856262469s) [noise=true , address=185.167.204.206:4053 , piece_id=HKLIP347QTNQWBQOKV3JSFGNOSJXY65NY5NWHNOD4CULC6HND2TQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986020966 (485h44m57.857104001s) [noise=true , address=185.167.204.205:4001 , piece_id=XHI54JXIF553XP3O75YFCMULFRKGQKCZMODK4O7TQPZ6GNQ76U4A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.986357256 (485h44m57.857440291s) [noise=true , address=185.167.204.205:4026 , piece_id=L4OL4FBJAQIPJZOLMS7HQDLS5ANAB5BH4JBXWA2YOUIMWH3ZMGEA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.988328560 (485h44m57.859411595s) [noise=true , address=185.167.204.205:4029 , piece_id=GWICARJW2AWFF6N2L2BVOYTEWI6PBB2PWOI2MHRBBAJVTCXPMO6A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.989905162 (485h44m57.860988197s) [noise=true , address=185.167.204.205:4027 , piece_id=5CUZIUOOQ7CKYVAOMH24DRP5CZMUDUUBPAZYWIEDMCDAQJMDVM2Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.990003198 (485h44m57.861086233s) [noise=true , address=185.167.204.205:4036 , piece_id=NGZXM5UHPAVWMPQSJEQ4RNDBLZ4PMJDWB5XJHXQSEPL663TJ56AQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.992957895 (485h44m57.86404093s) [noise=true , address=81.171.14.70:4047 , piece_id=NXQAQS3QIK4CLW5B3UZYDMIZ2YBH6XF6Q3ZRZGEBQYC54GS42BWQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.993962587 (485h44m57.865045622s) [noise=true , address=185.167.204.206:4067 , piece_id=WDQCOP324WE7A6CEX23SF2HKIYBKCALSI62UU3HZ6NWXU54P3OJA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.994190371 (485h44m57.865273406s) [noise=true , address=185.167.204.206:4062 , piece_id=V4UX5YBPKJGIOI2FB7YXIH5ZBJSMTOCUBPEKFTZZVXKKZKFSVFMA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995280166 (485h44m57.866363201s) [noise=true , address=185.167.204.206:4047 , piece_id=3ON2YNYSFJTO3KSTRHLR62DZ25CHP7MNEOTYGXL64C2XJHSJEMCA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.995367914 (485h44m57.866450959s) [noise=true , address=185.167.204.206:4064 , piece_id=LFM3UKVFSNQYQIO3DJITC2EYVGBQD2JXYPK4DD2IRL2KGQG2BAUA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:57.997243275 (485h44m57.86832631s) [noise=true , address=185.167.204.206:4044 , piece_id=ZC6ZTJSS27D47GG6H72TIPCU5I6XYSPUAO6BEK7FO6GDGA3DAS7Q, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.009518258 (485h44m57.880601303s) [noise=true , address=185.167.204.205:4010 , piece_id=2HDMNDKVDC6H63R64AZLVITJGPJ6DYLWIGTSXABX5F7JCG3RJXHA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.011034034 (485h44m57.882117079s) [noise=true , address=185.167.204.205:4033 , piece_id=FPMOUO7ODH5HGX5TQMI3B4ZJNBFJDJKYEJNBYG6UL63PYAWTYZAA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014221173 (485h44m57.885304218s) [noise=true , address=185.167.204.205:4008 , piece_id=S535IAWODU464PEYL22IMLBEKKSCPH32ZYKLLI2BCDOJSHSPF3PA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.014480747 (485h44m57.885563782s) [noise=true , address=185.167.204.205:4030 , piece_id=2OFHY32EJQANORDZBVIWBOPIXJDJUO5JYLERNLJW24YC32YCSHJQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.017501679 (485h44m57.888584714s) [noise=true , address=185.167.204.206:4055 , piece_id=JYTVB64KJU6NTT2OKTBTYM3ITN6LN6JTZWXMZ5RHQRI4FIWQ67WA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.020812724 (485h44m57.891895759s) [noise=true , address=81.171.14.70:4046 , piece_id=U4WOOXI2LPVNBKQXEBCVAJELLYCJNJMQJ6MUIOX6JDKZ5U3IWCRQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.036333589 (485h44m57.907416624s) [noise=true , address=81.171.14.70:4044 , piece_id=RALKLQIQCJA4VLDTZT6FC6QH2YKQBVDSN3FJTYMIATXLDZKSELQQ, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:58.567781283 (485h44m58.438864318s) [noise=true , address=81.171.14.70:4032 , piece_id=2JXQ7J7PGIFKAKOQPMDPKFN52NGQ3YGF2KVAKAACYELI7T6USSVA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:13:59.859284313 (485h44m59.730367348s) [noise=true , address=89.149.201.147:4017 , piece_id=WGJTVV3POL35LZM72ZUVFNARESTWPM6UEBBIYAIBL4TCMTZAY5HA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:04.290883050 (485h45m4.161966105s) [noise=true , address=89.149.201.147:4014 , piece_id=35CRPLZ6JGGOQZFWSOJLXZERN7WDC4VXN2LSZXL64GUINZUHQ7EA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: <nil>
Dec 25 21:14:56.128630221 (485h45m55.999713266s) [noise=true , address=89.149.201.147:4010 , piece_id=SFNFKVMQLQZFMTXJM4F6JK3G47P25NN3PJMZH4632636TPGBGR7A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60900->89.149.201.147:4010: use of closed network connection
Dec 25 21:14:56.128772011 (485h45m55.999855046s) [noise=true , address=89.149.201.147:4007 , piece_id=3LASTPWFFY5LNKWBDEFGJC3ISDKXSFLD5WTF4WJDJUPVESHUMI5A, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54090->89.149.201.147:4007: use of closed network connection
Dec 25 21:14:56.128938387 (485h45m56.000021422s) [noise=true , address=89.149.201.147:4020 , piece_id=Y3H3HY72RYGJXMFLQCNZ6QAS3S7B2YEH7NCQYBAXIRN345BBB5SA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 188.166.225.170:50116->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129146574 (485h45m56.000229619s) [noise=true , address=89.149.201.147:4005 , piece_id=UKQM6IOQDT6ZGMKXP6NTWNJPR6DUCWELZ6YUQWECO72DJW3HWFYA, seg_pos={0 0}, upload=426336]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:53156->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 25 21:14:56.129178625 (485h45m56.00026166s) [seg_pos={0 0}, upload=426336]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Dec 25 21:14:56.294222363 (485h45m56.165305408s) [upload=426336]: Done uploading segments...
Dec 25 21:14:56.294261267 (485h45m56.165344302s) [upload=426336]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 1m0.16817168s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
3.529594037s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:46:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.529620186s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
3.526247605s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:46:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.526275809s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
3.518842362s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:45:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.518869943s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [X..X........................................................] duration:
3.684126601s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:45:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.684150779s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.X..X.......................................................] duration:
3.51579925s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:44:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.515831501s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..X..X......................................................] duration:
3.506813892s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:44:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.506838419s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...X..X.....................................................] duration:
3.565198664s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:43:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.565224262s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [....X..X....................................................] duration:
3.454463126s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:42:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.454510596s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.....X..X...................................................] duration:
3.527406741s trace:
https://jaeger.dev.storj.io/trace/5b7172c399215f06
FAIL (2025-12-25 20:41:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.527436969s
core
uplink
us-select-1
us1-placement-20
|