Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [..X..X...X..........X.X.X.....X.......XXX...................] duration: 22.263306271s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:29:07 UTC) orbiter warning: context deadline exceeded Duration: 22.263323764s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [....................X....................X...X..X...........] duration: 14.186635678s trace: https://jaeger.dev.storj.io/trace/320447183612ca53 FAIL (2026-01-16 14:29:06 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 14.186665323s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.000751373s trace: https://jaeger.dev.storj.io/trace/68acecc6053bf14b FAIL (2026-01-16 14:28:57 UTC) orbiter warning: context deadline exceeded Duration: 30.000776331s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....................X....................X...X..X..........] duration: 23.456227872s trace: https://jaeger.dev.storj.io/trace/320447183612ca53 FAIL (2026-01-16 14:28:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 23.456254865s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XXXXX..XXX] duration: 5.000885569s trace: https://jaeger.dev.storj.io/trace/2f346702478797e FAIL (2026-01-16 14:28:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000910927s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [X..X..X...X..........X.X.X.....X.......XXX..................] duration: 11.408401219s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:28:30 UTC) orbiter warning: context deadline exceeded Duration: 11.408592383s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [X.XX.....X..................................................] duration: 4.469933749s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:28:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.469999505s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.00131857s trace: https://jaeger.dev.storj.io/trace/35f18e55e7729e FAIL (2026-01-16 14:28:12 UTC) orbiter warning: context deadline exceeded Duration: 30.001337707s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.X..X..X...X..........X.X.X.....X.......XXX.................] duration: 7.762668395s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:28:00 UTC) orbiter warning: context deadline exceeded Duration: 7.762693091s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XXXXX..XX] duration: 5.001414184s trace: https://jaeger.dev.storj.io/trace/2e8b0ef1c3ba294d FAIL (2026-01-16 14:27:35 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001488906s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [..X..X..X...X..........X.X.X.....X.......XXX................] duration: 22.859512196s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:27:33 UTC) orbiter warning: context deadline exceeded Duration: 22.859536652s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [......................X....................X...X..X.........] duration: 12.637459103s trace: https://jaeger.dev.storj.io/trace/320447183612ca53 FAIL (2026-01-16 14:27:27 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.637485523s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.X.XX.....X.................................................] duration: 4.37894358s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:27:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.378973316s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXX] duration: 30.000936352s trace: https://jaeger.dev.storj.io/trace/600741db1aa333a FAIL (2026-01-16 14:27:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001006285s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..X.XX.....X................................................] duration: 4.712720038s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:26:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.71274764s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XXXXX..X] duration: 5.000654678s trace: https://jaeger.dev.storj.io/trace/798343ae8cf1c04 FAIL (2026-01-16 14:26:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000676421s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [...X..X..X...X..........X.X.X.....X.......XXX...............] duration: 22.649269654s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:26:50 UTC) orbiter warning: context deadline exceeded Duration: 22.649354155s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......................X....................X...X..X........] duration: 30.000940952s trace: https://jaeger.dev.storj.io/trace/320447183612ca53 FAIL (2026-01-16 14:26:42 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000966801s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [X..X.XX.....X...............................................] duration: 4.540171116s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:26:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.540196454s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXX] duration: 30.000594807s trace: https://jaeger.dev.storj.io/trace/8136072f0f5cf55 FAIL (2026-01-16 14:26:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000607962s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 55 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XXXXX..] duration: 4.00342276s trace: https://jaeger.dev.storj.io/trace/2c5f52d0df276dee FAIL (2026-01-16 14:26:15 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.00346389s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XXXXX.] duration: 3.990736345s trace: https://jaeger.dev.storj.io/trace/2c5f52d0df276dee FAIL (2026-01-16 14:25:51 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.990751323s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.X..X.XX.....X..............................................] duration: 4.292428963s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:25:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.292449321s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXX] duration: 30.001579819s trace: https://jaeger.dev.storj.io/trace/7e77cab0b99b6052 FAIL (2026-01-16 14:25:46 UTC) orbiter warning: context deadline exceeded Duration: 30.00160035s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [....X..X..X...X..........X.X.X.....X.......XXX..............] duration: 24.185297055s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:25:42 UTC) orbiter warning: context deadline exceeded Duration: 24.185341359s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [..X..X.XX.....X.............................................] duration: 4.797601025s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:25:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.797627604s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [........................X....................X...X..X.......] duration: 22.573078251s trace: https://jaeger.dev.storj.io/trace/320447183612ca53 FAIL (2026-01-16 14:25:33 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 22.573098041s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXX] duration: 30.001461159s trace: https://jaeger.dev.storj.io/trace/4069abc01cc1d572 FAIL (2026-01-16 14:25:02 UTC) orbiter warning: context deadline exceeded Duration: 30.001477559s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.....X..X..X...X..........X.X.X.....X.......XXX.............] duration: 9.450603854s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:25:01 UTC) orbiter warning: context deadline exceeded Duration: 9.450627919s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XXXXX] duration: 5.001121277s trace: https://jaeger.dev.storj.io/trace/2c5f52d0df276dee FAIL (2026-01-16 14:24:47 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001142918s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........................X....................X...X..X......] duration: 18.232842321s trace: https://jaeger.dev.storj.io/trace/320447183612ca53 FAIL (2026-01-16 14:24:40 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 18.232871809s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [...X..X.XX.....X............................................] duration: 4.800622755s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:24:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.800651271s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [......X..X..X...X..........X.X.X.....X.......XXX............] duration: 11.01605478s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:24:30 UTC) orbiter warning: context deadline exceeded Duration: 11.016088716s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XXXX] duration: 5.001541767s trace: https://jaeger.dev.storj.io/trace/66a072c224785c10 FAIL (2026-01-16 14:24:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001597703s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX] duration: 30.001447591s trace: https://jaeger.dev.storj.io/trace/5125ef85021cafdf FAIL (2026-01-16 14:24:21 UTC) orbiter warning: context deadline exceeded Duration: 30.001475693s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [....X..X.XX.....X...........................................] duration: 4.578332066s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:23:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.578350211s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXX] duration: 30.001750626s trace: https://jaeger.dev.storj.io/trace/6429489f9240b4ce FAIL (2026-01-16 14:23:42 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001776936s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.......X..X..X...X..........X.X.X.....X.......XXX...........] duration: 31.696800732s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:23:38 UTC) orbiter warning: context deadline exceeded Duration: 31.696849987s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........................X....................X...X..X.....] duration: 11.699441833s trace: https://jaeger.dev.storj.io/trace/320447183612ca53 FAIL (2026-01-16 14:23:33 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.699464186s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XXX] duration: 5.000651543s trace: https://jaeger.dev.storj.io/trace/2f21bfa9d88da66a FAIL (2026-01-16 14:23:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000673354s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.XX] duration: 5.000479264s trace: https://jaeger.dev.storj.io/trace/52969bb4ba410486 FAIL (2026-01-16 14:23:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000501426s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.....X..X.XX.....X..........................................] duration: 5.240689276s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:22:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.240731375s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXX] duration: 30.001000833s trace: https://jaeger.dev.storj.io/trace/55ac485fdc7d96e4 FAIL (2026-01-16 14:22:32 UTC) orbiter warning: context deadline exceeded Duration: 30.001020662s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.X] duration: 5.001221467s trace: https://jaeger.dev.storj.io/trace/727fb6d39c664e8f FAIL (2026-01-16 14:22:32 UTC) orbiter warning: context deadline exceeded Duration: 5.001245213s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [........X..X..X...X..........X.X.X.....X.......XXX..........] duration: 20.033881369s trace: https://jaeger.dev.storj.io/trace/585efedda6658af FAIL (2026-01-16 14:22:21 UTC) orbiter warning: context deadline exceeded Duration: 20.033912297s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........................X....................X...X..X....] duration: 9.577026953s trace: https://jaeger.dev.storj.io/trace/320447183612ca53 FAIL (2026-01-16 14:22:17 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.577059286s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [......X..X.XX.....X.........................................] duration: 4.618225034s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:22:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.618242789s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..XXXXXXXXXXXXXX.] duration: 4.798194904s trace: https://jaeger.dev.storj.io/trace/26e58185a2552579 FAIL (2026-01-16 14:22:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.798217257s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 58 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXX.XXXXXXXXXXXXXXXX] duration: 30.001414638s trace: https://jaeger.dev.storj.io/trace/20d99597a8218189 FAIL (2026-01-16 14:21:57 UTC) orbiter warning: context deadline exceeded Duration: 30.001435036s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.......X..X.XX.....X........................................] duration: 4.581514826s trace: https://jaeger.dev.storj.io/trace/18ea158581539e05 FAIL (2026-01-16 14:21:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== : Uploading piece... Jan 16 13:47:34.817121271 (21h51m31.71082988s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817237642 (21h51m31.710946251s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817351119 (21h51m31.711059728s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817710643 (21h51m31.711419282s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.817769405 (21h51m31.711478014s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818062553 (21h51m31.711771162s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818137756 (21h51m31.711846365s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818415194 (21h51m31.712123793s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.818739812 (21h51m31.712448421s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819043791 (21h51m31.7127524s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819337630 (21h51m31.713046239s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819543422 (21h51m31.713252031s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:34.819810982 (21h51m31.713519591s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Uploading piece... Jan 16 13:47:35.646384760 (21h51m32.540093369s) [upload=19196]: Next returned nil segment Jan 16 13:47:35.646399467 (21h51m32.540108076s) [upload=19196]: Waiting for error group managing segments... Jan 16 13:47:36.044357389 (21h51m32.938065998s) [noise=true , address=81.171.14.70:4045 , piece_id=GC5TS2METLE6BBQQGYRMWPTMVH3RMRKQJA2RXKQFCCTCJB2JXMBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.049970457 (21h51m32.943679076s) [noise=true , address=81.171.14.70:4042 , piece_id=PFKTRW3DI6O7EQ4LSDBQM5YQDJ6JQLXCNZTBCNMTYD3SKQWVGGLQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.057550509 (21h51m32.951259118s) [noise=true , address=81.171.14.70:4040 , piece_id=4ZRIS4UHZC6SMLPEIXS6KU6UAKYVIGI6ZMJFRFJ25PY4RB32WVEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.093832752 (21h51m32.987541361s) [noise=true , address=81.171.14.70:4026 , piece_id=YZUBTL2WRUNDUPW376BG676VAWOU2GMIMQITAKTWIKJ3HKZXNLZA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.370239906 (21h51m33.263948515s) [noise=true , address=185.167.204.206:4067 , piece_id=BSRJBOCNWZIYTEP6HY3NOGZORQTPCWKN43E6HPVC37LY5I5CJYNA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.384125184 (21h51m33.277833793s) [noise=true , address=185.167.204.206:4062 , piece_id=3Z6VWEXXIA3ISY73C5JV5S5ROLCBR6DSQWZVI6Q3QSSYLRBNM6LQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391293162 (21h51m33.285001771s) [noise=true , address=185.167.204.206:4064 , piece_id=2PDTBJHQW5AHYD2SOM6Q5D6BYGQJCWSWQNLRXCNRPWYBHKBS6B3Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.391398192 (21h51m33.285106801s) [noise=true , address=185.167.204.206:4040 , piece_id=XCGSNFY225UO7MYFSYWQQLVMP73RIUVII7ZYTTGWZ3TQU2DPMOTA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.392101912 (21h51m33.285810521s) [noise=true , address=185.167.204.206:4061 , piece_id=EN3JISM5WLYJWU3UG3BFTNCBOP7MTIFJBRYU4KTKDFVSWCEJRVJA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.400384883 (21h51m33.294093492s) [noise=true , address=185.167.204.206:4039 , piece_id=BJWZY2S2EZSQO6CJM25WV4RIYTMS3P4CG5RHC44JXDMUGA3Z3JEQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.405248333 (21h51m33.298956942s) [noise=true , address=185.167.204.206:4050 , piece_id=E5FLLMTDTPGGIAKZDIIWPBOFWQL7YXZSUA7Z5YSN2KWJOASDJF6Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.414198665 (21h51m33.307907274s) [noise=true , address=185.167.204.205:4006 , piece_id=XCZ2NHQZKDA7AADK3JP26Y3WOZMXQ5IJV5THD5V2P5TX3F7WAFOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423293562 (21h51m33.317002171s) [noise=true , address=185.167.204.206:4045 , piece_id=FHIBGSVU2OZBBQETRZNJK6QW7DTCV7ITCEMUGEYQAN6ZYMQQYTOQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.423504314 (21h51m33.317212923s) [noise=true , address=185.167.204.205:4018 , piece_id=3J3LKBXHO5E2IYUVRO7NG7BSYXYBQEFRHV23OQHXHFBYBIYOBQ2A, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.435923832 (21h51m33.329632461s) [noise=true , address=185.167.204.205:4019 , piece_id=NGOWYQ3TZHPLUJ73WVIC3YYL65EYJVBKOPUWCI4DLEGRPQIECBBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.436584970 (21h51m33.330293579s) [noise=true , address=185.167.204.205:4026 , piece_id=SVVM4Q6OCLSV7TWVURRBYN765J44OTG7AFOQS3RZX7GKFMDJ6ZJQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.491250847 (21h51m33.384959456s) [noise=true , address=81.171.14.70:4031 , piece_id=EF67IQMYFBPUP6UZXDGSQLHR6X4G6OSCKEH4DYWCKI4UIHO4UVDA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.518740798 (21h51m33.412449407s) [noise=true , address=81.171.14.70:4030 , piece_id=SLIXLC6YJ5PLS4MCXJIACYV5MIFOQSBARATYC3WAEZEZSVWICMCQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.526006844 (21h51m33.419715453s) [noise=true , address=81.171.14.70:4025 , piece_id=DCILR24FF45JKLU36SHTMAJLY3NTFNGT4UWNFJXATADZJY2W3TBA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.564445552 (21h51m33.458154161s) [noise=true , address=81.171.14.70:4027 , piece_id=7YO3ZAQFFZOSWSG2JH3KOHWDEFQJLOCCQ5FUGSIT7UUREHROOGYA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.587122821 (21h51m33.48083146s) [noise=true , address=81.171.14.70:4038 , piece_id=VAUCLB55KGVJVL4BSWY4ZY2747BDYFXI2RK3JMPDO4ZOCVOT43EA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.679729699 (21h51m33.573438309s) [noise=true , address=89.149.201.147:4012 , piece_id=SPAZ2DY75JXHC2PWPRI3QG7HYCGHM4GVXN5DY5ZWYDTM6637EV7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:36.775377568 (21h51m33.669086177s) [noise=true , address=89.149.201.147:4010 , piece_id=WBP6VM7X2ZISV4K4SE6LL3ZSPYHJQK24IOGILVH6S2ZLWRRJVN7Q, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.160795473 (21h51m34.054504082s) [noise=true , address=89.149.201.147:4023 , piece_id=LQXOUV6UVIHCQTXPVMC7NYINBLEZWF4H7W6BSOWGK6BFG5ARQ3VQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:47:37.251044932 (21h51m34.144753541s) [noise=true , address=89.149.201.147:4007 , piece_id=J4W7LHO6YZCI3KPZ3F3DN6P4EAV5RIMRQ2X7ZOKLAAQVNGD7HVMA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: <nil> Jan 16 13:48:34.164143586 (21h52m31.057852195s) [noise=true , address=89.149.201.147:4011 , piece_id=TFRZQWAVN2NUSEWM4L33PKZKUYWQYCV3KCRHTKVTABLDZ7GSVVSQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 188.166.225.170:48732->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 16 13:48:34.164198381 (21h52m31.05790699s) [noise=true , address=89.149.201.147:4020 , piece_id=CQAAHSLJFZE4GHOKB5UO7A2ANJ6N4HHFZDQ33WV25JF76L7JMMDQ, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: expected piece hash; context deadline exceeded; EOF Jan 16 13:48:34.164358165 (21h52m31.058066774s) [noise=true , address=89.149.201.147:4014 , piece_id=BNGVISOX55CNKPIHIJJCXFNIMGW5FCE6GWEY4QKLIAWMVYMRAYFA, seg_pos={0 0}, upload=19196]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: context deadline exceeded; context deadline exceeded Jan 16 13:48:34.164382872 (21h52m31.058091481s) [seg_pos={0 0}, upload=19196]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Jan 16 13:48:34.330174768 (21h52m31.223883387s) [upload=19196]: Done uploading segments... Jan 16 13:48:34.330206869 (21h52m31.223915478s) [upload=19196]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.58153785s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)