Orbiter History

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [...X.X.........] duration: 101.530485ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:12:18 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 101.557657ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.768647989s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:11:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.768683066s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................................X..........X............] duration: 3.40012125s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:11:30 UTC) orbiter warning: context deadline exceeded Duration: 3.400159463s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [....X.X........] duration: 82.894128ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:11:22 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 82.922371ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.874289786s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:11:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.874341133s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [.....X.X.......] duration: 96.954952ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:10:51 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 96.986223ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.899512326s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:10:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.899542424s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................................X..........X...........] duration: 3.423995432s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:10:18 UTC) orbiter warning: context deadline exceeded Duration: 3.424023716s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.027682443s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:10:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 6.02782804s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [......X.X......] duration: 85.25327ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:09:57 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 85.273008ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................................X..........X..........] duration: 3.442430185s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:09:40 UTC) orbiter warning: context deadline exceeded Duration: 3.442464199s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.636439887s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:09:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.636479041s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................................X..........X.........] duration: 3.522493209s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:08:56 UTC) orbiter warning: context deadline exceeded Duration: 3.522546119s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [.......X.X.....] duration: 72.60288ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:08:54 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 72.655251ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................................X..........X........] duration: 3.742657578s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:08:40 UTC) orbiter warning: context deadline exceeded Duration: 3.742688117s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 8.939861761s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:08:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 8.939912588s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [........X.X....] duration: 83.970146ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:08:14 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 83.999934ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................................X..........X.......] duration: 3.351736824s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:07:28 UTC) orbiter warning: context deadline exceeded Duration: 3.35176699s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 4.745542464s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:07:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.745575927s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................................X..........X......] duration: 3.415432067s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:07:10 UTC) orbiter warning: context deadline exceeded Duration: 3.415467155s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [.........X.X...] duration: 149.737853ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:07:03 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 149.776476ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.843862773s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:06:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.843908019s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.409908922s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:06:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.40993398s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [..........X.X..] duration: 109.012885ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:06:04 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 109.041769ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................................X..........X.....] duration: 3.790614549s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:06:00 UTC) orbiter warning: context deadline exceeded Duration: 3.790681306s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................................X..........X....] duration: 3.35859167s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:05:41 UTC) orbiter warning: context deadline exceeded Duration: 3.358621827s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [...........X.X.] duration: 122.961695ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:05:38 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 122.992864ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.819753601s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:04:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.819807615s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............................................X..........X...] duration: 3.421560775s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:04:38 UTC) orbiter warning: context deadline exceeded Duration: 3.421590281s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 2 out of 15 is failed (threshold=6) [............X.X] duration: 228.21554ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/ad5f9081cf270b2 FAIL (2025-11-07 13:04:37 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:43574->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 228.233704ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............................................X..........X..] duration: 3.389980567s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:04:14 UTC) orbiter warning: context deadline exceeded Duration: 3.390013591s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.364696317s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:03:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.364736534s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................................X..........X.] duration: 3.406474236s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:03:47 UTC) orbiter warning: context deadline exceeded Duration: 3.406495498s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.462953474s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:03:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.462990004s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 91.998565ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/1b66b36114179a00 FAIL (2025-11-07 13:03:26 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:37750->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 92.029334ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 653.741011ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/1b66b36114179a00 FAIL (2025-11-07 13:02:42 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:37750->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 653.770197ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 11.49396887s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:02:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 11.4940007s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................................X..........X] duration: 5.000977077s trace: https://jaeger.dev.storj.io/trace/20326ce8f3151a55 FAIL (2025-11-07 13:02:38 UTC) orbiter warning: context deadline exceeded Duration: 5.001004619s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 8.767830033s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:02:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 8.767866303s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................................X..........] duration: 3.521957262s trace: https://jaeger.dev.storj.io/trace/4a4e55bff7946473 FAIL (2025-11-07 13:02:00 UTC) orbiter warning: context deadline exceeded Duration: 3.521991857s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 3.426175381s trace: https://jaeger.dev.storj.io/trace/4a4e55bff7946473 FAIL (2025-11-07 13:01:42 UTC) orbiter warning: context deadline exceeded Duration: 3.426204697s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.367879771s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:01:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.36791565s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 3.471297607s trace: https://jaeger.dev.storj.io/trace/4a4e55bff7946473 FAIL (2025-11-07 13:01:06 UTC) orbiter warning: context deadline exceeded Duration: 3.471347973s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.354105515s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 13:00:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.354138327s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 3.813365388s trace: https://jaeger.dev.storj.io/trace/4a4e55bff7946473 FAIL (2025-11-07 13:00:18 UTC) orbiter warning: context deadline exceeded Duration: 3.813399423s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 3.428975803s trace: https://jaeger.dev.storj.io/trace/4a4e55bff7946473 FAIL (2025-11-07 12:59:57 UTC) orbiter warning: context deadline exceeded Duration: 3.428998064s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [X...................................X.......................] duration: 5.912823679s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 12:59:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.912855539s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 3.854518687s trace: https://jaeger.dev.storj.io/trace/4a4e55bff7946473 FAIL (2025-11-07 12:59:35 UTC) orbiter warning: context deadline exceeded Duration: 3.85464037s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 3.413220805s trace: https://jaeger.dev.storj.io/trace/4a4e55bff7946473 FAIL (2025-11-07 12:58:35 UTC) orbiter warning: context deadline exceeded Duration: 3.413275639s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.X...................................X......................] duration: 4.808864575s trace: https://jaeger.dev.storj.io/trace/525286543fa3ba91 FAIL (2025-11-07 12:58:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== :38.178305861 (192h57m9.874154614s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.178736631 (192h57m9.874585384s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179009922 (192h57m9.874858675s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179196807 (192h57m9.87504557s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179532517 (192h57m9.87538126s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.179619983 (192h57m9.875468726s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180075770 (192h57m9.875924514s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.180093074 (192h57m9.875941827s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.181714923 (192h57m9.877563676s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182276191 (192h57m9.878124944s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.182768168 (192h57m9.878616921s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:38.183246669 (192h57m9.879095422s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Uploading piece... Nov 7 12:37:39.023314018 (192h57m10.719162771s) [upload=170064]: Next returned nil segment Nov 7 12:37:39.023331120 (192h57m10.719179863s) [upload=170064]: Waiting for error group managing segments... Nov 7 12:37:39.404128431 (192h57m11.099977174s) [noise=true , address=81.171.14.70:4032 , piece_id=7NB7BM62JGOHT2ARYQDJZUF67JD7MI6MNEOHR3HMXF6JNFX5KMHQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.409942001 (192h57m11.105790754s) [noise=true , address=81.171.14.70:4045 , piece_id=NCMDOVSYSB46SJYIZ4KS6KN3PQOBBBNKSA53SFWNLLSIFOCJODSQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.418704757 (192h57m11.11455351s) [noise=true , address=81.171.14.70:4047 , piece_id=YHF43Z277LUAXFU57LPF2AG7E5CJYA3YS7EYQ2L3OKUYGV5CA6HA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.422401115 (192h57m11.118249858s) [noise=true , address=81.171.14.70:4033 , piece_id=L6FOGNSLT3QCQD2S2XFBMYTCKBK54A27SFWXEHFNY4KEOZJ663GQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.430155803 (192h57m11.126004546s) [noise=true , address=81.171.14.70:4043 , piece_id=KMPNXQWRIAWQNSYLFRUSDXYYFDWODCNHCZT3M3F3PAGSPVLYIQWA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.432969751 (192h57m11.128818504s) [noise=true , address=81.171.14.70:4035 , piece_id=WKEY3O2VEILUSQOPWLVWUVWTJ5P2FRHFYB3ISJ4CHBRU2PJ4SICQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.456047847 (192h57m11.15189659s) [noise=true , address=89.149.201.147:4006 , piece_id=LASG5H4RJOMUSRW5JLP2VAFTR2Q5Q6WTN5VX5ZH7ZMP35FJFO3LQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.472003520 (192h57m11.167852263s) [noise=true , address=89.149.201.147:4022 , piece_id=O6H2LWVFT7Z6C32QBYT6I3U2BSO5FPPNKJBIKI4TIQZDPTGYLBIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.476240688 (192h57m11.172089442s) [noise=true , address=81.171.14.70:4025 , piece_id=DMUPNB3KVCEVXDDAC42EXY64FAMXEDHCJ7UQ7GXNPMUCTLECIW2A, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.478983470 (192h57m11.174832224s) [noise=true , address=89.149.201.147:4014 , piece_id=A2TBT5YYOEHVDACEULYYDL5E45BBQNFWW4DNQ5KL6XST2H7PKIUA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.490828646 (192h57m11.186677399s) [noise=true , address=89.149.201.147:4004 , piece_id=QJJJNPFD7OK6RNQ4CDVZTULIFNQRUUIMWFN6J6KLYGWPAT2ZX6KQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.499318544 (192h57m11.195167297s) [noise=true , address=81.171.14.70:4044 , piece_id=APHYF67EBVHOUPTQVVRW63TS7DH6GTEQ26KGDECFXXFK5JT2TAGQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.504596154 (192h57m11.200444907s) [noise=true , address=81.171.14.70:4041 , piece_id=B7GD6R6PI7XLRAEMQKLR7NX4URDWMSZSO73NP5PR3MUFLNIWJ3FA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.506012901 (192h57m11.201861654s) [noise=true , address=89.149.201.147:4017 , piece_id=2UZMLY6A7EEOSY4J56C42Q7ASS5KL2RBXQMQGJ7CQ75WXX5VGDAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.519940763 (192h57m11.215789516s) [noise=true , address=89.149.201.147:4012 , piece_id=J7DGFVN7CHOJLDXPOVIOO6H7CCA2NL4GK27TJ5PDQE55N2GXVXFA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:39.539468408 (192h57m11.235317161s) [noise=true , address=89.149.201.147:4019 , piece_id=XTUSCMFNBLMA7H6Y4POVFDW2ELUBFID4QDQI3WYB5NMWAKZWFKUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.677137395 (192h57m12.372986138s) [noise=true , address=185.167.204.206:4049 , piece_id=PCPF6CVHCQ5TQGOTVCG5DYYSIPHPLOM6XSGBFMYSK2PWT4ZKZAPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.716386644 (192h57m12.412235397s) [noise=true , address=185.167.204.206:4043 , piece_id=4AUKA5I7C3CX5U2DRQNT22B7WVJMVSUUWND2HH3TWJPVOZAXSZIQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.724698241 (192h57m12.420546994s) [noise=true , address=185.167.204.205:4020 , piece_id=GGNBFXSOV6GPN5RWDZPZROGFVG5EVMKRWDV5R4CVFCH7M2TBKTNA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.726222003 (192h57m12.422070756s) [noise=true , address=185.167.204.205:4021 , piece_id=LN36HFHPK7AY4B7OYXXSY7JSIW44HLTWR6DOY6OLXR4UME3JHSUQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.727072272 (192h57m12.422921025s) [noise=true , address=185.167.204.205:4032 , piece_id=U7WR7H27PEEVZNN6LATWIKLS5CP5VMJQPW7MVSCRUNRUNFXZRUPQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.735998038 (192h57m12.431846791s) [noise=true , address=185.167.204.205:4023 , piece_id=WSCRJDWKTI2JMLXUVJ7IMTLVXMFGRNCMPWE3U6AVC2J7YS6DEWQQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.788867884 (192h57m12.484716637s) [noise=true , address=185.167.204.206:4052 , piece_id=6TSU5KB4YAQURVO4YEB2OTDHLKJXRBILUVGJSGU4TLRQT7USOPDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.815570602 (192h57m12.511419355s) [noise=true , address=185.167.204.206:4069 , piece_id=CZXHOYZZVBMOUUNDGZBJXHSTTKCGCHEQAQLDOU62JHU3MF4C2JDQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:37:40.833876541 (192h57m12.529725294s) [noise=true , address=185.167.204.205:4033 , piece_id=76TW5MSJ7BNVHNO4OU6ZRAU7OS4NW6QDXQJQ65AVRH45IZ6Q5K3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: <nil> Nov 7 12:38:37.518121189 (192h58m9.213969952s) [noise=true , address=185.167.204.206:4058 , piece_id=QK66LQRH4EM2H5F43KWQITUDXKCZPUS56OUU27BAX755X3LEAV3Q, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:34970->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518260674 (192h58m9.214109427s) [noise=true , address=185.167.204.205:4034 , piece_id=YYHZDPOEDZIOK6ZCEEPZ24YOFLW6FYCUN62SVYBPIQ5RXPV4WRAA, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:50202->185.167.204.205:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518314648 (192h58m9.214163411s) [noise=true , address=185.167.204.206:4059 , piece_id=CRY5PQKDBMVW2WZ7MW2STHP5GBXWATIC4WSQ6H43Z3JIMXFBEIWQ, seg_pos={0 0}, upload=170064]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:38:37.518497015 (192h58m9.214345768s) [seg_pos={0 0}, upload=170064]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 7 12:38:37.690636996 (192h58m9.386485749s) [upload=170064]: Done uploading segments... Nov 7 12:38:37.690688734 (192h58m9.386537487s) [upload=170064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 4.808896836s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)