Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.797225069s trace: https://jaeger.dev.storj.io/trace/5860d9055b13d3d5 FAIL (2025-11-21 02:31:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 02:25:33.629924468 (282h21m32.181394939s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630349578 (282h21m32.181820039s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630843158 (282h21m32.182313619s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.631501040 (282h21m32.182971502s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.632877661 (282h21m32.184348112s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.633957257 (282h21m32.185427718s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635008760 (282h21m32.186479221s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635936546 (282h21m32.187407007s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.636636048 (282h21m32.188106509s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:34.461042315 (282h21m33.012512776s) [upload=248651]: Next returned nil segment Nov 21 02:25:34.461079235 (282h21m33.012549697s) [upload=248651]: Waiting for error group managing segments... Nov 21 02:25:34.850359259 (282h21m33.40182972s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.852076179 (282h21m33.40354664s) [noise=true , address=185.167.204.206:4055 , piece_id=H54UI2MK43VZPELPTCU6XNLESYE6S5XZ4ZKAOV66TP3BBKKKDMFA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.856988012 (282h21m33.408458473s) [noise=true , address=185.167.204.205:4031 , piece_id=MCKJTCBSRINYPN27XNNFMXYPDHE3KVMSCWOB7VCOETNIO4F3PZVQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858141178 (282h21m33.409611639s) [noise=true , address=185.167.204.206:4067 , piece_id=TQD5JG4TGZYKCG4KOAWEUF6BSVY2IX35O2IB6VYKKH7ABNQEMRRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858405160 (282h21m33.409875621s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858612054 (282h21m33.410082515s) [noise=true , address=185.167.204.205:4023 , piece_id=NQMCNM7GAS2URY7JNN4DXMU2FZ7UAVHC42U55IVIGYUWXZ5DFOCQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859019680 (282h21m33.410490131s) [noise=true , address=185.167.204.205:4013 , piece_id=G5AFIVUYYIG3IAVQ2UN4MTL3NPXN326IOR77CXTU4BAIBFMICKXQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859464347 (282h21m33.410934808s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859565901 (282h21m33.411036352s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866136853 (282h21m33.417607324s) [noise=true , address=185.167.204.205:4027 , piece_id=DTF2OMEXXT2XFQB2RQOKL66K4AOIC3DTZOTE2ZGIMYWVPCTKJWJA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866678734 (282h21m33.418149195s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867348910 (282h21m33.418819361s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867982197 (282h21m33.419452668s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.868482399 (282h21m33.41995286s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.880010110 (282h21m33.431480601s) [noise=true , address=185.167.204.205:4025 , piece_id=ZWXX3V2QD4QSVDNMMDJ5GSSLIMSAK5IZOHOEB2SI3TFMPUXRRVXA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.419467556 (282h21m33.970938017s) [noise=true , address=81.171.14.70:4044 , piece_id=WAQ3SBHX6TRISFEOPE4Y6O2HSE2NYVC257V6ROMZSFVJO7YLCGRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.424133200 (282h21m33.975603661s) [noise=true , address=81.171.14.70:4038 , piece_id=X67ZAHX3AIYBBWES2PL5TB6FKR3DGZBALSLTITODERBWUI2OILVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.433560922 (282h21m33.985031383s) [noise=true , address=81.171.14.70:4041 , piece_id=AAUJYA6S7AWTCUO33QBNLCFUKRLGY6NLGFHRECJ5I63H53J46SMQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.452011215 (282h21m34.003481676s) [noise=true , address=81.171.14.70:4047 , piece_id=ZNKZHAJAP24ZF6ZBV6762YY7LCRUSQCCL5E53WU5TMZ457CRZ3RA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.508011640 (282h21m34.059482111s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.897112773 (282h21m34.448583234s) [noise=true , address=81.171.14.70:4031 , piece_id=LYWET76RCJLTUN3DJDSVMDOZ6X5S53KPZ264P7D5FS7XCRDSYIQA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.027285292 (282h21m34.578755743s) [noise=true , address=81.171.14.70:4045 , piece_id=EOJUCJVNYJIF447J6FKIRVIXM3IJ5OU6TEVUKHFKQCUUVIMBR2EA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.070911284 (282h21m34.622381745s) [noise=true , address=89.149.201.147:4011 , piece_id=F5544PH4I4Z224P2DVMAXLM57DWIFT37KKXUJBR7B3OG5FV7KK6A, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.073062550 (282h21m34.624533011s) [noise=true , address=89.149.201.147:4018 , piece_id=LPC2AQ7TX4UUEI4I5VMGDOIFJI7R3GJGAOL5Q2O7SVY42OFN3XVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.083744591 (282h21m34.635215052s) [noise=true , address=89.149.201.147:4008 , piece_id=GSCXEJOMPWFECP7YSD66BRY26ZTXGIRZIMZYWKIW2SLRGPSJT7OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.146992305 (282h21m34.698462766s) [noise=true , address=89.149.201.147:4003 , piece_id=SDOIACESWFHPNPOZUZIXW5F2K62OUKCLCBHUKD4YKPLUQG4XXE5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.147018144 (282h21m34.698488605s) [seg_pos={0 0}, upload=248651]: Segment reached optimal threshold of 26 pieces. Nov 21 02:25:36.147392256 (282h21m34.698862717s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Nov 21 02:25:36.147403267 (282h21m34.698873728s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148140441 (282h21m34.699610933s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection Nov 21 02:25:36.148153566 (282h21m34.699624027s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148213310 (282h21m34.699683761s) [seg_pos={0 0}, upload=248651]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 21 02:25:36.148357414 (282h21m34.699827875s) [upload=248651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 02:25:36.148395076 (282h21m34.699865547s) [upload=248651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 02:25:36.406626090 (282h21m34.958096551s) [upload=248651]: Done uploading segments... Nov 21 02:25:36.406651539 (282h21m34.958122s) [upload=248651]: Upload finished. err: <nil> Duration: 5.797254044s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.761927847s trace: https://jaeger.dev.storj.io/trace/5860d9055b13d3d5 FAIL (2025-11-21 02:30:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 02:25:33.629924468 (282h21m32.181394939s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630349578 (282h21m32.181820039s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630843158 (282h21m32.182313619s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.631501040 (282h21m32.182971502s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.632877661 (282h21m32.184348112s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.633957257 (282h21m32.185427718s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635008760 (282h21m32.186479221s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635936546 (282h21m32.187407007s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.636636048 (282h21m32.188106509s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:34.461042315 (282h21m33.012512776s) [upload=248651]: Next returned nil segment Nov 21 02:25:34.461079235 (282h21m33.012549697s) [upload=248651]: Waiting for error group managing segments... Nov 21 02:25:34.850359259 (282h21m33.40182972s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.852076179 (282h21m33.40354664s) [noise=true , address=185.167.204.206:4055 , piece_id=H54UI2MK43VZPELPTCU6XNLESYE6S5XZ4ZKAOV66TP3BBKKKDMFA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.856988012 (282h21m33.408458473s) [noise=true , address=185.167.204.205:4031 , piece_id=MCKJTCBSRINYPN27XNNFMXYPDHE3KVMSCWOB7VCOETNIO4F3PZVQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858141178 (282h21m33.409611639s) [noise=true , address=185.167.204.206:4067 , piece_id=TQD5JG4TGZYKCG4KOAWEUF6BSVY2IX35O2IB6VYKKH7ABNQEMRRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858405160 (282h21m33.409875621s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858612054 (282h21m33.410082515s) [noise=true , address=185.167.204.205:4023 , piece_id=NQMCNM7GAS2URY7JNN4DXMU2FZ7UAVHC42U55IVIGYUWXZ5DFOCQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859019680 (282h21m33.410490131s) [noise=true , address=185.167.204.205:4013 , piece_id=G5AFIVUYYIG3IAVQ2UN4MTL3NPXN326IOR77CXTU4BAIBFMICKXQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859464347 (282h21m33.410934808s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859565901 (282h21m33.411036352s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866136853 (282h21m33.417607324s) [noise=true , address=185.167.204.205:4027 , piece_id=DTF2OMEXXT2XFQB2RQOKL66K4AOIC3DTZOTE2ZGIMYWVPCTKJWJA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866678734 (282h21m33.418149195s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867348910 (282h21m33.418819361s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867982197 (282h21m33.419452668s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.868482399 (282h21m33.41995286s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.880010110 (282h21m33.431480601s) [noise=true , address=185.167.204.205:4025 , piece_id=ZWXX3V2QD4QSVDNMMDJ5GSSLIMSAK5IZOHOEB2SI3TFMPUXRRVXA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.419467556 (282h21m33.970938017s) [noise=true , address=81.171.14.70:4044 , piece_id=WAQ3SBHX6TRISFEOPE4Y6O2HSE2NYVC257V6ROMZSFVJO7YLCGRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.424133200 (282h21m33.975603661s) [noise=true , address=81.171.14.70:4038 , piece_id=X67ZAHX3AIYBBWES2PL5TB6FKR3DGZBALSLTITODERBWUI2OILVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.433560922 (282h21m33.985031383s) [noise=true , address=81.171.14.70:4041 , piece_id=AAUJYA6S7AWTCUO33QBNLCFUKRLGY6NLGFHRECJ5I63H53J46SMQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.452011215 (282h21m34.003481676s) [noise=true , address=81.171.14.70:4047 , piece_id=ZNKZHAJAP24ZF6ZBV6762YY7LCRUSQCCL5E53WU5TMZ457CRZ3RA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.508011640 (282h21m34.059482111s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.897112773 (282h21m34.448583234s) [noise=true , address=81.171.14.70:4031 , piece_id=LYWET76RCJLTUN3DJDSVMDOZ6X5S53KPZ264P7D5FS7XCRDSYIQA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.027285292 (282h21m34.578755743s) [noise=true , address=81.171.14.70:4045 , piece_id=EOJUCJVNYJIF447J6FKIRVIXM3IJ5OU6TEVUKHFKQCUUVIMBR2EA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.070911284 (282h21m34.622381745s) [noise=true , address=89.149.201.147:4011 , piece_id=F5544PH4I4Z224P2DVMAXLM57DWIFT37KKXUJBR7B3OG5FV7KK6A, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.073062550 (282h21m34.624533011s) [noise=true , address=89.149.201.147:4018 , piece_id=LPC2AQ7TX4UUEI4I5VMGDOIFJI7R3GJGAOL5Q2O7SVY42OFN3XVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.083744591 (282h21m34.635215052s) [noise=true , address=89.149.201.147:4008 , piece_id=GSCXEJOMPWFECP7YSD66BRY26ZTXGIRZIMZYWKIW2SLRGPSJT7OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.146992305 (282h21m34.698462766s) [noise=true , address=89.149.201.147:4003 , piece_id=SDOIACESWFHPNPOZUZIXW5F2K62OUKCLCBHUKD4YKPLUQG4XXE5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.147018144 (282h21m34.698488605s) [seg_pos={0 0}, upload=248651]: Segment reached optimal threshold of 26 pieces. Nov 21 02:25:36.147392256 (282h21m34.698862717s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Nov 21 02:25:36.147403267 (282h21m34.698873728s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148140441 (282h21m34.699610933s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection Nov 21 02:25:36.148153566 (282h21m34.699624027s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148213310 (282h21m34.699683761s) [seg_pos={0 0}, upload=248651]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 21 02:25:36.148357414 (282h21m34.699827875s) [upload=248651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 02:25:36.148395076 (282h21m34.699865547s) [upload=248651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 02:25:36.406626090 (282h21m34.958096551s) [upload=248651]: Done uploading segments... Nov 21 02:25:36.406651539 (282h21m34.958122s) [upload=248651]: Upload finished. err: <nil> Duration: 5.762053456s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.686798378s trace: https://jaeger.dev.storj.io/trace/5860d9055b13d3d5 FAIL (2025-11-21 02:29:38 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 02:25:33.629924468 (282h21m32.181394939s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630349578 (282h21m32.181820039s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630843158 (282h21m32.182313619s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.631501040 (282h21m32.182971502s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.632877661 (282h21m32.184348112s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.633957257 (282h21m32.185427718s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635008760 (282h21m32.186479221s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635936546 (282h21m32.187407007s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.636636048 (282h21m32.188106509s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:34.461042315 (282h21m33.012512776s) [upload=248651]: Next returned nil segment Nov 21 02:25:34.461079235 (282h21m33.012549697s) [upload=248651]: Waiting for error group managing segments... Nov 21 02:25:34.850359259 (282h21m33.40182972s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.852076179 (282h21m33.40354664s) [noise=true , address=185.167.204.206:4055 , piece_id=H54UI2MK43VZPELPTCU6XNLESYE6S5XZ4ZKAOV66TP3BBKKKDMFA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.856988012 (282h21m33.408458473s) [noise=true , address=185.167.204.205:4031 , piece_id=MCKJTCBSRINYPN27XNNFMXYPDHE3KVMSCWOB7VCOETNIO4F3PZVQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858141178 (282h21m33.409611639s) [noise=true , address=185.167.204.206:4067 , piece_id=TQD5JG4TGZYKCG4KOAWEUF6BSVY2IX35O2IB6VYKKH7ABNQEMRRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858405160 (282h21m33.409875621s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858612054 (282h21m33.410082515s) [noise=true , address=185.167.204.205:4023 , piece_id=NQMCNM7GAS2URY7JNN4DXMU2FZ7UAVHC42U55IVIGYUWXZ5DFOCQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859019680 (282h21m33.410490131s) [noise=true , address=185.167.204.205:4013 , piece_id=G5AFIVUYYIG3IAVQ2UN4MTL3NPXN326IOR77CXTU4BAIBFMICKXQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859464347 (282h21m33.410934808s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859565901 (282h21m33.411036352s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866136853 (282h21m33.417607324s) [noise=true , address=185.167.204.205:4027 , piece_id=DTF2OMEXXT2XFQB2RQOKL66K4AOIC3DTZOTE2ZGIMYWVPCTKJWJA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866678734 (282h21m33.418149195s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867348910 (282h21m33.418819361s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867982197 (282h21m33.419452668s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.868482399 (282h21m33.41995286s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.880010110 (282h21m33.431480601s) [noise=true , address=185.167.204.205:4025 , piece_id=ZWXX3V2QD4QSVDNMMDJ5GSSLIMSAK5IZOHOEB2SI3TFMPUXRRVXA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.419467556 (282h21m33.970938017s) [noise=true , address=81.171.14.70:4044 , piece_id=WAQ3SBHX6TRISFEOPE4Y6O2HSE2NYVC257V6ROMZSFVJO7YLCGRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.424133200 (282h21m33.975603661s) [noise=true , address=81.171.14.70:4038 , piece_id=X67ZAHX3AIYBBWES2PL5TB6FKR3DGZBALSLTITODERBWUI2OILVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.433560922 (282h21m33.985031383s) [noise=true , address=81.171.14.70:4041 , piece_id=AAUJYA6S7AWTCUO33QBNLCFUKRLGY6NLGFHRECJ5I63H53J46SMQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.452011215 (282h21m34.003481676s) [noise=true , address=81.171.14.70:4047 , piece_id=ZNKZHAJAP24ZF6ZBV6762YY7LCRUSQCCL5E53WU5TMZ457CRZ3RA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.508011640 (282h21m34.059482111s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.897112773 (282h21m34.448583234s) [noise=true , address=81.171.14.70:4031 , piece_id=LYWET76RCJLTUN3DJDSVMDOZ6X5S53KPZ264P7D5FS7XCRDSYIQA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.027285292 (282h21m34.578755743s) [noise=true , address=81.171.14.70:4045 , piece_id=EOJUCJVNYJIF447J6FKIRVIXM3IJ5OU6TEVUKHFKQCUUVIMBR2EA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.070911284 (282h21m34.622381745s) [noise=true , address=89.149.201.147:4011 , piece_id=F5544PH4I4Z224P2DVMAXLM57DWIFT37KKXUJBR7B3OG5FV7KK6A, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.073062550 (282h21m34.624533011s) [noise=true , address=89.149.201.147:4018 , piece_id=LPC2AQ7TX4UUEI4I5VMGDOIFJI7R3GJGAOL5Q2O7SVY42OFN3XVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.083744591 (282h21m34.635215052s) [noise=true , address=89.149.201.147:4008 , piece_id=GSCXEJOMPWFECP7YSD66BRY26ZTXGIRZIMZYWKIW2SLRGPSJT7OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.146992305 (282h21m34.698462766s) [noise=true , address=89.149.201.147:4003 , piece_id=SDOIACESWFHPNPOZUZIXW5F2K62OUKCLCBHUKD4YKPLUQG4XXE5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.147018144 (282h21m34.698488605s) [seg_pos={0 0}, upload=248651]: Segment reached optimal threshold of 26 pieces. Nov 21 02:25:36.147392256 (282h21m34.698862717s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Nov 21 02:25:36.147403267 (282h21m34.698873728s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148140441 (282h21m34.699610933s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection Nov 21 02:25:36.148153566 (282h21m34.699624027s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148213310 (282h21m34.699683761s) [seg_pos={0 0}, upload=248651]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 21 02:25:36.148357414 (282h21m34.699827875s) [upload=248651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 02:25:36.148395076 (282h21m34.699865547s) [upload=248651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 02:25:36.406626090 (282h21m34.958096551s) [upload=248651]: Done uploading segments... Nov 21 02:25:36.406651539 (282h21m34.958122s) [upload=248651]: Upload finished. err: <nil> Duration: 5.686830338s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.265064416s trace: https://jaeger.dev.storj.io/trace/5860d9055b13d3d5 FAIL (2025-11-21 02:28:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 02:25:33.629924468 (282h21m32.181394939s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630349578 (282h21m32.181820039s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630843158 (282h21m32.182313619s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.631501040 (282h21m32.182971502s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.632877661 (282h21m32.184348112s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.633957257 (282h21m32.185427718s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635008760 (282h21m32.186479221s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635936546 (282h21m32.187407007s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.636636048 (282h21m32.188106509s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:34.461042315 (282h21m33.012512776s) [upload=248651]: Next returned nil segment Nov 21 02:25:34.461079235 (282h21m33.012549697s) [upload=248651]: Waiting for error group managing segments... Nov 21 02:25:34.850359259 (282h21m33.40182972s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.852076179 (282h21m33.40354664s) [noise=true , address=185.167.204.206:4055 , piece_id=H54UI2MK43VZPELPTCU6XNLESYE6S5XZ4ZKAOV66TP3BBKKKDMFA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.856988012 (282h21m33.408458473s) [noise=true , address=185.167.204.205:4031 , piece_id=MCKJTCBSRINYPN27XNNFMXYPDHE3KVMSCWOB7VCOETNIO4F3PZVQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858141178 (282h21m33.409611639s) [noise=true , address=185.167.204.206:4067 , piece_id=TQD5JG4TGZYKCG4KOAWEUF6BSVY2IX35O2IB6VYKKH7ABNQEMRRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858405160 (282h21m33.409875621s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858612054 (282h21m33.410082515s) [noise=true , address=185.167.204.205:4023 , piece_id=NQMCNM7GAS2URY7JNN4DXMU2FZ7UAVHC42U55IVIGYUWXZ5DFOCQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859019680 (282h21m33.410490131s) [noise=true , address=185.167.204.205:4013 , piece_id=G5AFIVUYYIG3IAVQ2UN4MTL3NPXN326IOR77CXTU4BAIBFMICKXQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859464347 (282h21m33.410934808s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859565901 (282h21m33.411036352s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866136853 (282h21m33.417607324s) [noise=true , address=185.167.204.205:4027 , piece_id=DTF2OMEXXT2XFQB2RQOKL66K4AOIC3DTZOTE2ZGIMYWVPCTKJWJA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866678734 (282h21m33.418149195s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867348910 (282h21m33.418819361s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867982197 (282h21m33.419452668s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.868482399 (282h21m33.41995286s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.880010110 (282h21m33.431480601s) [noise=true , address=185.167.204.205:4025 , piece_id=ZWXX3V2QD4QSVDNMMDJ5GSSLIMSAK5IZOHOEB2SI3TFMPUXRRVXA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.419467556 (282h21m33.970938017s) [noise=true , address=81.171.14.70:4044 , piece_id=WAQ3SBHX6TRISFEOPE4Y6O2HSE2NYVC257V6ROMZSFVJO7YLCGRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.424133200 (282h21m33.975603661s) [noise=true , address=81.171.14.70:4038 , piece_id=X67ZAHX3AIYBBWES2PL5TB6FKR3DGZBALSLTITODERBWUI2OILVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.433560922 (282h21m33.985031383s) [noise=true , address=81.171.14.70:4041 , piece_id=AAUJYA6S7AWTCUO33QBNLCFUKRLGY6NLGFHRECJ5I63H53J46SMQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.452011215 (282h21m34.003481676s) [noise=true , address=81.171.14.70:4047 , piece_id=ZNKZHAJAP24ZF6ZBV6762YY7LCRUSQCCL5E53WU5TMZ457CRZ3RA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.508011640 (282h21m34.059482111s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.897112773 (282h21m34.448583234s) [noise=true , address=81.171.14.70:4031 , piece_id=LYWET76RCJLTUN3DJDSVMDOZ6X5S53KPZ264P7D5FS7XCRDSYIQA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.027285292 (282h21m34.578755743s) [noise=true , address=81.171.14.70:4045 , piece_id=EOJUCJVNYJIF447J6FKIRVIXM3IJ5OU6TEVUKHFKQCUUVIMBR2EA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.070911284 (282h21m34.622381745s) [noise=true , address=89.149.201.147:4011 , piece_id=F5544PH4I4Z224P2DVMAXLM57DWIFT37KKXUJBR7B3OG5FV7KK6A, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.073062550 (282h21m34.624533011s) [noise=true , address=89.149.201.147:4018 , piece_id=LPC2AQ7TX4UUEI4I5VMGDOIFJI7R3GJGAOL5Q2O7SVY42OFN3XVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.083744591 (282h21m34.635215052s) [noise=true , address=89.149.201.147:4008 , piece_id=GSCXEJOMPWFECP7YSD66BRY26ZTXGIRZIMZYWKIW2SLRGPSJT7OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.146992305 (282h21m34.698462766s) [noise=true , address=89.149.201.147:4003 , piece_id=SDOIACESWFHPNPOZUZIXW5F2K62OUKCLCBHUKD4YKPLUQG4XXE5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.147018144 (282h21m34.698488605s) [seg_pos={0 0}, upload=248651]: Segment reached optimal threshold of 26 pieces. Nov 21 02:25:36.147392256 (282h21m34.698862717s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Nov 21 02:25:36.147403267 (282h21m34.698873728s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148140441 (282h21m34.699610933s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection Nov 21 02:25:36.148153566 (282h21m34.699624027s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148213310 (282h21m34.699683761s) [seg_pos={0 0}, upload=248651]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 21 02:25:36.148357414 (282h21m34.699827875s) [upload=248651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 02:25:36.148395076 (282h21m34.699865547s) [upload=248651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 02:25:36.406626090 (282h21m34.958096551s) [upload=248651]: Done uploading segments... Nov 21 02:25:36.406651539 (282h21m34.958122s) [upload=248651]: Upload finished. err: <nil> Duration: 6.265096898s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.266845151s trace: https://jaeger.dev.storj.io/trace/5860d9055b13d3d5 FAIL (2025-11-21 02:27:43 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 02:25:33.629924468 (282h21m32.181394939s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630349578 (282h21m32.181820039s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630843158 (282h21m32.182313619s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.631501040 (282h21m32.182971502s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.632877661 (282h21m32.184348112s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.633957257 (282h21m32.185427718s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635008760 (282h21m32.186479221s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635936546 (282h21m32.187407007s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.636636048 (282h21m32.188106509s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:34.461042315 (282h21m33.012512776s) [upload=248651]: Next returned nil segment Nov 21 02:25:34.461079235 (282h21m33.012549697s) [upload=248651]: Waiting for error group managing segments... Nov 21 02:25:34.850359259 (282h21m33.40182972s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.852076179 (282h21m33.40354664s) [noise=true , address=185.167.204.206:4055 , piece_id=H54UI2MK43VZPELPTCU6XNLESYE6S5XZ4ZKAOV66TP3BBKKKDMFA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.856988012 (282h21m33.408458473s) [noise=true , address=185.167.204.205:4031 , piece_id=MCKJTCBSRINYPN27XNNFMXYPDHE3KVMSCWOB7VCOETNIO4F3PZVQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858141178 (282h21m33.409611639s) [noise=true , address=185.167.204.206:4067 , piece_id=TQD5JG4TGZYKCG4KOAWEUF6BSVY2IX35O2IB6VYKKH7ABNQEMRRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858405160 (282h21m33.409875621s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858612054 (282h21m33.410082515s) [noise=true , address=185.167.204.205:4023 , piece_id=NQMCNM7GAS2URY7JNN4DXMU2FZ7UAVHC42U55IVIGYUWXZ5DFOCQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859019680 (282h21m33.410490131s) [noise=true , address=185.167.204.205:4013 , piece_id=G5AFIVUYYIG3IAVQ2UN4MTL3NPXN326IOR77CXTU4BAIBFMICKXQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859464347 (282h21m33.410934808s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859565901 (282h21m33.411036352s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866136853 (282h21m33.417607324s) [noise=true , address=185.167.204.205:4027 , piece_id=DTF2OMEXXT2XFQB2RQOKL66K4AOIC3DTZOTE2ZGIMYWVPCTKJWJA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866678734 (282h21m33.418149195s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867348910 (282h21m33.418819361s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867982197 (282h21m33.419452668s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.868482399 (282h21m33.41995286s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.880010110 (282h21m33.431480601s) [noise=true , address=185.167.204.205:4025 , piece_id=ZWXX3V2QD4QSVDNMMDJ5GSSLIMSAK5IZOHOEB2SI3TFMPUXRRVXA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.419467556 (282h21m33.970938017s) [noise=true , address=81.171.14.70:4044 , piece_id=WAQ3SBHX6TRISFEOPE4Y6O2HSE2NYVC257V6ROMZSFVJO7YLCGRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.424133200 (282h21m33.975603661s) [noise=true , address=81.171.14.70:4038 , piece_id=X67ZAHX3AIYBBWES2PL5TB6FKR3DGZBALSLTITODERBWUI2OILVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.433560922 (282h21m33.985031383s) [noise=true , address=81.171.14.70:4041 , piece_id=AAUJYA6S7AWTCUO33QBNLCFUKRLGY6NLGFHRECJ5I63H53J46SMQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.452011215 (282h21m34.003481676s) [noise=true , address=81.171.14.70:4047 , piece_id=ZNKZHAJAP24ZF6ZBV6762YY7LCRUSQCCL5E53WU5TMZ457CRZ3RA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.508011640 (282h21m34.059482111s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.897112773 (282h21m34.448583234s) [noise=true , address=81.171.14.70:4031 , piece_id=LYWET76RCJLTUN3DJDSVMDOZ6X5S53KPZ264P7D5FS7XCRDSYIQA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.027285292 (282h21m34.578755743s) [noise=true , address=81.171.14.70:4045 , piece_id=EOJUCJVNYJIF447J6FKIRVIXM3IJ5OU6TEVUKHFKQCUUVIMBR2EA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.070911284 (282h21m34.622381745s) [noise=true , address=89.149.201.147:4011 , piece_id=F5544PH4I4Z224P2DVMAXLM57DWIFT37KKXUJBR7B3OG5FV7KK6A, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.073062550 (282h21m34.624533011s) [noise=true , address=89.149.201.147:4018 , piece_id=LPC2AQ7TX4UUEI4I5VMGDOIFJI7R3GJGAOL5Q2O7SVY42OFN3XVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.083744591 (282h21m34.635215052s) [noise=true , address=89.149.201.147:4008 , piece_id=GSCXEJOMPWFECP7YSD66BRY26ZTXGIRZIMZYWKIW2SLRGPSJT7OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.146992305 (282h21m34.698462766s) [noise=true , address=89.149.201.147:4003 , piece_id=SDOIACESWFHPNPOZUZIXW5F2K62OUKCLCBHUKD4YKPLUQG4XXE5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.147018144 (282h21m34.698488605s) [seg_pos={0 0}, upload=248651]: Segment reached optimal threshold of 26 pieces. Nov 21 02:25:36.147392256 (282h21m34.698862717s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Nov 21 02:25:36.147403267 (282h21m34.698873728s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148140441 (282h21m34.699610933s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection Nov 21 02:25:36.148153566 (282h21m34.699624027s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148213310 (282h21m34.699683761s) [seg_pos={0 0}, upload=248651]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 21 02:25:36.148357414 (282h21m34.699827875s) [upload=248651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 02:25:36.148395076 (282h21m34.699865547s) [upload=248651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 02:25:36.406626090 (282h21m34.958096551s) [upload=248651]: Done uploading segments... Nov 21 02:25:36.406651539 (282h21m34.958122s) [upload=248651]: Upload finished. err: <nil> Duration: 5.266882273s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.729282028s trace: https://jaeger.dev.storj.io/trace/5860d9055b13d3d5 FAIL (2025-11-21 02:26:38 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 02:25:33.629924468 (282h21m32.181394939s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630349578 (282h21m32.181820039s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630843158 (282h21m32.182313619s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.631501040 (282h21m32.182971502s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.632877661 (282h21m32.184348112s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.633957257 (282h21m32.185427718s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635008760 (282h21m32.186479221s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635936546 (282h21m32.187407007s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.636636048 (282h21m32.188106509s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:34.461042315 (282h21m33.012512776s) [upload=248651]: Next returned nil segment Nov 21 02:25:34.461079235 (282h21m33.012549697s) [upload=248651]: Waiting for error group managing segments... Nov 21 02:25:34.850359259 (282h21m33.40182972s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.852076179 (282h21m33.40354664s) [noise=true , address=185.167.204.206:4055 , piece_id=H54UI2MK43VZPELPTCU6XNLESYE6S5XZ4ZKAOV66TP3BBKKKDMFA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.856988012 (282h21m33.408458473s) [noise=true , address=185.167.204.205:4031 , piece_id=MCKJTCBSRINYPN27XNNFMXYPDHE3KVMSCWOB7VCOETNIO4F3PZVQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858141178 (282h21m33.409611639s) [noise=true , address=185.167.204.206:4067 , piece_id=TQD5JG4TGZYKCG4KOAWEUF6BSVY2IX35O2IB6VYKKH7ABNQEMRRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858405160 (282h21m33.409875621s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858612054 (282h21m33.410082515s) [noise=true , address=185.167.204.205:4023 , piece_id=NQMCNM7GAS2URY7JNN4DXMU2FZ7UAVHC42U55IVIGYUWXZ5DFOCQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859019680 (282h21m33.410490131s) [noise=true , address=185.167.204.205:4013 , piece_id=G5AFIVUYYIG3IAVQ2UN4MTL3NPXN326IOR77CXTU4BAIBFMICKXQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859464347 (282h21m33.410934808s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859565901 (282h21m33.411036352s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866136853 (282h21m33.417607324s) [noise=true , address=185.167.204.205:4027 , piece_id=DTF2OMEXXT2XFQB2RQOKL66K4AOIC3DTZOTE2ZGIMYWVPCTKJWJA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866678734 (282h21m33.418149195s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867348910 (282h21m33.418819361s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867982197 (282h21m33.419452668s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.868482399 (282h21m33.41995286s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.880010110 (282h21m33.431480601s) [noise=true , address=185.167.204.205:4025 , piece_id=ZWXX3V2QD4QSVDNMMDJ5GSSLIMSAK5IZOHOEB2SI3TFMPUXRRVXA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.419467556 (282h21m33.970938017s) [noise=true , address=81.171.14.70:4044 , piece_id=WAQ3SBHX6TRISFEOPE4Y6O2HSE2NYVC257V6ROMZSFVJO7YLCGRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.424133200 (282h21m33.975603661s) [noise=true , address=81.171.14.70:4038 , piece_id=X67ZAHX3AIYBBWES2PL5TB6FKR3DGZBALSLTITODERBWUI2OILVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.433560922 (282h21m33.985031383s) [noise=true , address=81.171.14.70:4041 , piece_id=AAUJYA6S7AWTCUO33QBNLCFUKRLGY6NLGFHRECJ5I63H53J46SMQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.452011215 (282h21m34.003481676s) [noise=true , address=81.171.14.70:4047 , piece_id=ZNKZHAJAP24ZF6ZBV6762YY7LCRUSQCCL5E53WU5TMZ457CRZ3RA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.508011640 (282h21m34.059482111s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.897112773 (282h21m34.448583234s) [noise=true , address=81.171.14.70:4031 , piece_id=LYWET76RCJLTUN3DJDSVMDOZ6X5S53KPZ264P7D5FS7XCRDSYIQA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.027285292 (282h21m34.578755743s) [noise=true , address=81.171.14.70:4045 , piece_id=EOJUCJVNYJIF447J6FKIRVIXM3IJ5OU6TEVUKHFKQCUUVIMBR2EA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.070911284 (282h21m34.622381745s) [noise=true , address=89.149.201.147:4011 , piece_id=F5544PH4I4Z224P2DVMAXLM57DWIFT37KKXUJBR7B3OG5FV7KK6A, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.073062550 (282h21m34.624533011s) [noise=true , address=89.149.201.147:4018 , piece_id=LPC2AQ7TX4UUEI4I5VMGDOIFJI7R3GJGAOL5Q2O7SVY42OFN3XVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.083744591 (282h21m34.635215052s) [noise=true , address=89.149.201.147:4008 , piece_id=GSCXEJOMPWFECP7YSD66BRY26ZTXGIRZIMZYWKIW2SLRGPSJT7OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.146992305 (282h21m34.698462766s) [noise=true , address=89.149.201.147:4003 , piece_id=SDOIACESWFHPNPOZUZIXW5F2K62OUKCLCBHUKD4YKPLUQG4XXE5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.147018144 (282h21m34.698488605s) [seg_pos={0 0}, upload=248651]: Segment reached optimal threshold of 26 pieces. Nov 21 02:25:36.147392256 (282h21m34.698862717s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Nov 21 02:25:36.147403267 (282h21m34.698873728s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148140441 (282h21m34.699610933s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection Nov 21 02:25:36.148153566 (282h21m34.699624027s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148213310 (282h21m34.699683761s) [seg_pos={0 0}, upload=248651]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 21 02:25:36.148357414 (282h21m34.699827875s) [upload=248651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 02:25:36.148395076 (282h21m34.699865547s) [upload=248651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 02:25:36.406626090 (282h21m34.958096551s) [upload=248651]: Done uploading segments... Nov 21 02:25:36.406651539 (282h21m34.958122s) [upload=248651]: Upload finished. err: <nil> Duration: 5.729303258s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.003939426s trace: https://jaeger.dev.storj.io/trace/5860d9055b13d3d5 FAIL (2025-11-21 02:26:32 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 02:25:33.629924468 (282h21m32.181394939s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630349578 (282h21m32.181820039s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.630843158 (282h21m32.182313619s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.631501040 (282h21m32.182971502s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.632877661 (282h21m32.184348112s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.633957257 (282h21m32.185427718s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635008760 (282h21m32.186479221s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.635936546 (282h21m32.187407007s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:33.636636048 (282h21m32.188106509s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Uploading piece... Nov 21 02:25:34.461042315 (282h21m33.012512776s) [upload=248651]: Next returned nil segment Nov 21 02:25:34.461079235 (282h21m33.012549697s) [upload=248651]: Waiting for error group managing segments... Nov 21 02:25:34.850359259 (282h21m33.40182972s) [noise=true , address=185.167.204.206:4056 , piece_id=WP4BU4B4BJKASBDB7R7CB4IVBIP7NVRIHAOTZ2LWPG3XHMMC65TA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.852076179 (282h21m33.40354664s) [noise=true , address=185.167.204.206:4055 , piece_id=H54UI2MK43VZPELPTCU6XNLESYE6S5XZ4ZKAOV66TP3BBKKKDMFA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.856988012 (282h21m33.408458473s) [noise=true , address=185.167.204.205:4031 , piece_id=MCKJTCBSRINYPN27XNNFMXYPDHE3KVMSCWOB7VCOETNIO4F3PZVQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858141178 (282h21m33.409611639s) [noise=true , address=185.167.204.206:4067 , piece_id=TQD5JG4TGZYKCG4KOAWEUF6BSVY2IX35O2IB6VYKKH7ABNQEMRRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858405160 (282h21m33.409875621s) [noise=true , address=185.167.204.206:4041 , piece_id=S7UUW2R74ETDDNDVA73DRMGZ65YTPPLPWILZZ626SIG2YG55AOOA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.858612054 (282h21m33.410082515s) [noise=true , address=185.167.204.205:4023 , piece_id=NQMCNM7GAS2URY7JNN4DXMU2FZ7UAVHC42U55IVIGYUWXZ5DFOCQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859019680 (282h21m33.410490131s) [noise=true , address=185.167.204.205:4013 , piece_id=G5AFIVUYYIG3IAVQ2UN4MTL3NPXN326IOR77CXTU4BAIBFMICKXQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859464347 (282h21m33.410934808s) [noise=true , address=185.167.204.206:4044 , piece_id=6TMH2M7X2J6NUJ7H7YQ44MK3CHAHTONHFVB767OLQ7LVWYS6SWSQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.859565901 (282h21m33.411036352s) [noise=true , address=185.167.204.206:4071 , piece_id=CWYOC5U5SIHG24FJA76NVMYJG47L55GDKXTZ7FHENXXGL6NNLNCA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866136853 (282h21m33.417607324s) [noise=true , address=185.167.204.205:4027 , piece_id=DTF2OMEXXT2XFQB2RQOKL66K4AOIC3DTZOTE2ZGIMYWVPCTKJWJA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.866678734 (282h21m33.418149195s) [noise=true , address=185.167.204.206:4043 , piece_id=OBBQPYJ5QWYI3IDE7ROOB62NCIA425S2RW6N4BRRNXDSN7XTH3VA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867348910 (282h21m33.418819361s) [noise=true , address=185.167.204.205:4015 , piece_id=UC43M7E3DTT7P6X5FZR63SXMW3B7Y7LNX3CIXI5YGWVIPVXHRWWQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.867982197 (282h21m33.419452668s) [noise=true , address=185.167.204.206:4058 , piece_id=WJFVIB3443AETF6JXCW2CAYSL2E5SZWD3XITVJICPRBJUU7BO2OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.868482399 (282h21m33.41995286s) [noise=true , address=185.167.204.206:4037 , piece_id=ZTVJJC7I2VQ3ZO62Y2SNZKV64WYLEXHL2CJNDORXID6NBWWZSOYQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:34.880010110 (282h21m33.431480601s) [noise=true , address=185.167.204.205:4025 , piece_id=ZWXX3V2QD4QSVDNMMDJ5GSSLIMSAK5IZOHOEB2SI3TFMPUXRRVXA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.419467556 (282h21m33.970938017s) [noise=true , address=81.171.14.70:4044 , piece_id=WAQ3SBHX6TRISFEOPE4Y6O2HSE2NYVC257V6ROMZSFVJO7YLCGRQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.424133200 (282h21m33.975603661s) [noise=true , address=81.171.14.70:4038 , piece_id=X67ZAHX3AIYBBWES2PL5TB6FKR3DGZBALSLTITODERBWUI2OILVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.433560922 (282h21m33.985031383s) [noise=true , address=81.171.14.70:4041 , piece_id=AAUJYA6S7AWTCUO33QBNLCFUKRLGY6NLGFHRECJ5I63H53J46SMQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.452011215 (282h21m34.003481676s) [noise=true , address=81.171.14.70:4047 , piece_id=ZNKZHAJAP24ZF6ZBV6762YY7LCRUSQCCL5E53WU5TMZ457CRZ3RA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.508011640 (282h21m34.059482111s) [noise=true , address=81.171.14.70:4035 , piece_id=VI2R7YZTWKO4NNTYCTKDPAMHAA2CA5UA54ZJJOQXJ5FG6YY4VS5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:35.897112773 (282h21m34.448583234s) [noise=true , address=81.171.14.70:4031 , piece_id=LYWET76RCJLTUN3DJDSVMDOZ6X5S53KPZ264P7D5FS7XCRDSYIQA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.027285292 (282h21m34.578755743s) [noise=true , address=81.171.14.70:4045 , piece_id=EOJUCJVNYJIF447J6FKIRVIXM3IJ5OU6TEVUKHFKQCUUVIMBR2EA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.070911284 (282h21m34.622381745s) [noise=true , address=89.149.201.147:4011 , piece_id=F5544PH4I4Z224P2DVMAXLM57DWIFT37KKXUJBR7B3OG5FV7KK6A, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.073062550 (282h21m34.624533011s) [noise=true , address=89.149.201.147:4018 , piece_id=LPC2AQ7TX4UUEI4I5VMGDOIFJI7R3GJGAOL5Q2O7SVY42OFN3XVA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.083744591 (282h21m34.635215052s) [noise=true , address=89.149.201.147:4008 , piece_id=GSCXEJOMPWFECP7YSD66BRY26ZTXGIRZIMZYWKIW2SLRGPSJT7OQ, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.146992305 (282h21m34.698462766s) [noise=true , address=89.149.201.147:4003 , piece_id=SDOIACESWFHPNPOZUZIXW5F2K62OUKCLCBHUKD4YKPLUQG4XXE5Q, seg_pos={0 0}, upload=248651]: Done uploading piece. err: <nil> Nov 21 02:25:36.147018144 (282h21m34.698488605s) [seg_pos={0 0}, upload=248651]: Segment reached optimal threshold of 26 pieces. Nov 21 02:25:36.147392256 (282h21m34.698862717s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz): protocol: expected piece hash; context canceled; EOF Nov 21 02:25:36.147403267 (282h21m34.698873728s) [noise=true , address=89.149.201.147:4021 , piece_id=YPXYWJWR2LMLCA4PFNLVHI4HBZ3ZP6VGIHCMAHVOADM5USZ3UJWA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148140441 (282h21m34.699610933s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53374->89.149.201.147:4010: use of closed network connection Nov 21 02:25:36.148153566 (282h21m34.699624027s) [noise=true , address=89.149.201.147:4010 , piece_id=X2Y6OVKDJOUA7DUWJAJAEN2FWYOFC3XXJPLNHCFQCXIV543RCIAA, seg_pos={0 0}, upload=248651]: Long tail cancellation due to optimal threshold Nov 21 02:25:36.148213310 (282h21m34.699683761s) [seg_pos={0 0}, upload=248651]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 21 02:25:36.148357414 (282h21m34.699827875s) [upload=248651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 02:25:36.148395076 (282h21m34.699865547s) [upload=248651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 02:25:36.406626090 (282h21m34.958096551s) [upload=248651]: Done uploading segments... Nov 21 02:25:36.406651539 (282h21m34.958122s) [upload=248651]: Upload finished. err: <nil> Duration: 1m0.003963953s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 685.110198ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:47:20 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 685.134665ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 694.856585ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:46:47 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 694.883607ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 696.090525ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:45:49 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 696.17232ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 685.255956ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:45:24 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 685.284499ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.831634692s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:44:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.831655191s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 698.057252ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:44:13 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 698.085836ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 691.078471ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:43:28 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 691.109391ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.762302453s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:43:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.76233181s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.906319665s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:43:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.90634853s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 689.425244ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:42:21 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 689.453196ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.827185641s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:41:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.827217402s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 692.076362ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:41:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 692.113803ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.889789921s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:41:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.889819727s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.695728633s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:41:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.69588984s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 690.658752ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:40:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 690.68945ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.626891836s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:40:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.626979894s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 699.656707ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:40:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 699.692594ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.830876218s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:39:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.830936954s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 686.452875ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:39:29 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 686.482761ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.860730906s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:38:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.860762988s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.923996655s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:38:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.924027775s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 697.527152ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:38:17 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 697.646418ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.18148055s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:37:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.181511488s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 691.492451ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:37:04 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 691.547435ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.786995381s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:36:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.787034957s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 698.310608ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:36:14 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 698.339255ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.646834701s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:35:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.646850291s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 690.600146ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:35:38 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 690.666073ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.978780966s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:35:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.978810973s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.804409218s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:34:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.804433235s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.981161517s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:34:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.981193157s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 697.263748ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:34:24 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 697.292675ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.699931646s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:34:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.699959311s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 692.82824ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:33:42 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 692.858849ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.880736425s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:33:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.88076542s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 698.307613ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:32:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 698.330527ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 699.139728ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:32:28 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 699.168363ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.719787305s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:31:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.7198055s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 695.509846ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:31:19 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 695.525947ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.793410425s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:31:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.793440101s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 700.668419ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:30:29 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 700.697794ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.04791709s trace: https://jaeger.dev.storj.io/trace/6ddd3463bed508e FAIL (2025-11-20 23:29:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.047956414s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 693.82103ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/778bd78de335867b FAIL (2025-11-20 23:29:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 693.847461ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)