Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.945529599s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:53:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.945562181s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 3.381841335s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:53:39 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.381864908s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 3.48273213s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:53:04 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.482763791s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.103110942s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:52:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 5.103137924s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 4.975664773s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:52:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.975697185s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................X......................................] duration: 3.463077952s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:52:14 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.463194404s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 4.832631392s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:52:06 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.832664626s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................X.....................................] duration: 3.47366764s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:51:54 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.473690212s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 4.8860596s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:51:06 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.886093875s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................X....................................] duration: 3.38262119s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:50:53 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.382670836s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................X...................................] duration: 3.373223506s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:49:59 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.373256958s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 4.864888355s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:49:58 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.864927138s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 4.828937618s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:49:31 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.828970601s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 4.855077523s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:49:04 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.855112118s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................X..................................] duration: 3.429548529s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:48:58 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.429605657s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 4.783995778s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:48:31 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.784016477s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................X.................................] duration: 3.413641523s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:47:50 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.413669627s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 4.879577935s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:47:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.879607801s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................X................................] duration: 3.447475889s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:47:16 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.447516166s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................X...............................] duration: 3.510902614s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:46:37 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.510951488s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.827739706s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:46:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.827772448s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................X..............................] duration: 3.37712015s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:46:03 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.377147582s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.836244241s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:45:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.836268036s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................X.............................] duration: 3.385825588s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:45:25 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.385856927s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.812967077s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:45:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.813001483s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................X............................] duration: 3.376445456s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:44:47 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.376478037s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 4.851968241s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:44:36 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.852002828s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................X...........................] duration: 3.390247998s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:44:24 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.390277324s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................X..........................] duration: 3.397573368s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:44:09 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.397600939s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.815649075s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:43:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.815684012s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................X.........................] duration: 3.465835489s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:43:10 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.465862702s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 4.786710227s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:42:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.78687959s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................X........................] duration: 3.383949866s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:42:18 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.384000482s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 4.886142657s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:42:09 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.886174797s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................X.......................] duration: 3.324637835s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:41:37 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.324669977s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 3.411159987s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:41:16 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.411191498s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.838544871s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:41:14 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.83865518s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 4.829314395s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:40:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.829340645s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 3.630275241s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:40:47 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.63030601s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.815404146s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:40:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.815435546s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 3.464311538s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:39:57 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.464330593s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.847759316s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:39:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.847791048s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.831863757s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:38:57 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.831886891s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 3.418465771s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:38:51 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.418572934s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.768963296s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:38:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.768996931s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 4.809734752s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:37:57 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.809762185s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 3.41066295s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:37:45 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.410687056s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 3.430092438s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:37:23 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.43011959s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.885510673s trace: https://jaeger.dev.storj.io/trace/2468f5523f64cfad FAIL (2025-11-04 03:37:20 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931433457 (111h31m34.62728221s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.931988755 (111h31m34.627837508s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.932518393 (111h31m34.628367146s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933111292 (111h31m34.628960045s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.933671208 (111h31m34.629519961s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.944576273 (111h31m34.640425026s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.946100836 (111h31m34.641949589s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.948533128 (111h31m34.644381881s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.950980658 (111h31m34.646829411s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:02.952386496 (111h31m34.648235249s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Uploading piece... Nov 4 03:12:03.793168457 (111h31m35.48901721s) [upload=98231]: Next returned nil segment Nov 4 03:12:03.793186962 (111h31m35.489035716s) [upload=98231]: Waiting for error group managing segments... Nov 4 03:12:04.222998520 (111h31m35.918847283s) [noise=true , address=81.171.14.70:4043 , piece_id=OP54I23KGW2RLUA6YWITL6UFJSAM57RT2RUL2OA6DYM6V7QQTA5A, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.244274272 (111h31m35.940123025s) [noise=true , address=81.171.14.70:4033 , piece_id=MO43WEYVYFEVRXPZM6P5TP3THB6FXXCVDJKLCFURDA22OEEWR5XA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250207430 (111h31m35.946056193s) [noise=true , address=81.171.14.70:4029 , piece_id=OTM4HL4WGCWDUSU2N2NH3OMLBTZ3TABOMWOHFS2VI4LNGSS5ARGA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.250829534 (111h31m35.946678287s) [noise=true , address=89.149.201.147:4011 , piece_id=MS55ZOZ536VKOWAZ27ULQ3WD6Z66NJ5LW4HFPI3ZODRWZX3JRPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.251439146 (111h31m35.947287899s) [noise=true , address=89.149.201.147:4022 , piece_id=2LKE5B4YBZRJQF4YC3D7AST7IFNZ5TNY7WRWDWDVEGJMXCWPPMTQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.254884115 (111h31m35.950732869s) [noise=true , address=81.171.14.70:4032 , piece_id=GPQFU3TVSS4QOUH76LJJCXTMH6QA3YB66Y4VOXGVHLBHR66J2OUA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.258386845 (111h31m35.954235588s) [noise=true , address=81.171.14.70:4037 , piece_id=HXWEX64DA3JSBGKFBMLR5JZFDODHRLGXV5PH4KUSB6MJHAOPM56Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.261986919 (111h31m35.957835672s) [noise=true , address=81.171.14.70:4045 , piece_id=G6CVHIZIPXSPMTRYAK4YOX23243JGJF72PLZZJZMSB6RQZLVSJEQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.266565067 (111h31m35.962413821s) [noise=true , address=81.171.14.70:4047 , piece_id=CRFSVTRCNAP7O5WBFJC3CI7BIHYW5GEMQNJWY62MCBTU3OQGUOVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.269620636 (111h31m35.965469399s) [noise=true , address=81.171.14.70:4035 , piece_id=XCZ2GNJM6LYJ4YH6Q63RWANB7TWICYAPIDBTU3345LZCJOQ7IAIA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.274954883 (111h31m35.970803636s) [noise=true , address=81.171.14.70:4031 , piece_id=4AK4F3TTW2LOQ6KKKX2UX7C5GLHCGNTDCM72S3TYURHKHMGPMBVQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.284291882 (111h31m35.980140635s) [noise=true , address=89.149.201.147:4006 , piece_id=DWJ7ZTT7OD7D7WYA3IHQRW5Q77GBXR64KLO44PN7STXGMYVTBUHA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.319732566 (111h31m36.015581319s) [noise=true , address=89.149.201.147:4009 , piece_id=PCZIPIA3GEZAKOBJZ3WOVLP73MIHXE526DOOFALXNC5AZGIEHTIQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.335212994 (111h31m36.031061747s) [noise=true , address=89.149.201.147:4015 , piece_id=5UZRJXCB5GY65WPUHSPXOGWKDVAHSQ33V64UZN6EMDW6MJQWUFRQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.344732029 (111h31m36.040580792s) [noise=true , address=89.149.201.147:4010 , piece_id=VRBIAGNVKYEEUFT2TUDGAP6V54BP5NPXGIZN5WWNUPXAEMVMNM3Q, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.715960106 (111h31m36.411808879s) [noise=true , address=89.149.201.147:4019 , piece_id=ZQVTTUA3PTE2WQNUSQQDWLU5TUJSSORKLMHASHZ3U2LKP7FP7IBQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.764646833 (111h31m36.460495586s) [noise=true , address=185.167.204.205:4021 , piece_id=RFXWTD6LCFX6Y632J332JJIZE5FGFQSX5MDZS2KO6KOG5BOGBOAQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.770990263 (111h31m36.466839026s) [noise=true , address=185.167.204.205:4034 , piece_id=SNMCCSKZNMSZYAFUDHKOFVIYH2AU54VQBHZTSWT4OI2NN3KX6CQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.780238132 (111h31m36.476086885s) [noise=true , address=89.149.201.147:4012 , piece_id=DIIGXYMGR523PGVWPEUEY2JZ32RB7JNCXOAPZTJVQ2ZNJVMYOYSQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.784640304 (111h31m36.480489057s) [noise=true , address=185.167.204.205:4032 , piece_id=TXNXVFEWVGBW64IVMIMN4UA5RMRFK5EI7ZOYJV4MVIUAVKRJGLGQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.789906792 (111h31m36.485755545s) [noise=true , address=81.171.14.70:4048 , piece_id=7QN7XFFYKKVWXDD4TOTSRNL7PCGPO62D2ONNMWS3VJRVBAMHNYPQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.830445545 (111h31m36.526294298s) [noise=true , address=185.167.204.206:4069 , piece_id=HQNTKHHW5XQJPXBPOPPZAQNDQN46SNHUU5YMAWEQUPA6XPGQIEQQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.843338375 (111h31m36.539187128s) [noise=true , address=185.167.204.205:4022 , piece_id=K7M5H4K5TBJBVO547RUQ3RGO6D465VQUSU7FEAHX2KBELODWFFVA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.867028524 (111h31m36.562877277s) [noise=true , address=185.167.204.206:4053 , piece_id=GRCYPAUC6RS467UIRIRAY5DQ7L2OE562TIKWNV4JZPDSJ3XGAIOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.918008137 (111h31m36.61385689s) [noise=true , address=185.167.204.206:4044 , piece_id=AZRUAKEY4CW4Z7YFX53MK3DHBMPTYCAEZYTSBMTL4KWL2LN7TDOQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921963128 (111h31m36.617811881s) [noise=true , address=185.167.204.205:4030 , piece_id=Z3SL2QYN6YEL7MACJM57I6W6WSSQ6L7UNPQ6SZ2RSHV4UXUHCXKQ, seg_pos={0 0}, upload=98231]: Done uploading piece. err: <nil> Nov 4 03:12:04.921989427 (111h31m36.61783818s) [seg_pos={0 0}, upload=98231]: Segment reached optimal threshold of 26 pieces. Nov 4 03:12:04.922274782 (111h31m36.618123535s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922288277 (111h31m36.61813703s) [noise=true , address=185.167.204.206:4041 , piece_id=NA3A2KAZZMUSY323KQ3MX56QU7K6NW5LMY2NJTCBZDJESH5WOSWA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922447901 (111h31m36.618296654s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: expected piece hash; context canceled; EOF Nov 4 03:12:04.922461056 (111h31m36.618309809s) [noise=true , address=185.167.204.205:4011 , piece_id=BN7VOLK7O3RIS4OWUAQZNKCLEXUYWJPTTAYO77YXR34TLBHEZPEA, seg_pos={0 0}, upload=98231]: Long tail cancellation due to optimal threshold Nov 4 03:12:04.922486986 (111h31m36.618335739s) [seg_pos={0 0}, upload=98231]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 4 03:12:04.922592256 (111h31m36.618441009s) [upload=98231]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 4 03:12:04.922602044 (111h31m36.618450797s) [upload=98231]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 4 03:12:05.152115785 (111h31m36.847964538s) [upload=98231]: Done uploading segments... Nov 4 03:12:05.152143498 (111h31m36.847992251s) [upload=98231]: Upload finished. err: <nil> Duration: 4.88554118s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 3.354375171s trace: https://jaeger.dev.storj.io/trace/4d9510343af71bf7 FAIL (2025-11-04 03:36:39 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 3.354405899s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)