Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.65199917s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:45:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 4.652021012s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 3.772796316s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:45:40 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.772820041s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 3.755846424s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:45:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.755888725s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.089842858s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:44:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 5.089866244s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 3.796731201s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:44:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.796755929s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.150496607s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:44:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 5.150522025s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.22286934s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:43:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 5.222893999s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 3.608887462s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:43:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.608910457s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.16786734s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:42:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 5.167889663s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 3.441961087s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:42:05 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.441986156s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 3.504209402s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:41:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.504222758s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 3.517404003s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:41:16 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.517424063s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 4.666155457s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:41:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 4.666177109s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 3.555588898s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:40:27 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.555609487s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.187822825s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:40:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 5.187853675s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 3.6108139s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:39:16 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.610834931s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 4.279850658s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:39:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 4.279884103s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 3.4682693s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:38:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.468282536s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 4.699796735s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:38:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 4.69982528s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 3.50864972s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:37:45 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.508692744s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 3.474995118s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:37:24 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.475015588s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.067552059s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:36:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 5.067577027s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 3.676359592s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:36:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.676405852s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 4.313339419s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:36:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 4.313366623s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 3.55208927s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:35:28 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.552104359s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.073758438s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:35:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 5.073836058s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................X......................................] duration: 3.457444731s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:34:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.457469158s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................X.....................................] duration: 3.493126812s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:34:06 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.493152892s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 3.886094305s trace: https://jaeger.dev.storj.io/trace/2ff3393e0c1a9697 FAIL (2026-04-11 22:33:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== WKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548563173 (102h47m43.367799197s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548778418 (102h47m43.368014442s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.548903660 (102h47m43.368139684s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549268945 (102h47m43.368504969s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549357806 (102h47m43.36859384s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549645432 (102h47m43.368881456s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.549937606 (102h47m43.36917363s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550040233 (102h47m43.369276257s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550233477 (102h47m43.369469501s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:56.550488940 (102h47m43.369724964s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Uploading piece... Apr 11 22:33:57.367204035 (102h47m44.186440059s) [upload=98637]: Next returned nil segment Apr 11 22:33:57.367221299 (102h47m44.186457323s) [upload=98637]: Waiting for error group managing segments... Apr 11 22:33:57.752503468 (102h47m44.571739492s) [noise=true , address=185.167.204.205:4005 , piece_id=GME5HRL5F2UWT2KT5NTUDTSORNUVQPJYM6U54WY5QNFGQPHXMQBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.754690408 (102h47m44.573926432s) [noise=true , address=185.167.204.205:4016 , piece_id=KZFLN7QBVQMTM65BKN5D4TE5SU4L4LUWLYIEGL4BGLTF4DEMZ37A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.755137762 (102h47m44.574373776s) [noise=true , address=185.167.204.205:4010 , piece_id=AT25DWQ2QG2YJ6IATZ5TEXVJZETMZ7GRBE5LWZQOJC5OBBJJANCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758231522 (102h47m44.577467546s) [noise=true , address=185.167.204.206:4071 , piece_id=EXPK2YQ2YV3VW265RMZKWOEBP57ZCNYYMPBOSTENC4VYGSAI3QTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.758971310 (102h47m44.578207335s) [noise=true , address=185.167.204.205:4027 , piece_id=3S2Q4G2W3BNBRGZMPASGOOVD5YBNVU7NTYROV3WBDCZNVUCVKKGQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.759903018 (102h47m44.579139032s) [noise=true , address=185.167.204.206:4067 , piece_id=A6C4WZOVNZPR7OW5BTXHX4GPTXAAEZH6W64IB33MOSHNCCUB2O5A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.760298882 (102h47m44.579534906s) [noise=true , address=185.167.204.206:4064 , piece_id=2X4VJ7IWSX7MVOPKP5YI6HMRK5APDK7CJ6CNTFI4NBPER2V4YQUA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.762311998 (102h47m44.581548022s) [noise=true , address=185.167.204.205:4030 , piece_id=GOUSDCKL2BNQVIHLEJRV2KYRRNMWS6WBFWRSCAU3ZB5PXN4LED6Q, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.764244477 (102h47m44.583480501s) [noise=true , address=185.167.204.206:4040 , piece_id=SAJRKOJM7COUWFX37APYZK4LXGYTDURPRKPU4OEM2Q77XNRZAWTQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.766334120 (102h47m44.585570144s) [noise=true , address=185.167.204.205:4026 , piece_id=I25EHV7OIJ2RWKLK2BESU4VQPLMUVUNAXDO3P6TWMBMTJPEFRC6A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.767129575 (102h47m44.5863656s) [noise=true , address=185.167.204.206:4050 , piece_id=QGHNIH22IEYHCYGFTXECYXOTXPV2GER3AME7EOLOJ6OG7U276RFQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.778074198 (102h47m44.597310232s) [noise=true , address=81.171.14.70:4030 , piece_id=RDGJSROJDP624XNUAHSAWIC4TNLA36JOHGJQGBS7RF6BPPLEZKLA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.788393573 (102h47m44.607629597s) [noise=true , address=81.171.14.70:4028 , piece_id=ZBPDZUZISOSKEUULEYQKAMD2VFXTMJ4USH2C5EYPN6HQVP7TMCTA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.792230277 (102h47m44.611466301s) [noise=true , address=81.171.14.70:4025 , piece_id=JNGRNWZER45XEMDP2GMT5G7CABVYMWYFZF7N4DN3PQPPKFR5IPKQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.801053727 (102h47m44.620289801s) [noise=true , address=81.171.14.70:4031 , piece_id=O44CIAGDJOVFWTOMU76QNE7D2V5DMM2WXS32AQSTQLPBQM4PLAJA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.811586183 (102h47m44.630822207s) [noise=true , address=81.171.14.70:4045 , piece_id=42ZDFPDJPRXTOYSGH7RACQ5LG6LHMAXXIGRUZPR4YS5R4UPLBLCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.821434329 (102h47m44.640670364s) [noise=true , address=81.171.14.70:4033 , piece_id=HMXHPVPEP3XZNJIRHOYM63F455XEQXBF2UEISP255HKG7R3BFDBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:57.823108190 (102h47m44.642344204s) [noise=true , address=81.171.14.70:4041 , piece_id=FUM5YJPGUWFO6RIOEXC22P64RXGLOSV2RN7GUGTQN7HAZO5PNCJQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.241410556 (102h47m45.06064658s) [noise=true , address=81.171.14.70:4044 , piece_id=A7WGIPG4BR2VXXNSC4JJW4BTOPDXGY5UVOVMOCPYVMIDRUWKFC2A, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.270512701 (102h47m45.089748725s) [noise=true , address=89.149.201.147:4001 , piece_id=QHAVRQG6CR52AZRNCY2NUF4P7S7IS2XGVYDTQGAJTDODCOCMCJEQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.286940856 (102h47m45.10617688s) [noise=true , address=89.149.201.147:4003 , piece_id=FBBKIOSZMPV7AGVHMASK3NP2EFJHAGWKLUD3NHB4AWOGCPY5XZCA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.320932218 (102h47m45.140168242s) [noise=true , address=89.149.201.147:4006 , piece_id=KNGL5AUHLTHNK5AP7O4J3AGMAO6XB6ZW6R2PGGMR6QESZCA5ZPCQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.322102787 (102h47m45.141338811s) [noise=true , address=89.149.201.147:4011 , piece_id=6ERRCLCVWLBGHC2CAGRGX5MU6XLVPYNQKRF2AUTWXYHJV4MNFLBQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.350742410 (102h47m45.169978434s) [noise=true , address=89.149.201.147:4021 , piece_id=6EH4Y5JXQ5PWFKKBNQBZOWEJ2OVPCM6T5QIIERDUQDEDCUB6GHMQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.371028521 (102h47m45.190264545s) [noise=true , address=89.149.201.147:4005 , piece_id=KQEIPBHZNAUICQVQ25ZDTXDYVAORQRCCMMRWPWCDSUJKIEZVKBNA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772402786 (102h47m45.59163881s) [noise=true , address=89.149.201.147:4010 , piece_id=7FTYZAMMFUA24KVB2I27N4JKYKPGBKQKY4PHHS6WE22B545JRGDA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: <nil> Apr 11 22:33:58.772424879 (102h47m45.591660903s) [seg_pos={0 0}, upload=98637]: Satisfied cohort requirements after 26 pieces Apr 11 22:33:58.772602983 (102h47m45.591839007s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772608363 (102h47m45.591844387s) [noise=true , address=89.149.201.147:4014 , piece_id=O6HBKJQQ7E3UXCKNUNRMLEENGYXQSJ422YPY76JVUAL6NXUB44OA, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772726511 (102h47m45.591962535s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Apr 11 22:33:58.772732062 (102h47m45.591968086s) [noise=true , address=89.149.201.147:4007 , piece_id=FIP7YPDHWTMZA7POUFIFKGEUZVU44WJWQX2RFRQUJKOMDMQY7MYQ, seg_pos={0 0}, upload=98637]: Long tail cancellation due to optimal threshold Apr 11 22:33:58.772750788 (102h47m45.591986812s) [seg_pos={0 0}, upload=98637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Apr 11 22:33:58.772816936 (102h47m45.59205296s) [upload=98637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Apr 11 22:33:58.772821675 (102h47m45.592057699s) [upload=98637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Apr 11 22:33:59.016818673 (102h47m45.836054697s) [upload=98637]: Done uploading segments... Apr 11 22:33:59.016837189 (102h47m45.836073213s) [upload=98637]: Upload finished. err: <nil> Duration: 3.886116417s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................X....................................] duration: 3.47252795s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:33:21 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.472562897s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................X...................................] duration: 3.500337813s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:32:51 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.500357492s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................X..................................] duration: 3.734139748s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:31:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.734167803s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................X.................................] duration: 3.90402366s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:31:29 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.904049099s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................X................................] duration: 3.718534828s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:30:43 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.718581559s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................X...............................] duration: 3.713740156s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:30:02 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.713765675s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................X..............................] duration: 4.450049059s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:29:08 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.450070873s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................X.............................] duration: 3.7362146s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:28:24 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.73625601s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................X............................] duration: 3.723973157s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:28:06 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.724001572s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................X...........................] duration: 3.741142884s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:27:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.741215162s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................X..........................] duration: 3.476332617s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:26:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.476423342s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................X.........................] duration: 3.589033271s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:26:12 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.589052789s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................X........................] duration: 4.223021774s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:25:26 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.22304547s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................X.......................] duration: 3.642960887s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:24:17 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.64298302s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 3.563820412s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:23:35 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.563842835s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 3.671893669s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:23:09 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.671918226s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 3.567136631s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:22:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.567163592s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 4.307680688s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:22:17 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.307704304s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 4.353647555s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:21:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.353677574s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 3.530957009s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:21:04 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.530981838s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 3.794420612s trace: https://jaeger.dev.storj.io/trace/7686969fc770dac5 FAIL (2026-04-11 22:20:24 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.794446101s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)