Orbiter History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 473.96866ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:19:38 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 473.986854ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 461.814746ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:19:25 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 461.845635ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 391.735594ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/41cfd75a627799ce FAIL (2025-11-21 11:19:22 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 391.761062ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 494.609073ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:19:11 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 494.63905ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [..........................................X...X.X......X.XX.] duration: 6.35310438s trace: https://jaeger.dev.storj.io/trace/20a90eb87f230231 FAIL (2025-11-21 11:19:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 21 11:18:14.349295322 (291h14m12.900765793s) [upload=256479]: Starting upload Nov 21 11:18:14.349414619 (291h14m12.90088508s) [upload=256479]: Done starting upload Nov 21 11:18:14.349759345 (291h14m12.901229816s) [upload=256479]: Uploading segments... Nov 21 11:18:14.349994613 (291h14m12.901465074s) [upload=256479]: Got next segment. Inline: false Nov 21 11:18:14.350114782 (291h14m12.901585233s) [upload=256479]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 21 11:18:14.350123238 (291h14m12.901593699s) [upload=256479]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 21 11:18:14.594157192 (291h14m13.145627663s) [seg_pos={0 0}, upload=256479]: Begin upload segment... Nov 21 11:18:14.594239949 (291h14m13.14571041s) [seg_pos={0 0}, upload=256479]: Done begin upload segment. Nov 21 11:18:14.594286508 (291h14m13.145756979s) [noise=true , address=145.79.227.30:4761 , piece_id=UOX6EHIP66VUSEBAFJHFI3RE5AKCZPBFZSXNUQCKQ56EJA2I3R5A, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.594303400 (291h14m13.145773861s) [noise=true , address=45.91.116.14:4190 , piece_id=BWFAHNL3SRJZ7MUTOZMM3VA7VW737NKKJCNELBF74P5PLQHCZETQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.594918692 (291h14m13.146389153s) [noise=true , address=77.90.31.18:4805 , piece_id=VQVR3Q4MD77FDUYVR5TEB3RUZODUMNXECKDNAPJNKWYLRYWPUB5A, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.595266895 (291h14m13.146737356s) [noise=true , address=45.91.116.7:4009 , piece_id=3FBMTAMRDQP6XTXRSMNUAGY7M2JY5TZJDC3TOZNYECFNZNFWKISQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.595427761 (291h14m13.146898222s) [noise=true , address=145.79.227.23:4547 , piece_id=BW6D4PYPBQQMPFRDNTEK25SCN3OGDD7D7GVRLZFJIIURJ66VZ4VA, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.595832191 (291h14m13.147302652s) [noise=true , address=145.79.227.31:4799 , piece_id=TGV27SA4PYI3PMLYXLBAIBETRSYB2WSAHGVS53SLC5AT6D6DUMKQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.596073641 (291h14m13.147544102s) [noise=true , address=77.90.31.14:4662 , piece_id=KLPJHWNHZQ7UQ4IQQ3BG24FK4QVQLSHHYF7QDNFFVJFXD4LRYDRA, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.596446520 (291h14m13.147916982s) [noise=true , address=145.79.227.8:4331 , piece_id=QG5YHTQMRR7PLRFTQG23NXMCHMS3ZS2YKFHRG2CY7JL3SZTVGEWA, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.596864116 (291h14m13.148334587s) [noise=true , address=145.79.227.9:4365 , piece_id=CDEBBJ27B5RRGJ3TRNJSNFTUXDCYVYPFUAG6JMHOINNWEWHMHRIQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.596948737 (291h14m13.148419198s) [noise=true , address=145.79.227.32:4835 , piece_id=RDYHZGUOZU6X36R7LGLWYGBBKQ4H3UEMUC5PMBA6RFOKOHPXTY7A, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.597450142 (291h14m13.148920603s) [noise=true , address=45.91.116.11:4119 , piece_id=6ZIU2HC2HLE4TSFZI5GHN2CMB2O7KZWRHVZA64K4U35UCBTOJSXQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.598080402 (291h14m13.149550863s) [noise=true , address=145.79.227.14:4840 , piece_id=IZDBIA7G5XNZ6N2BUVNC37HDJNXREQ6KLYFTAZ4FFCRMDF4T7ZOQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.598765737 (291h14m13.150236188s) [noise=true , address=145.79.227.20:4437 , piece_id=FL76MEOZCNBHSQ6K3T5YEVEAUQXL3AZ6NFW5EB72TPLJ4JZGRJ6Q, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.599439099 (291h14m13.15090956s) [noise=true , address=145.79.227.10:4403 , piece_id=GL6JFAEQ2V6ZQ4CUDZYD4FHJDRCPFPJGXGU3SP43QV3YD46S63EQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.600110298 (291h14m13.151580759s) [noise=true , address=77.90.31.19:4843 , piece_id=ZXSCUD3RA747GHLCBKPL3Z2A52DMSQ6UHSFZT2X6NIVIQBRW7ZNQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.600648582 (291h14m13.152119043s) [noise=true , address=45.91.116.11:4117 , piece_id=BRFYRO35QNVARHV2JTN6TO7XPHXQTTV2U3LD2FVM6XEBQOCESLOQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:16.298592456 (291h14m14.850062917s) [upload=256479]: Next returned nil segment Nov 21 11:18:16.298613146 (291h14m14.850083597s) [upload=256479]: Waiting for error group managing segments... Nov 21 11:18:16.579494524 (291h14m15.130964985s) [noise=true , address=145.79.227.31:4799 , piece_id=TGV27SA4PYI3PMLYXLBAIBETRSYB2WSAHGVS53SLC5AT6D6DUMKQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.590161836 (291h14m15.141632297s) [noise=true , address=145.79.227.8:4331 , piece_id=QG5YHTQMRR7PLRFTQG23NXMCHMS3ZS2YKFHRG2CY7JL3SZTVGEWA, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.593457982 (291h14m15.144928443s) [noise=true , address=145.79.227.32:4835 , piece_id=RDYHZGUOZU6X36R7LGLWYGBBKQ4H3UEMUC5PMBA6RFOKOHPXTY7A, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.595047368 (291h14m15.146517829s) [noise=true , address=145.79.227.10:4403 , piece_id=GL6JFAEQ2V6ZQ4CUDZYD4FHJDRCPFPJGXGU3SP43QV3YD46S63EQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.597470232 (291h14m15.148940683s) [noise=true , address=145.79.227.23:4547 , piece_id=BW6D4PYPBQQMPFRDNTEK25SCN3OGDD7D7GVRLZFJIIURJ66VZ4VA, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.597771516 (291h14m15.149241977s) [noise=true , address=145.79.227.9:4365 , piece_id=CDEBBJ27B5RRGJ3TRNJSNFTUXDCYVYPFUAG6JMHOINNWEWHMHRIQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.605864286 (291h14m15.157334747s) [noise=true , address=145.79.227.30:4761 , piece_id=UOX6EHIP66VUSEBAFJHFI3RE5AKCZPBFZSXNUQCKQ56EJA2I3R5A, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.609362257 (291h14m15.160832708s) [noise=true , address=145.79.227.20:4437 , piece_id=FL76MEOZCNBHSQ6K3T5YEVEAUQXL3AZ6NFW5EB72TPLJ4JZGRJ6Q, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.611218832 (291h14m15.162689283s) [noise=true , address=145.79.227.14:4840 , piece_id=IZDBIA7G5XNZ6N2BUVNC37HDJNXREQ6KLYFTAZ4FFCRMDF4T7ZOQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.141134305 (291h14m15.692604766s) [noise=true , address=45.91.116.11:4119 , piece_id=6ZIU2HC2HLE4TSFZI5GHN2CMB2O7KZWRHVZA64K4U35UCBTOJSXQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.194245908 (291h14m15.745716369s) [noise=true , address=77.90.31.19:4843 , piece_id=ZXSCUD3RA747GHLCBKPL3Z2A52DMSQ6UHSFZT2X6NIVIQBRW7ZNQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.228658936 (291h14m15.780129397s) [noise=true , address=45.91.116.7:4009 , piece_id=3FBMTAMRDQP6XTXRSMNUAGY7M2JY5TZJDC3TOZNYECFNZNFWKISQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.278640220 (291h14m15.830110681s) [noise=true , address=45.91.116.14:4190 , piece_id=BWFAHNL3SRJZ7MUTOZMM3VA7VW737NKKJCNELBF74P5PLQHCZETQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.278664897 (291h14m15.830135348s) [seg_pos={0 0}, upload=256479]: Segment reached optimal threshold of 13 pieces. Nov 21 11:18:17.278877532 (291h14m15.830347993s) [noise=true , address=77.90.31.18:4805 , piece_id=VQVR3Q4MD77FDUYVR5TEB3RUZODUMNXECKDNAPJNKWYLRYWPUB5A, seg_pos={0 0}, upload=256479]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Nov 21 11:18:17.278885186 (291h14m15.830355637s) [noise=true , address=77.90.31.18:4805 , piece_id=VQVR3Q4MD77FDUYVR5TEB3RUZODUMNXECKDNAPJNKWYLRYWPUB5A, seg_pos={0 0}, upload=256479]: Long tail cancellation due to optimal threshold Nov 21 11:18:17.279222248 (291h14m15.830692709s) [noise=true , address=45.91.116.11:4117 , piece_id=BRFYRO35QNVARHV2JTN6TO7XPHXQTTV2U3LD2FVM6XEBQOCESLOQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: expected piece hash; context canceled; EOF Nov 21 11:18:17.279229722 (291h14m15.830700183s) [noise=true , address=45.91.116.11:4117 , piece_id=BRFYRO35QNVARHV2JTN6TO7XPHXQTTV2U3LD2FVM6XEBQOCESLOQ, seg_pos={0 0}, upload=256479]: Long tail cancellation due to optimal threshold Nov 21 11:18:17.279356294 (291h14m15.830826755s) [noise=true , address=77.90.31.14:4662 , piece_id=KLPJHWNHZQ7UQ4IQQ3BG24FK4QVQLSHHYF7QDNFFVJFXD4LRYDRA, seg_pos={0 0}, upload=256479]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF Nov 21 11:18:17.279365010 (291h14m15.830835461s) [noise=true , address=77.90.31.14:4662 , piece_id=KLPJHWNHZQ7UQ4IQQ3BG24FK4QVQLSHHYF7QDNFFVJFXD4LRYDRA, seg_pos={0 0}, upload=256479]: Long tail cancellation due to optimal threshold Nov 21 11:18:17.279383384 (291h14m15.830853845s) [seg_pos={0 0}, upload=256479]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 21 11:18:17.279494236 (291h14m15.830964697s) [upload=256479]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 11:18:17.279500298 (291h14m15.830970749s) [upload=256479]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 11:18:17.570292897 (291h14m16.121763348s) [upload=256479]: Done uploading segments... Nov 21 11:18:17.570321843 (291h14m16.121792294s) [upload=256479]: Upload finished. err: <nil> Duration: 6.353136491s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 27 out of 60 is failed (threshold=6) [.................................XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001009644s trace: https://jaeger.dev.storj.io/trace/34cd4297949d7d6a FAIL (2025-11-21 11:19:04 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.001033709s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 432.074146ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/3e5c193367f9a974 FAIL (2025-11-21 11:18:56 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 432.101237ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [...........................................X...X.X......X.XX] duration: 30.003649267s trace: https://jaeger.dev.storj.io/trace/20a90eb87f230231 FAIL (2025-11-21 11:18:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 21 11:18:14.349295322 (291h14m12.900765793s) [upload=256479]: Starting upload Nov 21 11:18:14.349414619 (291h14m12.90088508s) [upload=256479]: Done starting upload Nov 21 11:18:14.349759345 (291h14m12.901229816s) [upload=256479]: Uploading segments... Nov 21 11:18:14.349994613 (291h14m12.901465074s) [upload=256479]: Got next segment. Inline: false Nov 21 11:18:14.350114782 (291h14m12.901585233s) [upload=256479]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 21 11:18:14.350123238 (291h14m12.901593699s) [upload=256479]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 21 11:18:14.594157192 (291h14m13.145627663s) [seg_pos={0 0}, upload=256479]: Begin upload segment... Nov 21 11:18:14.594239949 (291h14m13.14571041s) [seg_pos={0 0}, upload=256479]: Done begin upload segment. Nov 21 11:18:14.594286508 (291h14m13.145756979s) [noise=true , address=145.79.227.30:4761 , piece_id=UOX6EHIP66VUSEBAFJHFI3RE5AKCZPBFZSXNUQCKQ56EJA2I3R5A, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.594303400 (291h14m13.145773861s) [noise=true , address=45.91.116.14:4190 , piece_id=BWFAHNL3SRJZ7MUTOZMM3VA7VW737NKKJCNELBF74P5PLQHCZETQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.594918692 (291h14m13.146389153s) [noise=true , address=77.90.31.18:4805 , piece_id=VQVR3Q4MD77FDUYVR5TEB3RUZODUMNXECKDNAPJNKWYLRYWPUB5A, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.595266895 (291h14m13.146737356s) [noise=true , address=45.91.116.7:4009 , piece_id=3FBMTAMRDQP6XTXRSMNUAGY7M2JY5TZJDC3TOZNYECFNZNFWKISQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.595427761 (291h14m13.146898222s) [noise=true , address=145.79.227.23:4547 , piece_id=BW6D4PYPBQQMPFRDNTEK25SCN3OGDD7D7GVRLZFJIIURJ66VZ4VA, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.595832191 (291h14m13.147302652s) [noise=true , address=145.79.227.31:4799 , piece_id=TGV27SA4PYI3PMLYXLBAIBETRSYB2WSAHGVS53SLC5AT6D6DUMKQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.596073641 (291h14m13.147544102s) [noise=true , address=77.90.31.14:4662 , piece_id=KLPJHWNHZQ7UQ4IQQ3BG24FK4QVQLSHHYF7QDNFFVJFXD4LRYDRA, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.596446520 (291h14m13.147916982s) [noise=true , address=145.79.227.8:4331 , piece_id=QG5YHTQMRR7PLRFTQG23NXMCHMS3ZS2YKFHRG2CY7JL3SZTVGEWA, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.596864116 (291h14m13.148334587s) [noise=true , address=145.79.227.9:4365 , piece_id=CDEBBJ27B5RRGJ3TRNJSNFTUXDCYVYPFUAG6JMHOINNWEWHMHRIQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.596948737 (291h14m13.148419198s) [noise=true , address=145.79.227.32:4835 , piece_id=RDYHZGUOZU6X36R7LGLWYGBBKQ4H3UEMUC5PMBA6RFOKOHPXTY7A, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.597450142 (291h14m13.148920603s) [noise=true , address=45.91.116.11:4119 , piece_id=6ZIU2HC2HLE4TSFZI5GHN2CMB2O7KZWRHVZA64K4U35UCBTOJSXQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.598080402 (291h14m13.149550863s) [noise=true , address=145.79.227.14:4840 , piece_id=IZDBIA7G5XNZ6N2BUVNC37HDJNXREQ6KLYFTAZ4FFCRMDF4T7ZOQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.598765737 (291h14m13.150236188s) [noise=true , address=145.79.227.20:4437 , piece_id=FL76MEOZCNBHSQ6K3T5YEVEAUQXL3AZ6NFW5EB72TPLJ4JZGRJ6Q, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.599439099 (291h14m13.15090956s) [noise=true , address=145.79.227.10:4403 , piece_id=GL6JFAEQ2V6ZQ4CUDZYD4FHJDRCPFPJGXGU3SP43QV3YD46S63EQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.600110298 (291h14m13.151580759s) [noise=true , address=77.90.31.19:4843 , piece_id=ZXSCUD3RA747GHLCBKPL3Z2A52DMSQ6UHSFZT2X6NIVIQBRW7ZNQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:14.600648582 (291h14m13.152119043s) [noise=true , address=45.91.116.11:4117 , piece_id=BRFYRO35QNVARHV2JTN6TO7XPHXQTTV2U3LD2FVM6XEBQOCESLOQ, seg_pos={0 0}, upload=256479]: Uploading piece... Nov 21 11:18:16.298592456 (291h14m14.850062917s) [upload=256479]: Next returned nil segment Nov 21 11:18:16.298613146 (291h14m14.850083597s) [upload=256479]: Waiting for error group managing segments... Nov 21 11:18:16.579494524 (291h14m15.130964985s) [noise=true , address=145.79.227.31:4799 , piece_id=TGV27SA4PYI3PMLYXLBAIBETRSYB2WSAHGVS53SLC5AT6D6DUMKQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.590161836 (291h14m15.141632297s) [noise=true , address=145.79.227.8:4331 , piece_id=QG5YHTQMRR7PLRFTQG23NXMCHMS3ZS2YKFHRG2CY7JL3SZTVGEWA, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.593457982 (291h14m15.144928443s) [noise=true , address=145.79.227.32:4835 , piece_id=RDYHZGUOZU6X36R7LGLWYGBBKQ4H3UEMUC5PMBA6RFOKOHPXTY7A, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.595047368 (291h14m15.146517829s) [noise=true , address=145.79.227.10:4403 , piece_id=GL6JFAEQ2V6ZQ4CUDZYD4FHJDRCPFPJGXGU3SP43QV3YD46S63EQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.597470232 (291h14m15.148940683s) [noise=true , address=145.79.227.23:4547 , piece_id=BW6D4PYPBQQMPFRDNTEK25SCN3OGDD7D7GVRLZFJIIURJ66VZ4VA, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.597771516 (291h14m15.149241977s) [noise=true , address=145.79.227.9:4365 , piece_id=CDEBBJ27B5RRGJ3TRNJSNFTUXDCYVYPFUAG6JMHOINNWEWHMHRIQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.605864286 (291h14m15.157334747s) [noise=true , address=145.79.227.30:4761 , piece_id=UOX6EHIP66VUSEBAFJHFI3RE5AKCZPBFZSXNUQCKQ56EJA2I3R5A, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.609362257 (291h14m15.160832708s) [noise=true , address=145.79.227.20:4437 , piece_id=FL76MEOZCNBHSQ6K3T5YEVEAUQXL3AZ6NFW5EB72TPLJ4JZGRJ6Q, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:16.611218832 (291h14m15.162689283s) [noise=true , address=145.79.227.14:4840 , piece_id=IZDBIA7G5XNZ6N2BUVNC37HDJNXREQ6KLYFTAZ4FFCRMDF4T7ZOQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.141134305 (291h14m15.692604766s) [noise=true , address=45.91.116.11:4119 , piece_id=6ZIU2HC2HLE4TSFZI5GHN2CMB2O7KZWRHVZA64K4U35UCBTOJSXQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.194245908 (291h14m15.745716369s) [noise=true , address=77.90.31.19:4843 , piece_id=ZXSCUD3RA747GHLCBKPL3Z2A52DMSQ6UHSFZT2X6NIVIQBRW7ZNQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.228658936 (291h14m15.780129397s) [noise=true , address=45.91.116.7:4009 , piece_id=3FBMTAMRDQP6XTXRSMNUAGY7M2JY5TZJDC3TOZNYECFNZNFWKISQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.278640220 (291h14m15.830110681s) [noise=true , address=45.91.116.14:4190 , piece_id=BWFAHNL3SRJZ7MUTOZMM3VA7VW737NKKJCNELBF74P5PLQHCZETQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: <nil> Nov 21 11:18:17.278664897 (291h14m15.830135348s) [seg_pos={0 0}, upload=256479]: Segment reached optimal threshold of 13 pieces. Nov 21 11:18:17.278877532 (291h14m15.830347993s) [noise=true , address=77.90.31.18:4805 , piece_id=VQVR3Q4MD77FDUYVR5TEB3RUZODUMNXECKDNAPJNKWYLRYWPUB5A, seg_pos={0 0}, upload=256479]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Nov 21 11:18:17.278885186 (291h14m15.830355637s) [noise=true , address=77.90.31.18:4805 , piece_id=VQVR3Q4MD77FDUYVR5TEB3RUZODUMNXECKDNAPJNKWYLRYWPUB5A, seg_pos={0 0}, upload=256479]: Long tail cancellation due to optimal threshold Nov 21 11:18:17.279222248 (291h14m15.830692709s) [noise=true , address=45.91.116.11:4117 , piece_id=BRFYRO35QNVARHV2JTN6TO7XPHXQTTV2U3LD2FVM6XEBQOCESLOQ, seg_pos={0 0}, upload=256479]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: expected piece hash; context canceled; EOF Nov 21 11:18:17.279229722 (291h14m15.830700183s) [noise=true , address=45.91.116.11:4117 , piece_id=BRFYRO35QNVARHV2JTN6TO7XPHXQTTV2U3LD2FVM6XEBQOCESLOQ, seg_pos={0 0}, upload=256479]: Long tail cancellation due to optimal threshold Nov 21 11:18:17.279356294 (291h14m15.830826755s) [noise=true , address=77.90.31.14:4662 , piece_id=KLPJHWNHZQ7UQ4IQQ3BG24FK4QVQLSHHYF7QDNFFVJFXD4LRYDRA, seg_pos={0 0}, upload=256479]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF Nov 21 11:18:17.279365010 (291h14m15.830835461s) [noise=true , address=77.90.31.14:4662 , piece_id=KLPJHWNHZQ7UQ4IQQ3BG24FK4QVQLSHHYF7QDNFFVJFXD4LRYDRA, seg_pos={0 0}, upload=256479]: Long tail cancellation due to optimal threshold Nov 21 11:18:17.279383384 (291h14m15.830853845s) [seg_pos={0 0}, upload=256479]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 21 11:18:17.279494236 (291h14m15.830964697s) [upload=256479]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 11:18:17.279500298 (291h14m15.830970749s) [upload=256479]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 11:18:17.570292897 (291h14m16.121763348s) [upload=256479]: Done uploading segments... Nov 21 11:18:17.570321843 (291h14m16.121792294s) [upload=256479]: Upload finished. err: <nil> Duration: 30.003666351s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 388.990777ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/41cfd75a627799ce FAIL (2025-11-21 11:18:33 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 389.019281ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 491.239496ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:18:32 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 491.273342ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 470.074194ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:18:27 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 470.102297ms edge linksharing bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [............................................X...X.X......X.X] duration: 30.005802766s trace: https://jaeger.dev.storj.io/trace/4523e135850992aa FAIL (2025-11-21 11:18:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 34.690773909 (291h13m33.24224439s) [upload=256468]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 21 11:17:34.937446427 (291h13m33.488916888s) [seg_pos={0 0}, upload=256468]: Begin upload segment... Nov 21 11:17:34.937504286 (291h13m33.488974757s) [seg_pos={0 0}, upload=256468]: Done begin upload segment. Nov 21 11:17:34.937539554 (291h13m33.489010035s) [noise=true , address=145.79.227.21:4474 , piece_id=LSTGCNJGWF3ZIBGCCQ6NZLBG3OT64QMPXAEQIEW57ZDYFI6GKIJA, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.937564231 (291h13m33.489034682s) [noise=true , address=45.91.116.9:4263 , piece_id=IZSZ4DN6JKIQS4QYB6P6CVDEMF34QKABQDQFXC4KJVZ6OFCJKGJQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.938292247 (291h13m33.489762708s) [noise=true , address=145.79.227.30:4762 , piece_id=42PF44ZJFYNSBTIAIQCSG7QD6F3CFBVX7VPZNEO46A5WAY422OIQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.938452032 (291h13m33.489922493s) [noise=true , address=77.90.31.17:4770 , piece_id=SGH6DDHCXAWO6UHS5KWSK4CR4XTDK76EXWVIKR6WQFV3H4TCXNSQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.938820212 (291h13m33.490290673s) [noise=true , address=77.90.31.19:4843 , piece_id=VLXVL2GVILEKW4CTCCXKT7FK5IJLBFHFLZYSHATLKQ4U5HQOD6UQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.939127307 (291h13m33.490597768s) [noise=true , address=77.90.31.10:4519 , piece_id=KZCEAXOZA2J23J3CV6UO6V2JKURBQ4BFFC2QPBTN5AQYN3SITXEQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.939545884 (291h13m33.491016335s) [noise=true , address=145.79.227.31:4798 , piece_id=H66JS2XMSEFEAR6Y3JNHWSYNAIC5TAY4H2XSFSYRUB3F363KHISQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.939949613 (291h13m33.491420065s) [noise=true , address=145.79.227.9:4365 , piece_id=QGMLSSFGF7QW7LXMSOJJ4OVDQD36N7NWAC2U7XU55GXGYC37NQTA, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.940492937 (291h13m33.491963409s) [noise=true , address=77.90.31.13:4627 , piece_id=25T2A4KV7CJCB7PDR4YPBXZPSKACQ4DAUKQUGKKBYBXVBYFGJBKQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.940923598 (291h13m33.492394059s) [noise=true , address=145.79.227.11:4731 , piece_id=B3VHJBDUKFVFCOWD3AFQGA6PF3TY3HBVU2EJKE7QMX5I3UWRZNYA, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.941388914 (291h13m33.492859365s) [noise=true , address=45.91.116.10:4082 , piece_id=2V3IFO3GPXRX6KRPM5CUW5XCIPQP5V36TQ3L5AOWIABLRX434UXA, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.941741235 (291h13m33.493211696s) [noise=true , address=145.79.227.23:4546 , piece_id=5EI724SIYEJYWTERBGCECK4FCBKBAHBYFK5ZFFTOOX2U3YWFVPAQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.942161585 (291h13m33.493632036s) [noise=true , address=77.90.31.17:4771 , piece_id=MAGMVAWPD5FFST5CQRSOZTB3SVVFNUNOBKUNGKSVNZG72LPPDQZA, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.942486804 (291h13m33.493957255s) [noise=true , address=145.79.227.32:4834 , piece_id=G7NC3XABUBNHQ4PUWIVATTDCXA52UHRVAFFR5T5SMUGJXHLNRDMQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.944698646 (291h13m33.496169107s) [noise=true , address=77.90.31.14:4662 , piece_id=FZRS5PAKDUOTLCXFW7DCTR52TQES37B23OT3KGVYC6PIPIXGQ4IQ, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:34.945104549 (291h13m33.496575s) [noise=true , address=145.79.227.27:4691 , piece_id=IK64GHYJWAWGIWQCHVDSIXJ2JBUDCO5IPXG2RMRN2QYSTYBIKBFA, seg_pos={0 0}, upload=256468]: Uploading piece... Nov 21 11:17:36.651218490 (291h13m35.202688951s) [upload=256468]: Next returned nil segment Nov 21 11:17:36.651233288 (291h13m35.202703739s) [upload=256468]: Waiting for error group managing segments... Nov 21 11:17:36.936198993 (291h13m35.487669454s) [noise=true , address=145.79.227.9:4365 , piece_id=QGMLSSFGF7QW7LXMSOJJ4OVDQD36N7NWAC2U7XU55GXGYC37NQTA, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:36.944718396 (291h13m35.496188857s) [noise=true , address=145.79.227.27:4691 , piece_id=IK64GHYJWAWGIWQCHVDSIXJ2JBUDCO5IPXG2RMRN2QYSTYBIKBFA, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:36.949426400 (291h13m35.500896871s) [noise=true , address=145.79.227.23:4546 , piece_id=5EI724SIYEJYWTERBGCECK4FCBKBAHBYFK5ZFFTOOX2U3YWFVPAQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:36.950207798 (291h13m35.501678269s) [noise=true , address=145.79.227.32:4834 , piece_id=G7NC3XABUBNHQ4PUWIVATTDCXA52UHRVAFFR5T5SMUGJXHLNRDMQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:36.951330165 (291h13m35.502800616s) [noise=true , address=145.79.227.31:4798 , piece_id=H66JS2XMSEFEAR6Y3JNHWSYNAIC5TAY4H2XSFSYRUB3F363KHISQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:36.951506812 (291h13m35.502977273s) [noise=true , address=145.79.227.30:4762 , piece_id=42PF44ZJFYNSBTIAIQCSG7QD6F3CFBVX7VPZNEO46A5WAY422OIQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:36.961351768 (291h13m35.512822239s) [noise=true , address=145.79.227.21:4474 , piece_id=LSTGCNJGWF3ZIBGCCQ6NZLBG3OT64QMPXAEQIEW57ZDYFI6GKIJA, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:36.977603534 (291h13m35.529074005s) [noise=true , address=145.79.227.11:4731 , piece_id=B3VHJBDUKFVFCOWD3AFQGA6PF3TY3HBVU2EJKE7QMX5I3UWRZNYA, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:37.500785004 (291h13m36.052255465s) [noise=true , address=45.91.116.9:4263 , piece_id=IZSZ4DN6JKIQS4QYB6P6CVDEMF34QKABQDQFXC4KJVZ6OFCJKGJQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:37.529399932 (291h13m36.080870393s) [noise=true , address=77.90.31.14:4662 , piece_id=FZRS5PAKDUOTLCXFW7DCTR52TQES37B23OT3KGVYC6PIPIXGQ4IQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:37.530409875 (291h13m36.081880337s) [noise=true , address=77.90.31.17:4771 , piece_id=MAGMVAWPD5FFST5CQRSOZTB3SVVFNUNOBKUNGKSVNZG72LPPDQZA, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:37.550988410 (291h13m36.102458871s) [noise=true , address=77.90.31.10:4519 , piece_id=KZCEAXOZA2J23J3CV6UO6V2JKURBQ4BFFC2QPBTN5AQYN3SITXEQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:37.577092978 (291h13m36.128563439s) [noise=true , address=77.90.31.17:4770 , piece_id=SGH6DDHCXAWO6UHS5KWSK4CR4XTDK76EXWVIKR6WQFV3H4TCXNSQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: <nil> Nov 21 11:17:37.577121642 (291h13m36.128592113s) [seg_pos={0 0}, upload=256468]: Segment reached optimal threshold of 13 pieces. Nov 21 11:17:37.577365637 (291h13m36.128836099s) [noise=true , address=77.90.31.13:4627 , piece_id=25T2A4KV7CJCB7PDR4YPBXZPSKACQ4DAUKQUGKKBYBXVBYFGJBKQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:37668->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:37668->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37668->77.90.31.13:4627: use of closed network connection Nov 21 11:17:37.577375266 (291h13m36.128845727s) [noise=true , address=77.90.31.13:4627 , piece_id=25T2A4KV7CJCB7PDR4YPBXZPSKACQ4DAUKQUGKKBYBXVBYFGJBKQ, seg_pos={0 0}, upload=256468]: Long tail cancellation due to optimal threshold Nov 21 11:17:37.577529278 (291h13m36.128999739s) [noise=true , address=77.90.31.19:4843 , piece_id=VLXVL2GVILEKW4CTCCXKT7FK5IJLBFHFLZYSHATLKQ4U5HQOD6UQ, seg_pos={0 0}, upload=256468]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: write tcp 188.166.225.170:37480->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:37480->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37480->77.90.31.19:4843: use of closed network connection Nov 21 11:17:37.577537043 (291h13m36.129007504s) [noise=true , address=77.90.31.19:4843 , piece_id=VLXVL2GVILEKW4CTCCXKT7FK5IJLBFHFLZYSHATLKQ4U5HQOD6UQ, seg_pos={0 0}, upload=256468]: Long tail cancellation due to optimal threshold Nov 21 11:17:37.577562321 (291h13m36.129032772s) [noise=true , address=45.91.116.10:4082 , piece_id=2V3IFO3GPXRX6KRPM5CUW5XCIPQP5V36TQ3L5AOWIABLRX434UXA, seg_pos={0 0}, upload=256468]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:34728->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:34728->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34728->45.91.116.10:4082: use of closed network connection Nov 21 11:17:37.577608429 (291h13m36.12907889s) [noise=true , address=45.91.116.10:4082 , piece_id=2V3IFO3GPXRX6KRPM5CUW5XCIPQP5V36TQ3L5AOWIABLRX434UXA, seg_pos={0 0}, upload=256468]: Long tail cancellation due to optimal threshold Nov 21 11:17:37.577683212 (291h13m36.129153673s) [seg_pos={0 0}, upload=256468]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 21 11:17:37.577785848 (291h13m36.129256299s) [upload=256468]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 11:17:37.577792981 (291h13m36.129263442s) [upload=256468]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 11:17:37.864661739 (291h13m36.4161322s) [upload=256468]: Done uploading segments... Nov 21 11:17:37.864685334 (291h13m36.416155795s) [upload=256468]: Upload finished. err: <nil> Duration:* 30.005826041s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 462.35761ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:17:57 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 462.387558ms edge linksharing bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 26 out of 60 is failed (threshold=6) [..................................XXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001371641s trace: https://jaeger.dev.storj.io/trace/2d09c864d39c626b FAIL (2025-11-21 11:17:53 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.001393172s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 387.233791ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/41cfd75a627799ce FAIL (2025-11-21 11:17:50 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 387.262125ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 523.767316ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:17:48 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 523.795007ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 413.74341ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/3e5c193367f9a974 FAIL (2025-11-21 11:17:47 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 413.758849ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 483.056494ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:17:33 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 483.079338ms edge linksharing bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 25 out of 60 is failed (threshold=6) [...................................XXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000530572s trace: https://jaeger.dev.storj.io/trace/64c30b1a5426e00a FAIL (2025-11-21 11:17:26 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.000558074s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................................X...X.X......X.] duration: 5.766711644s trace: https://jaeger.dev.storj.io/trace/5967e5f889fc0cc8 FAIL (2025-11-21 11:17:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :13.136118603 (291h12m11.687589064s) [upload=256450]: Starting upload Nov 21 11:16:13.136202523 (291h12m11.687672984s) [upload=256450]: Done starting upload Nov 21 11:16:13.136248531 (291h12m11.687718992s) [upload=256450]: Uploading segments... Nov 21 11:16:13.136603406 (291h12m11.688073867s) [upload=256450]: Got next segment. Inline: false Nov 21 11:16:13.136648362 (291h12m11.688118823s) [upload=256450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 21 11:16:13.136656046 (291h12m11.688126507s) [upload=256450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 21 11:16:13.386271828 (291h12m11.937742319s) [seg_pos={0 0}, upload=256450]: Begin upload segment... Nov 21 11:16:13.386332113 (291h12m11.937802574s) [seg_pos={0 0}, upload=256450]: Done begin upload segment. Nov 21 11:16:13.386371157 (291h12m11.937841628s) [noise=true , address=145.79.227.30:4761 , piece_id=EH22ZIXAJL2JO7OJA22RM65YEJIEYYPZ44K4VOYWCJX3ETTIKZYQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.386392388 (291h12m11.937862849s) [noise=true , address=145.79.227.27:4691 , piece_id=OTLWCMN4FRTFRUN6OXKUZJZP4XMAXGATW5DGT62BTEOGQPI5YTFQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.386950120 (291h12m11.938420571s) [noise=true , address=77.90.31.13:4628 , piece_id=EB6Y5AOEZP7IS3MJHFAEC7SXFPAJEE45742YFDAWCFU245LHNNJQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.387450773 (291h12m11.938921234s) [noise=true , address=145.79.227.8:4329 , piece_id=BTPTFF6HR2WNJZ5AVFXRRS55KZZ2M2ZSC5GRTSHAHNXLWF7BU7WA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.387781083 (291h12m11.939251544s) [noise=true , address=145.79.227.23:4545 , piece_id=OSCNY3CMHDDYQR33LHWXUHF2DPMNSRF5XEV25ZVAA2364QUDKPOQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.388377067 (291h12m11.939847528s) [noise=true , address=145.79.227.26:4655 , piece_id=QEE3X66KGUYYP7RISW3Y4HUL7USMEO2NWID645V4PXDC4PC4S52Q, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.388818017 (291h12m11.940288468s) [noise=true , address=145.79.227.15:4873 , piece_id=YMNBZD55OSIPD36HLKY72JXFZFSWEZKATZ4DWDLXIXN7JNPRSC6Q, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.389407420 (291h12m11.940877881s) [noise=true , address=145.79.227.9:4367 , piece_id=ZA7LQNMHK7CEID4C5433KOHCZRDNIMGAXSBVTJLETXALQP3X7H5Q, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.389880750 (291h12m11.941351211s) [noise=true , address=77.90.31.21:4878 , piece_id=P2D4GN64M7HBDZPBOACAL7X42KVEYYYG2KKQC3SVMUXEX32PPY3Q, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.390339834 (291h12m11.941810295s) [noise=true , address=145.79.227.31:4797 , piece_id=2S2EVGTLPM2WRU6ZIDL6HNHNBQVSNAX7G7KJK55N4BQTQ3FNUCLQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.390697065 (291h12m11.942167526s) [noise=true , address=145.79.227.32:4835 , piece_id=4WH5BCGJKQLWCZXHJXJSL7S7Z47YK3MX3S5B2EQ76IQCL4UUCIFA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.390767770 (291h12m11.942238231s) [noise=true , address=145.79.227.25:4617 , piece_id=DGFQDGN66PIRQ4INS2NYUA7ON4GNRYSLATYYWZFCTGTTPMUKQPPA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.391222335 (291h12m11.942692796s) [noise=true , address=45.91.116.14:4191 , piece_id=H3JVRXP6SAKSOJ2DPMDT6RIJKRG5BYW2NOGDPD6Y4PPAKLRTDSKA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.391317225 (291h12m11.942787686s) [noise=true , address=45.91.116.4:4937 , piece_id=SKAD3SJTBL7JOANY7VDGCB3BMHWCXBH5FHK6S5BSG6OXBG4W6MVQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.391895357 (291h12m11.943365818s) [noise=true , address=77.90.31.19:4842 , piece_id=XEDXDHMEE5BRSRXS4JVHKFVXV7AZLVLQN3EHCQU4FJWFQ6FCXVPQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.393045457 (291h12m11.944515918s) [noise=true , address=45.91.116.4:4940 , piece_id=YS2G6RFW3JZAR4A7MEGCU4T7X56YY6Y4JZVY5LF6GDFRDKBRWHEA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:15.093635639 (291h12m13.64510609s) [upload=256450]: Next returned nil segment Nov 21 11:16:15.093652752 (291h12m13.645123214s) [upload=256450]: Waiting for error group managing segments... Nov 21 11:16:15.378181315 (291h12m13.929651776s) [noise=true , address=145.79.227.32:4835 , piece_id=4WH5BCGJKQLWCZXHJXJSL7S7Z47YK3MX3S5B2EQ76IQCL4UUCIFA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.381053885 (291h12m13.932524346s) [noise=true , address=145.79.227.26:4655 , piece_id=QEE3X66KGUYYP7RISW3Y4HUL7USMEO2NWID645V4PXDC4PC4S52Q, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.381395756 (291h12m13.932866217s) [noise=true , address=145.79.227.8:4329 , piece_id=BTPTFF6HR2WNJZ5AVFXRRS55KZZ2M2ZSC5GRTSHAHNXLWF7BU7WA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.385390884 (291h12m13.936861335s) [noise=true , address=145.79.227.31:4797 , piece_id=2S2EVGTLPM2WRU6ZIDL6HNHNBQVSNAX7G7KJK55N4BQTQ3FNUCLQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.387068608 (291h12m13.938539069s) [noise=true , address=145.79.227.27:4691 , piece_id=OTLWCMN4FRTFRUN6OXKUZJZP4XMAXGATW5DGT62BTEOGQPI5YTFQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.390202325 (291h12m13.941672796s) [noise=true , address=145.79.227.9:4367 , piece_id=ZA7LQNMHK7CEID4C5433KOHCZRDNIMGAXSBVTJLETXALQP3X7H5Q, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.392926923 (291h12m13.944397374s) [noise=true , address=145.79.227.25:4617 , piece_id=DGFQDGN66PIRQ4INS2NYUA7ON4GNRYSLATYYWZFCTGTTPMUKQPPA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.402220850 (291h12m13.953691311s) [noise=true , address=145.79.227.30:4761 , piece_id=EH22ZIXAJL2JO7OJA22RM65YEJIEYYPZ44K4VOYWCJX3ETTIKZYQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.414870708 (291h12m13.966341169s) [noise=true , address=145.79.227.15:4873 , piece_id=YMNBZD55OSIPD36HLKY72JXFZFSWEZKATZ4DWDLXIXN7JNPRSC6Q, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.968557735 (291h12m14.520028186s) [noise=true , address=45.91.116.14:4191 , piece_id=H3JVRXP6SAKSOJ2DPMDT6RIJKRG5BYW2NOGDPD6Y4PPAKLRTDSKA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:16.006512679 (291h12m14.55798314s) [noise=true , address=45.91.116.4:4940 , piece_id=YS2G6RFW3JZAR4A7MEGCU4T7X56YY6Y4JZVY5LF6GDFRDKBRWHEA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:16.056667853 (291h12m14.608138314s) [noise=true , address=77.90.31.19:4842 , piece_id=XEDXDHMEE5BRSRXS4JVHKFVXV7AZLVLQN3EHCQU4FJWFQ6FCXVPQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:16.061909453 (291h12m14.613379915s) [noise=true , address=77.90.31.13:4628 , piece_id=EB6Y5AOEZP7IS3MJHFAEC7SXFPAJEE45742YFDAWCFU245LHNNJQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:16.061925304 (291h12m14.613395765s) [seg_pos={0 0}, upload=256450]: Segment reached optimal threshold of 13 pieces. Nov 21 11:16:16.062185159 (291h12m14.61365562s) [noise=true , address=77.90.31.21:4878 , piece_id=P2D4GN64M7HBDZPBOACAL7X42KVEYYYG2KKQC3SVMUXEX32PPY3Q, seg_pos={0 0}, upload=256450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Nov 21 11:16:16.062194977 (291h12m14.613665438s) [noise=true , address=77.90.31.21:4878 , piece_id=P2D4GN64M7HBDZPBOACAL7X42KVEYYYG2KKQC3SVMUXEX32PPY3Q, seg_pos={0 0}, upload=256450]: Long tail cancellation due to optimal threshold Nov 21 11:16:16.062378287 (291h12m14.613848748s) [noise=true , address=145.79.227.23:4545 , piece_id=OSCNY3CMHDDYQR33LHWXUHF2DPMNSRF5XEV25ZVAA2364QUDKPOQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: write tcp 188.166.225.170:45312->145.79.227.23:4545: use of closed network connection; write tcp 188.166.225.170:45312->145.79.227.23:4545: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45312->145.79.227.23:4545: use of closed network connection Nov 21 11:16:16.062391321 (291h12m14.613861782s) [noise=true , address=145.79.227.23:4545 , piece_id=OSCNY3CMHDDYQR33LHWXUHF2DPMNSRF5XEV25ZVAA2364QUDKPOQ, seg_pos={0 0}, upload=256450]: Long tail cancellation due to optimal threshold Nov 21 11:16:16.062471814 (291h12m14.613942275s) [noise=true , address=45.91.116.4:4937 , piece_id=SKAD3SJTBL7JOANY7VDGCB3BMHWCXBH5FHK6S5BSG6OXBG4W6MVQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Nov 21 11:16:16.062479930 (291h12m14.613950391s) [noise=true , address=45.91.116.4:4937 , piece_id=SKAD3SJTBL7JOANY7VDGCB3BMHWCXBH5FHK6S5BSG6OXBG4W6MVQ, seg_pos={0 0}, upload=256450]: Long tail cancellation due to optimal threshold Nov 21 11:16:16.062498275 (291h12m14.613968736s) [seg_pos={0 0}, upload=256450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 21 11:16:16.062577485 (291h12m14.614047946s) [upload=256450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 11:16:16.062582907 (291h12m14.614053368s) [upload=256450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 11:16:16.366053778 (291h12m14.917524239s) [upload=256450]: Done uploading segments... Nov 21 11:16:16.366077823 (291h12m14.917548294s) [upload=256450]: Upload finished. err: <nil> Duration: 5.766748043s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 471.862791ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:17:12 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 471.891375ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 471.711531ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:17:07 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 471.741909ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 384.766163ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/41cfd75a627799ce FAIL (2025-11-21 11:17:04 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 384.818723ms edge linksharing bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 24 out of 60 is failed (threshold=6) [....................................XXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001219222s trace: https://jaeger.dev.storj.io/trace/36f6ae970848d47e FAIL (2025-11-21 11:16:58 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.001247356s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 455.149868ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:16:49 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 455.175217ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................................X...X.X......X] duration: 30.00548846s trace: https://jaeger.dev.storj.io/trace/5967e5f889fc0cc8 FAIL (2025-11-21 11:16:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :13.136118603 (291h12m11.687589064s) [upload=256450]: Starting upload Nov 21 11:16:13.136202523 (291h12m11.687672984s) [upload=256450]: Done starting upload Nov 21 11:16:13.136248531 (291h12m11.687718992s) [upload=256450]: Uploading segments... Nov 21 11:16:13.136603406 (291h12m11.688073867s) [upload=256450]: Got next segment. Inline: false Nov 21 11:16:13.136648362 (291h12m11.688118823s) [upload=256450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 21 11:16:13.136656046 (291h12m11.688126507s) [upload=256450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 21 11:16:13.386271828 (291h12m11.937742319s) [seg_pos={0 0}, upload=256450]: Begin upload segment... Nov 21 11:16:13.386332113 (291h12m11.937802574s) [seg_pos={0 0}, upload=256450]: Done begin upload segment. Nov 21 11:16:13.386371157 (291h12m11.937841628s) [noise=true , address=145.79.227.30:4761 , piece_id=EH22ZIXAJL2JO7OJA22RM65YEJIEYYPZ44K4VOYWCJX3ETTIKZYQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.386392388 (291h12m11.937862849s) [noise=true , address=145.79.227.27:4691 , piece_id=OTLWCMN4FRTFRUN6OXKUZJZP4XMAXGATW5DGT62BTEOGQPI5YTFQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.386950120 (291h12m11.938420571s) [noise=true , address=77.90.31.13:4628 , piece_id=EB6Y5AOEZP7IS3MJHFAEC7SXFPAJEE45742YFDAWCFU245LHNNJQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.387450773 (291h12m11.938921234s) [noise=true , address=145.79.227.8:4329 , piece_id=BTPTFF6HR2WNJZ5AVFXRRS55KZZ2M2ZSC5GRTSHAHNXLWF7BU7WA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.387781083 (291h12m11.939251544s) [noise=true , address=145.79.227.23:4545 , piece_id=OSCNY3CMHDDYQR33LHWXUHF2DPMNSRF5XEV25ZVAA2364QUDKPOQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.388377067 (291h12m11.939847528s) [noise=true , address=145.79.227.26:4655 , piece_id=QEE3X66KGUYYP7RISW3Y4HUL7USMEO2NWID645V4PXDC4PC4S52Q, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.388818017 (291h12m11.940288468s) [noise=true , address=145.79.227.15:4873 , piece_id=YMNBZD55OSIPD36HLKY72JXFZFSWEZKATZ4DWDLXIXN7JNPRSC6Q, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.389407420 (291h12m11.940877881s) [noise=true , address=145.79.227.9:4367 , piece_id=ZA7LQNMHK7CEID4C5433KOHCZRDNIMGAXSBVTJLETXALQP3X7H5Q, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.389880750 (291h12m11.941351211s) [noise=true , address=77.90.31.21:4878 , piece_id=P2D4GN64M7HBDZPBOACAL7X42KVEYYYG2KKQC3SVMUXEX32PPY3Q, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.390339834 (291h12m11.941810295s) [noise=true , address=145.79.227.31:4797 , piece_id=2S2EVGTLPM2WRU6ZIDL6HNHNBQVSNAX7G7KJK55N4BQTQ3FNUCLQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.390697065 (291h12m11.942167526s) [noise=true , address=145.79.227.32:4835 , piece_id=4WH5BCGJKQLWCZXHJXJSL7S7Z47YK3MX3S5B2EQ76IQCL4UUCIFA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.390767770 (291h12m11.942238231s) [noise=true , address=145.79.227.25:4617 , piece_id=DGFQDGN66PIRQ4INS2NYUA7ON4GNRYSLATYYWZFCTGTTPMUKQPPA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.391222335 (291h12m11.942692796s) [noise=true , address=45.91.116.14:4191 , piece_id=H3JVRXP6SAKSOJ2DPMDT6RIJKRG5BYW2NOGDPD6Y4PPAKLRTDSKA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.391317225 (291h12m11.942787686s) [noise=true , address=45.91.116.4:4937 , piece_id=SKAD3SJTBL7JOANY7VDGCB3BMHWCXBH5FHK6S5BSG6OXBG4W6MVQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.391895357 (291h12m11.943365818s) [noise=true , address=77.90.31.19:4842 , piece_id=XEDXDHMEE5BRSRXS4JVHKFVXV7AZLVLQN3EHCQU4FJWFQ6FCXVPQ, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:13.393045457 (291h12m11.944515918s) [noise=true , address=45.91.116.4:4940 , piece_id=YS2G6RFW3JZAR4A7MEGCU4T7X56YY6Y4JZVY5LF6GDFRDKBRWHEA, seg_pos={0 0}, upload=256450]: Uploading piece... Nov 21 11:16:15.093635639 (291h12m13.64510609s) [upload=256450]: Next returned nil segment Nov 21 11:16:15.093652752 (291h12m13.645123214s) [upload=256450]: Waiting for error group managing segments... Nov 21 11:16:15.378181315 (291h12m13.929651776s) [noise=true , address=145.79.227.32:4835 , piece_id=4WH5BCGJKQLWCZXHJXJSL7S7Z47YK3MX3S5B2EQ76IQCL4UUCIFA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.381053885 (291h12m13.932524346s) [noise=true , address=145.79.227.26:4655 , piece_id=QEE3X66KGUYYP7RISW3Y4HUL7USMEO2NWID645V4PXDC4PC4S52Q, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.381395756 (291h12m13.932866217s) [noise=true , address=145.79.227.8:4329 , piece_id=BTPTFF6HR2WNJZ5AVFXRRS55KZZ2M2ZSC5GRTSHAHNXLWF7BU7WA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.385390884 (291h12m13.936861335s) [noise=true , address=145.79.227.31:4797 , piece_id=2S2EVGTLPM2WRU6ZIDL6HNHNBQVSNAX7G7KJK55N4BQTQ3FNUCLQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.387068608 (291h12m13.938539069s) [noise=true , address=145.79.227.27:4691 , piece_id=OTLWCMN4FRTFRUN6OXKUZJZP4XMAXGATW5DGT62BTEOGQPI5YTFQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.390202325 (291h12m13.941672796s) [noise=true , address=145.79.227.9:4367 , piece_id=ZA7LQNMHK7CEID4C5433KOHCZRDNIMGAXSBVTJLETXALQP3X7H5Q, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.392926923 (291h12m13.944397374s) [noise=true , address=145.79.227.25:4617 , piece_id=DGFQDGN66PIRQ4INS2NYUA7ON4GNRYSLATYYWZFCTGTTPMUKQPPA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.402220850 (291h12m13.953691311s) [noise=true , address=145.79.227.30:4761 , piece_id=EH22ZIXAJL2JO7OJA22RM65YEJIEYYPZ44K4VOYWCJX3ETTIKZYQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.414870708 (291h12m13.966341169s) [noise=true , address=145.79.227.15:4873 , piece_id=YMNBZD55OSIPD36HLKY72JXFZFSWEZKATZ4DWDLXIXN7JNPRSC6Q, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:15.968557735 (291h12m14.520028186s) [noise=true , address=45.91.116.14:4191 , piece_id=H3JVRXP6SAKSOJ2DPMDT6RIJKRG5BYW2NOGDPD6Y4PPAKLRTDSKA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:16.006512679 (291h12m14.55798314s) [noise=true , address=45.91.116.4:4940 , piece_id=YS2G6RFW3JZAR4A7MEGCU4T7X56YY6Y4JZVY5LF6GDFRDKBRWHEA, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:16.056667853 (291h12m14.608138314s) [noise=true , address=77.90.31.19:4842 , piece_id=XEDXDHMEE5BRSRXS4JVHKFVXV7AZLVLQN3EHCQU4FJWFQ6FCXVPQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:16.061909453 (291h12m14.613379915s) [noise=true , address=77.90.31.13:4628 , piece_id=EB6Y5AOEZP7IS3MJHFAEC7SXFPAJEE45742YFDAWCFU245LHNNJQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: <nil> Nov 21 11:16:16.061925304 (291h12m14.613395765s) [seg_pos={0 0}, upload=256450]: Segment reached optimal threshold of 13 pieces. Nov 21 11:16:16.062185159 (291h12m14.61365562s) [noise=true , address=77.90.31.21:4878 , piece_id=P2D4GN64M7HBDZPBOACAL7X42KVEYYYG2KKQC3SVMUXEX32PPY3Q, seg_pos={0 0}, upload=256450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Nov 21 11:16:16.062194977 (291h12m14.613665438s) [noise=true , address=77.90.31.21:4878 , piece_id=P2D4GN64M7HBDZPBOACAL7X42KVEYYYG2KKQC3SVMUXEX32PPY3Q, seg_pos={0 0}, upload=256450]: Long tail cancellation due to optimal threshold Nov 21 11:16:16.062378287 (291h12m14.613848748s) [noise=true , address=145.79.227.23:4545 , piece_id=OSCNY3CMHDDYQR33LHWXUHF2DPMNSRF5XEV25ZVAA2364QUDKPOQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: write tcp 188.166.225.170:45312->145.79.227.23:4545: use of closed network connection; write tcp 188.166.225.170:45312->145.79.227.23:4545: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45312->145.79.227.23:4545: use of closed network connection Nov 21 11:16:16.062391321 (291h12m14.613861782s) [noise=true , address=145.79.227.23:4545 , piece_id=OSCNY3CMHDDYQR33LHWXUHF2DPMNSRF5XEV25ZVAA2364QUDKPOQ, seg_pos={0 0}, upload=256450]: Long tail cancellation due to optimal threshold Nov 21 11:16:16.062471814 (291h12m14.613942275s) [noise=true , address=45.91.116.4:4937 , piece_id=SKAD3SJTBL7JOANY7VDGCB3BMHWCXBH5FHK6S5BSG6OXBG4W6MVQ, seg_pos={0 0}, upload=256450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Nov 21 11:16:16.062479930 (291h12m14.613950391s) [noise=true , address=45.91.116.4:4937 , piece_id=SKAD3SJTBL7JOANY7VDGCB3BMHWCXBH5FHK6S5BSG6OXBG4W6MVQ, seg_pos={0 0}, upload=256450]: Long tail cancellation due to optimal threshold Nov 21 11:16:16.062498275 (291h12m14.613968736s) [seg_pos={0 0}, upload=256450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 21 11:16:16.062577485 (291h12m14.614047946s) [upload=256450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 11:16:16.062582907 (291h12m14.614053368s) [upload=256450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 11:16:16.366053778 (291h12m14.917524239s) [upload=256450]: Done uploading segments... Nov 21 11:16:16.366077823 (291h12m14.917548294s) [upload=256450]: Upload finished. err: <nil> Duration: 30.005516544s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 381.624059ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/3e5c193367f9a974 FAIL (2025-11-21 11:16:41 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 381.660989ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 476.241828ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:16:23 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 476.2741ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 23 out of 60 is failed (threshold=6) [.....................................XXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000254515s trace: https://jaeger.dev.storj.io/trace/75a6dd39fc3e115e FAIL (2025-11-21 11:16:20 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.000281296s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 389.339249ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/41cfd75a627799ce FAIL (2025-11-21 11:16:09 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 389.369429ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 470.326194ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:16:04 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 470.381209ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 464.073097ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:16:00 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 464.10064ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 405.613951ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/41cfd75a627799ce FAIL (2025-11-21 11:15:44 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 405.635943ms edge linksharing bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 22 out of 60 is failed (threshold=6) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration: 5.001674198s trace: https://jaeger.dev.storj.io/trace/4927527cba36a2a6 FAIL (2025-11-21 11:15:38 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.001689637s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 392.295879ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/3e5c193367f9a974 FAIL (2025-11-21 11:15:29 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 392.328041ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 21 out of 60 is failed (threshold=6) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration: 5.001875583s trace: https://jaeger.dev.storj.io/trace/5cb7620721037365 FAIL (2025-11-21 11:15:15 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.001923394s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................................X...X.X......] duration: 6.367107704s trace: https://jaeger.dev.storj.io/trace/53af3f8a88cd49e5 FAIL (2025-11-21 11:15:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, Piece ID: CBXNWX6CTUXLVZIEDAUGBU4KGOYX4YE7VBU23FPNCDROUZCI7KYQ) context deadline exceeded; piecestore: (Node ID: 12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, Piece ID: 4HMLZG46CZKWMGWBDQEPBZU3JXFG7CMTEOLD76E22ZK37JTZTRPA) context deadline exceeded ======LOGS====== Nov 21 11:10:37.417909458 (291h6m35.969379919s) [upload=256367]: Starting upload Nov 21 11:10:37.417990373 (291h6m35.969460834s) [upload=256367]: Done starting upload Nov 21 11:10:37.418265637 (291h6m35.969736098s) [upload=256367]: Uploading segments... Nov 21 11:10:37.418320020 (291h6m35.969790501s) [upload=256367]: Got next segment. Inline: false Nov 21 11:10:37.418366208 (291h6m35.969836669s) [upload=256367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 21 11:10:37.418372090 (291h6m35.969842551s) [upload=256367]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 21 11:10:37.664136069 (291h6m36.21560654s) [seg_pos={0 0}, upload=256367]: Begin upload segment... Nov 21 11:10:37.664192046 (291h6m36.215662497s) [seg_pos={0 0}, upload=256367]: Done begin upload segment. Nov 21 11:10:37.664226261 (291h6m36.215696722s) [noise=true , address=45.91.116.11:4117 , piece_id=JNEX5OPGYKGVIIL6AJ2T7FRNL5N2NWBJW52KLLWXSJK2V233P4EQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.664643666 (291h6m36.216114127s) [noise=true , address=145.79.227.8:4331 , piece_id=EUGY73KZM6FPYFHP23RLOKIHUY4FOGRXGBHH5FDNWZQFRKBL2HYA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.665454219 (291h6m36.21692468s) [noise=true , address=145.79.227.25:4617 , piece_id=UY3TX5WWAG7SCGPAPX2J23JPUBBSCFWI7BKJV54U3ZT5XOU7M7NQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.665949191 (291h6m36.217419652s) [noise=true , address=145.79.227.9:4366 , piece_id=BF7ZBLQR763VFUUNYG5MFLA3M5HLCACCNBOPAOBDNZWXQO3QLQLA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.666395261 (291h6m36.217865712s) [noise=true , address=145.79.227.22:4511 , piece_id=Q5RF2BAVML7M3LKV6FM4SOEYI7OXZJX6ORUUCGC63GTA2OQR6FZA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.666855948 (291h6m36.218326409s) [noise=true , address=145.79.227.25:4619 , piece_id=5CAGDLXVUSIJO3RSUJUK732AQX46Y5LV53EKQ3SBSOPIGNPVHUIQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.667265478 (291h6m36.218735929s) [noise=true , address=145.79.227.23:4546 , piece_id=YAWCTSN44BRFJB4BD7OG2USFR6HJRXG2L3N6YAUVNOLIND5HKPVA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.669892209 (291h6m36.22136268s) [noise=true , address=145.79.227.28:4726 , piece_id=NZY53PEG4PTS23FOCT4TEVQPFHVA55XA2BAC7K7IH54VXMGJSHTQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.672216515 (291h6m36.223686976s) [noise=true , address=77.90.31.15:4699 , piece_id=QFLMO3D7XKPOMQEX47YU5VZRAEBZBYTUGZRGGTHY7QJKWNXEFFVA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.674139548 (291h6m36.225610009s) [noise=true , address=77.90.31.19:4843 , piece_id=CBXNWX6CTUXLVZIEDAUGBU4KGOYX4YE7VBU23FPNCDROUZCI7KYQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.676636602 (291h6m36.228107053s) [noise=true , address=145.79.227.28:4727 , piece_id=QO4JSFIA4TNVXEVHSDFKWVABMREA2HGEWJMJUOZFBMDYTUAVIFDA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.678623706 (291h6m36.230094167s) [noise=true , address=45.91.116.5:4298 , piece_id=4HMLZG46CZKWMGWBDQEPBZU3JXFG7CMTEOLD76E22ZK37JTZTRPA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.680460594 (291h6m36.231931055s) [noise=true , address=145.79.227.16:4912 , piece_id=3GEQBSELBUVEYYDOGJVX4QTPXPPAEKAW7BNXZ4IH6L6KQATKNV2A, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.680690572 (291h6m36.232161033s) [noise=true , address=145.79.227.30:4761 , piece_id=R5GHCXBMSHNUENMPU7LWZUXWFHOJSENXCKNMMKQEXLMYBK7RVQDA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.682475210 (291h6m36.233945661s) [noise=true , address=77.90.31.21:4877 , piece_id=MQI2ONSMXU7G6J6V2XAOGF2OB2EYSB2455CV6KL76JL5VP7SYFKQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.683107484 (291h6m36.234577975s) [noise=true , address=77.90.31.18:4806 , piece_id=MXP3BXFOJMS63C6SXKTILBC6UGV4AIYKRA3YJK3OFWBHYWHEN33A, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:39.375241073 (291h6m37.926711534s) [upload=256367]: Next returned nil segment Nov 21 11:10:39.375268265 (291h6m37.926738736s) [upload=256367]: Waiting for error group managing segments... Nov 21 11:10:39.658560142 (291h6m38.210030613s) [noise=true , address=145.79.227.9:4366 , piece_id=BF7ZBLQR763VFUUNYG5MFLA3M5HLCACCNBOPAOBDNZWXQO3QLQLA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.664174503 (291h6m38.215644974s) [noise=true , address=145.79.227.8:4331 , piece_id=EUGY73KZM6FPYFHP23RLOKIHUY4FOGRXGBHH5FDNWZQFRKBL2HYA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.674556161 (291h6m38.226026642s) [noise=true , address=145.79.227.25:4617 , piece_id=UY3TX5WWAG7SCGPAPX2J23JPUBBSCFWI7BKJV54U3ZT5XOU7M7NQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.676547513 (291h6m38.228017974s) [noise=true , address=145.79.227.25:4619 , piece_id=5CAGDLXVUSIJO3RSUJUK732AQX46Y5LV53EKQ3SBSOPIGNPVHUIQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.677416066 (291h6m38.228886538s) [noise=true , address=145.79.227.16:4912 , piece_id=3GEQBSELBUVEYYDOGJVX4QTPXPPAEKAW7BNXZ4IH6L6KQATKNV2A, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.679926346 (291h6m38.231396807s) [noise=true , address=145.79.227.30:4761 , piece_id=R5GHCXBMSHNUENMPU7LWZUXWFHOJSENXCKNMMKQEXLMYBK7RVQDA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.680870114 (291h6m38.232340575s) [noise=true , address=145.79.227.22:4511 , piece_id=Q5RF2BAVML7M3LKV6FM4SOEYI7OXZJX6ORUUCGC63GTA2OQR6FZA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.686043635 (291h6m38.237514096s) [noise=true , address=145.79.227.23:4546 , piece_id=YAWCTSN44BRFJB4BD7OG2USFR6HJRXG2L3N6YAUVNOLIND5HKPVA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.702043572 (291h6m38.253514033s) [noise=true , address=145.79.227.28:4726 , piece_id=NZY53PEG4PTS23FOCT4TEVQPFHVA55XA2BAC7K7IH54VXMGJSHTQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.711047487 (291h6m38.262517948s) [noise=true , address=145.79.227.28:4727 , piece_id=QO4JSFIA4TNVXEVHSDFKWVABMREA2HGEWJMJUOZFBMDYTUAVIFDA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:40.215943467 (291h6m38.767413929s) [noise=true , address=45.91.116.5:4298 , piece_id=4HMLZG46CZKWMGWBDQEPBZU3JXFG7CMTEOLD76E22ZK37JTZTRPA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:40.259670312 (291h6m38.811140783s) [noise=true , address=77.90.31.15:4699 , piece_id=QFLMO3D7XKPOMQEX47YU5VZRAEBZBYTUGZRGGTHY7QJKWNXEFFVA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:40.327151477 (291h6m38.878621928s) [noise=true , address=77.90.31.19:4843 , piece_id=CBXNWX6CTUXLVZIEDAUGBU4KGOYX4YE7VBU23FPNCDROUZCI7KYQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:40.327178769 (291h6m38.87864923s) [seg_pos={0 0}, upload=256367]: Segment reached optimal threshold of 13 pieces. Nov 21 11:10:40.327436179 (291h6m38.87890665s) [noise=true , address=77.90.31.18:4806 , piece_id=MXP3BXFOJMS63C6SXKTILBC6UGV4AIYKRA3YJK3OFWBHYWHEN33A, seg_pos={0 0}, upload=256367]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Nov 21 11:10:40.327446820 (291h6m38.878917281s) [noise=true , address=77.90.31.18:4806 , piece_id=MXP3BXFOJMS63C6SXKTILBC6UGV4AIYKRA3YJK3OFWBHYWHEN33A, seg_pos={0 0}, upload=256367]: Long tail cancellation due to optimal threshold Nov 21 11:10:40.327472790 (291h6m38.878943251s) [noise=true , address=77.90.31.21:4877 , piece_id=MQI2ONSMXU7G6J6V2XAOGF2OB2EYSB2455CV6KL76JL5VP7SYFKQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Nov 21 11:10:40.327482318 (291h6m38.878952779s) [noise=true , address=77.90.31.21:4877 , piece_id=MQI2ONSMXU7G6J6V2XAOGF2OB2EYSB2455CV6KL76JL5VP7SYFKQ, seg_pos={0 0}, upload=256367]: Long tail cancellation due to optimal threshold Nov 21 11:10:40.327721723 (291h6m38.879192185s) [noise=true , address=45.91.116.11:4117 , piece_id=JNEX5OPGYKGVIIL6AJ2T7FRNL5N2NWBJW52KLLWXSJK2V233P4EQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:57976->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:57976->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57976->45.91.116.11:4117: use of closed network connection Nov 21 11:10:40.327735429 (291h6m38.87920589s) [noise=true , address=45.91.116.11:4117 , piece_id=JNEX5OPGYKGVIIL6AJ2T7FRNL5N2NWBJW52KLLWXSJK2V233P4EQ, seg_pos={0 0}, upload=256367]: Long tail cancellation due to optimal threshold Nov 21 11:10:40.327760688 (291h6m38.879231149s) [seg_pos={0 0}, upload=256367]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 21 11:10:40.327873803 (291h6m38.879344264s) [upload=256367]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 11:10:40.327881768 (291h6m38.879352239s) [upload=256367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 11:10:40.631461627 (291h6m39.182932128s) [upload=256367]: Done uploading segments... Nov 21 11:10:40.631493278 (291h6m39.182963749s) [upload=256367]: Upload finished. err: <nil> Duration: 6.367136868s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 384.538589ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/41cfd75a627799ce FAIL (2025-11-21 11:15:10 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 384.58131ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 543.668601ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:15:09 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 543.686836ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [............................................X...............] duration: 456.738249ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:14:57 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 456.766894ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.............................................X..............] duration: 458.592711ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:14:36 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 458.619663ms edge linksharing bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................................X...X.X.....] duration: 14.645210948s trace: https://jaeger.dev.storj.io/trace/53af3f8a88cd49e5 FAIL (2025-11-21 11:14:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, Piece ID: CBXNWX6CTUXLVZIEDAUGBU4KGOYX4YE7VBU23FPNCDROUZCI7KYQ) context deadline exceeded; piecestore: (Node ID: 12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, Piece ID: 4HMLZG46CZKWMGWBDQEPBZU3JXFG7CMTEOLD76E22ZK37JTZTRPA) context deadline exceeded ======LOGS====== Nov 21 11:10:37.417909458 (291h6m35.969379919s) [upload=256367]: Starting upload Nov 21 11:10:37.417990373 (291h6m35.969460834s) [upload=256367]: Done starting upload Nov 21 11:10:37.418265637 (291h6m35.969736098s) [upload=256367]: Uploading segments... Nov 21 11:10:37.418320020 (291h6m35.969790501s) [upload=256367]: Got next segment. Inline: false Nov 21 11:10:37.418366208 (291h6m35.969836669s) [upload=256367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 21 11:10:37.418372090 (291h6m35.969842551s) [upload=256367]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 21 11:10:37.664136069 (291h6m36.21560654s) [seg_pos={0 0}, upload=256367]: Begin upload segment... Nov 21 11:10:37.664192046 (291h6m36.215662497s) [seg_pos={0 0}, upload=256367]: Done begin upload segment. Nov 21 11:10:37.664226261 (291h6m36.215696722s) [noise=true , address=45.91.116.11:4117 , piece_id=JNEX5OPGYKGVIIL6AJ2T7FRNL5N2NWBJW52KLLWXSJK2V233P4EQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.664643666 (291h6m36.216114127s) [noise=true , address=145.79.227.8:4331 , piece_id=EUGY73KZM6FPYFHP23RLOKIHUY4FOGRXGBHH5FDNWZQFRKBL2HYA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.665454219 (291h6m36.21692468s) [noise=true , address=145.79.227.25:4617 , piece_id=UY3TX5WWAG7SCGPAPX2J23JPUBBSCFWI7BKJV54U3ZT5XOU7M7NQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.665949191 (291h6m36.217419652s) [noise=true , address=145.79.227.9:4366 , piece_id=BF7ZBLQR763VFUUNYG5MFLA3M5HLCACCNBOPAOBDNZWXQO3QLQLA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.666395261 (291h6m36.217865712s) [noise=true , address=145.79.227.22:4511 , piece_id=Q5RF2BAVML7M3LKV6FM4SOEYI7OXZJX6ORUUCGC63GTA2OQR6FZA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.666855948 (291h6m36.218326409s) [noise=true , address=145.79.227.25:4619 , piece_id=5CAGDLXVUSIJO3RSUJUK732AQX46Y5LV53EKQ3SBSOPIGNPVHUIQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.667265478 (291h6m36.218735929s) [noise=true , address=145.79.227.23:4546 , piece_id=YAWCTSN44BRFJB4BD7OG2USFR6HJRXG2L3N6YAUVNOLIND5HKPVA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.669892209 (291h6m36.22136268s) [noise=true , address=145.79.227.28:4726 , piece_id=NZY53PEG4PTS23FOCT4TEVQPFHVA55XA2BAC7K7IH54VXMGJSHTQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.672216515 (291h6m36.223686976s) [noise=true , address=77.90.31.15:4699 , piece_id=QFLMO3D7XKPOMQEX47YU5VZRAEBZBYTUGZRGGTHY7QJKWNXEFFVA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.674139548 (291h6m36.225610009s) [noise=true , address=77.90.31.19:4843 , piece_id=CBXNWX6CTUXLVZIEDAUGBU4KGOYX4YE7VBU23FPNCDROUZCI7KYQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.676636602 (291h6m36.228107053s) [noise=true , address=145.79.227.28:4727 , piece_id=QO4JSFIA4TNVXEVHSDFKWVABMREA2HGEWJMJUOZFBMDYTUAVIFDA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.678623706 (291h6m36.230094167s) [noise=true , address=45.91.116.5:4298 , piece_id=4HMLZG46CZKWMGWBDQEPBZU3JXFG7CMTEOLD76E22ZK37JTZTRPA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.680460594 (291h6m36.231931055s) [noise=true , address=145.79.227.16:4912 , piece_id=3GEQBSELBUVEYYDOGJVX4QTPXPPAEKAW7BNXZ4IH6L6KQATKNV2A, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.680690572 (291h6m36.232161033s) [noise=true , address=145.79.227.30:4761 , piece_id=R5GHCXBMSHNUENMPU7LWZUXWFHOJSENXCKNMMKQEXLMYBK7RVQDA, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.682475210 (291h6m36.233945661s) [noise=true , address=77.90.31.21:4877 , piece_id=MQI2ONSMXU7G6J6V2XAOGF2OB2EYSB2455CV6KL76JL5VP7SYFKQ, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:37.683107484 (291h6m36.234577975s) [noise=true , address=77.90.31.18:4806 , piece_id=MXP3BXFOJMS63C6SXKTILBC6UGV4AIYKRA3YJK3OFWBHYWHEN33A, seg_pos={0 0}, upload=256367]: Uploading piece... Nov 21 11:10:39.375241073 (291h6m37.926711534s) [upload=256367]: Next returned nil segment Nov 21 11:10:39.375268265 (291h6m37.926738736s) [upload=256367]: Waiting for error group managing segments... Nov 21 11:10:39.658560142 (291h6m38.210030613s) [noise=true , address=145.79.227.9:4366 , piece_id=BF7ZBLQR763VFUUNYG5MFLA3M5HLCACCNBOPAOBDNZWXQO3QLQLA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.664174503 (291h6m38.215644974s) [noise=true , address=145.79.227.8:4331 , piece_id=EUGY73KZM6FPYFHP23RLOKIHUY4FOGRXGBHH5FDNWZQFRKBL2HYA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.674556161 (291h6m38.226026642s) [noise=true , address=145.79.227.25:4617 , piece_id=UY3TX5WWAG7SCGPAPX2J23JPUBBSCFWI7BKJV54U3ZT5XOU7M7NQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.676547513 (291h6m38.228017974s) [noise=true , address=145.79.227.25:4619 , piece_id=5CAGDLXVUSIJO3RSUJUK732AQX46Y5LV53EKQ3SBSOPIGNPVHUIQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.677416066 (291h6m38.228886538s) [noise=true , address=145.79.227.16:4912 , piece_id=3GEQBSELBUVEYYDOGJVX4QTPXPPAEKAW7BNXZ4IH6L6KQATKNV2A, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.679926346 (291h6m38.231396807s) [noise=true , address=145.79.227.30:4761 , piece_id=R5GHCXBMSHNUENMPU7LWZUXWFHOJSENXCKNMMKQEXLMYBK7RVQDA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.680870114 (291h6m38.232340575s) [noise=true , address=145.79.227.22:4511 , piece_id=Q5RF2BAVML7M3LKV6FM4SOEYI7OXZJX6ORUUCGC63GTA2OQR6FZA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.686043635 (291h6m38.237514096s) [noise=true , address=145.79.227.23:4546 , piece_id=YAWCTSN44BRFJB4BD7OG2USFR6HJRXG2L3N6YAUVNOLIND5HKPVA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.702043572 (291h6m38.253514033s) [noise=true , address=145.79.227.28:4726 , piece_id=NZY53PEG4PTS23FOCT4TEVQPFHVA55XA2BAC7K7IH54VXMGJSHTQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:39.711047487 (291h6m38.262517948s) [noise=true , address=145.79.227.28:4727 , piece_id=QO4JSFIA4TNVXEVHSDFKWVABMREA2HGEWJMJUOZFBMDYTUAVIFDA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:40.215943467 (291h6m38.767413929s) [noise=true , address=45.91.116.5:4298 , piece_id=4HMLZG46CZKWMGWBDQEPBZU3JXFG7CMTEOLD76E22ZK37JTZTRPA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:40.259670312 (291h6m38.811140783s) [noise=true , address=77.90.31.15:4699 , piece_id=QFLMO3D7XKPOMQEX47YU5VZRAEBZBYTUGZRGGTHY7QJKWNXEFFVA, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:40.327151477 (291h6m38.878621928s) [noise=true , address=77.90.31.19:4843 , piece_id=CBXNWX6CTUXLVZIEDAUGBU4KGOYX4YE7VBU23FPNCDROUZCI7KYQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: <nil> Nov 21 11:10:40.327178769 (291h6m38.87864923s) [seg_pos={0 0}, upload=256367]: Segment reached optimal threshold of 13 pieces. Nov 21 11:10:40.327436179 (291h6m38.87890665s) [noise=true , address=77.90.31.18:4806 , piece_id=MXP3BXFOJMS63C6SXKTILBC6UGV4AIYKRA3YJK3OFWBHYWHEN33A, seg_pos={0 0}, upload=256367]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Nov 21 11:10:40.327446820 (291h6m38.878917281s) [noise=true , address=77.90.31.18:4806 , piece_id=MXP3BXFOJMS63C6SXKTILBC6UGV4AIYKRA3YJK3OFWBHYWHEN33A, seg_pos={0 0}, upload=256367]: Long tail cancellation due to optimal threshold Nov 21 11:10:40.327472790 (291h6m38.878943251s) [noise=true , address=77.90.31.21:4877 , piece_id=MQI2ONSMXU7G6J6V2XAOGF2OB2EYSB2455CV6KL76JL5VP7SYFKQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Nov 21 11:10:40.327482318 (291h6m38.878952779s) [noise=true , address=77.90.31.21:4877 , piece_id=MQI2ONSMXU7G6J6V2XAOGF2OB2EYSB2455CV6KL76JL5VP7SYFKQ, seg_pos={0 0}, upload=256367]: Long tail cancellation due to optimal threshold Nov 21 11:10:40.327721723 (291h6m38.879192185s) [noise=true , address=45.91.116.11:4117 , piece_id=JNEX5OPGYKGVIIL6AJ2T7FRNL5N2NWBJW52KLLWXSJK2V233P4EQ, seg_pos={0 0}, upload=256367]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6): protocol: write tcp 188.166.225.170:57976->45.91.116.11:4117: use of closed network connection; write tcp 188.166.225.170:57976->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57976->45.91.116.11:4117: use of closed network connection Nov 21 11:10:40.327735429 (291h6m38.87920589s) [noise=true , address=45.91.116.11:4117 , piece_id=JNEX5OPGYKGVIIL6AJ2T7FRNL5N2NWBJW52KLLWXSJK2V233P4EQ, seg_pos={0 0}, upload=256367]: Long tail cancellation due to optimal threshold Nov 21 11:10:40.327760688 (291h6m38.879231149s) [seg_pos={0 0}, upload=256367]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 21 11:10:40.327873803 (291h6m38.879344264s) [upload=256367]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 21 11:10:40.327881768 (291h6m38.879352239s) [upload=256367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 21 11:10:40.631461627 (291h6m39.182932128s) [upload=256367]: Done uploading segments... Nov 21 11:10:40.631493278 (291h6m39.182963749s) [upload=256367]: Upload finished. err: <nil> Duration: 14.645244692s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 457.633445ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/5285054b3a776da7 FAIL (2025-11-21 11:14:33 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 457.667139ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 805.288762ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/3d967bc11165dc1c FAIL (2025-11-21 11:14:27 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": context deadline exceeded Duration: 805.316544ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 387.596363ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/3e5c193367f9a974 FAIL (2025-11-21 11:14:25 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 387.622543ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..............................................X.............] duration: 465.410473ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/e2bae25cf885024 FAIL (2025-11-21 11:14:19 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 465.443587ms edge linksharing bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 20 out of 60 is failed (threshold=6) [........................................XXXXXXXXXXXXXXXXXXXX] duration: 5.001020633s trace: https://jaeger.dev.storj.io/trace/644eb7a994f13475 FAIL (2025-11-21 11:14:18 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.001060166s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [............................................X...............] duration: 392.397554ms remote: "tcp:207.211.208.129:443" target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/41cfd75a627799ce FAIL (2025-11-21 11:14:03 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 392.417392ms edge linksharing bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 19 out of 60 is failed (threshold=6) [.........................................XXXXXXXXXXXXXXXXXXX] duration: 5.005866091s trace: https://jaeger.dev.storj.io/trace/1f30b4b6c6088b66 FAIL (2025-11-21 11:14:00 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.005893744s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 438.485424ms remote: "tcp:207.211.208.129:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/3e5c193367f9a974 FAIL (2025-11-21 11:13:57 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 438.512174ms edge gateway vhost bgp us1

Orbiter Check History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)