Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 4 out of 60 is failed (threshold=3) [............................................XX...X......X...] duration: 44.019515945s FAIL (2025-08-26 05:23:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:18.000025717 (13h16m45.158791451s) [upload=11637]: Starting upload Aug 26 05:20:18.000093988 (13h16m45.158859722s) [upload=11637]: Done starting upload Aug 26 05:20:18.000148342 (13h16m45.158914066s) [upload=11637]: Uploading segments... Aug 26 05:20:18.000183359 (13h16m45.158949093s) [upload=11637]: Got next segment. Inline: true Aug 26 05:20:18.000256940 (13h16m45.159022674s) [upload=11637]: Waiting for error group managing segments... Aug 26 05:20:18.000297667 (13h16m45.159063401s) [upload=11637]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:18.000302246 (13h16m45.15906798s) [upload=11637]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:20:18.000305281 (13h16m45.159071015s) [upload=11637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:39.528469747 (13h17m6.687235481s) [upload=11637]: Done uploading segments... Aug 26 05:20:39.528487431 (13h17m6.687253165s) [upload=11637]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 44.019531004s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [.........................X................XX...........X...X] duration: 913.654871ms remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=RMGXTFc2jnS Date=Tue, 26 Aug 2025 05:23:37 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Headers=* target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:23:37 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 913.677373ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 17 out of 60 is failed (threshold=3) [......................XXX....XX........XX..XX.XXXX...XXX..X.] duration: 29.124456702s FAIL (2025-08-26 05:23:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:22:24.692908479 (13h18m51.851674213s) [upload=11664]: Starting upload Aug 26 05:22:24.692965057 (13h18m51.851730791s) [upload=11664]: Done starting upload Aug 26 05:22:24.693021445 (13h18m51.851787179s) [upload=11664]: Uploading segments... Aug 26 05:22:24.693067183 (13h18m51.851832917s) [upload=11664]: Got next segment. Inline: true Aug 26 05:22:24.693071240 (13h18m51.851836974s) [upload=11664]: Waiting for error group managing segments... Aug 26 05:22:24.693106998 (13h18m51.851872722s) [upload=11664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:22:24.693111296 (13h18m51.85187703s) [upload=11664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:22:24.693113791 (13h18m51.851879525s) [upload=11664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:22:54.044453623 (13h19m21.203219357s) [upload=11664]: Done uploading segments... Aug 26 05:22:54.044470575 (13h19m21.203236309s) [upload=11664]: Upload finished. err: metaclient: context deadline exceeded Duration:* 29.124477482s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [..............................X.........X..X..XXX...........] duration: 1.513611921s remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:15:21 GMT Content-Length=423 Server=Storj X-Amz-Request-Id=185F393E89D07B67 X-Request-Id=WURxSo7gKen target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:23:21 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F393E89D07B67</RequestId><HostId></HostId></Error>" Duration: 1.513628322s edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [..........................X.X...X.......XXX.X..XXX......X.X.] duration: 13.187118912s FAIL (2025-08-26 05:23:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 13.187204043s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [...............................X.........X..X..XXX..........] duration: 35.976427239s remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:15:21 GMT Content-Length=423 Server=Storj X-Amz-Request-Id=185F393E89D07B67 X-Request-Id=WURxSo7gKen target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:23:19 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F393E89D07B67</RequestId><HostId></HostId></Error>" Duration: 35.976458098s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 15 out of 60 is failed (threshold=3) [....................XXX.....XX.........XXX.X.XXX..XX.......X] duration: 30.006420395s FAIL (2025-08-26 05:23:18 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.006444362s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..................XXX...X..............X.X...XXX....XXX.....] duration: 23.895975411s FAIL (2025-08-26 05:23:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:20.009104374 (13h16m47.167870108s) [upload=11638]: Starting upload Aug 26 05:20:20.009177123 (13h16m47.167942857s) [upload=11638]: Done starting upload Aug 26 05:20:20.009487938 (13h16m47.168253772s) [upload=11638]: Uploading segments... Aug 26 05:20:20.009551900 (13h16m47.168317634s) [upload=11638]: Got next segment. Inline: false Aug 26 05:20:20.009587307 (13h16m47.168353041s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:20.009592938 (13h16m47.168358692s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:24.249473770 (13h16m51.408239504s) [seg_pos={0 0}, upload=11638]: Begin upload segment... Aug 26 05:20:24.249510921 (13h16m51.408276645s) [seg_pos={0 0}, upload=11638]: Done begin upload segment. Aug 26 05:20:24.249529397 (13h16m51.408295131s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249545949 (13h16m51.408311683s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249880088 (13h16m51.408645822s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249941786 (13h16m51.40870752s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250105790 (13h16m51.408871524s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250213606 (13h16m51.40897933s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250326021 (13h16m51.409091755s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250484965 (13h16m51.409250699s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250541844 (13h16m51.409307578s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250759721 (13h16m51.409525455s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250809266 (13h16m51.409575s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250970333 (13h16m51.409736067s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251052360 (13h16m51.409818094s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251279666 (13h16m51.4100454s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251521318 (13h16m51.410287042s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251737351 (13h16m51.410503085s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:25.976881200 (13h16m53.135646934s) [upload=11638]: Next returned nil segment Aug 26 05:20:25.976899275 (13h16m53.135665009s) [upload=11638]: Waiting for error group managing segments... Aug 26 05:20:26.279055872 (13h16m53.437821606s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.284159517 (13h16m53.442925251s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.292293732 (13h16m53.451059476s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.297107562 (13h16m53.455873336s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.317633216 (13h16m53.47639895s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.322231294 (13h16m53.480997028s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.330197897 (13h16m53.488963631s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351459338 (13h16m53.510225072s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351904902 (13h16m53.510670636s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.368061736 (13h16m53.52682747s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.371712331 (13h16m53.530478055s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.398177028 (13h16m53.556942762s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427000680 (13h16m53.585766444s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427065153 (13h16m53.585830877s) [seg_pos={0 0}, upload=11638]: Segment reached optimal threshold of 13 pieces. Aug 26 05:20:26.427195283 (13h16m53.585961017s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427261379 (13h16m53.586027153s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427283992 (13h16m53.586049726s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427295144 (13h16m53.586060878s) [seg_pos={0 0}, upload=11638]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:20:26.427357523 (13h16m53.586123257s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:26.427361481 (13h16m53.586127215s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:46.008171151 (13h17m13.166936875s) [upload=11638]: Done uploading segments... Aug 26 05:20:46.008235204 (13h17m13.167000938s) [upload=11638]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 23.896000298s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [............................XX..X........XXXX.X..X...X....X.] duration: 9.840096095s FAIL (2025-08-26 05:23:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.840117215s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [........................X...................X...X.X.....X...] duration: 11.261995934s FAIL (2025-08-26 05:23:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== oad Aug 26 05:20:04.595909240 (13h16m31.754674994s) [upload=11633]: Done starting upload Aug 26 05:20:04.596022267 (13h16m31.754788001s) [upload=11633]: Uploading segments... Aug 26 05:20:04.596164129 (13h16m31.754929863s) [upload=11633]: Got next segment. Inline: false Aug 26 05:20:04.596322702 (13h16m31.755088436s) [upload=11633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:04.596329215 (13h16m31.755094949s) [upload=11633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:09.040386360 (13h16m36.199152094s) [seg_pos={0 0}, upload=11633]: Begin upload segment... Aug 26 05:20:09.040434532 (13h16m36.199200266s) [seg_pos={0 0}, upload=11633]: Done begin upload segment. Aug 26 05:20:09.040455482 (13h16m36.199221217s) [noise=true , address=193.149.164.143:4701 , piece_id=W3JJBBLK4LFTQMGSORFC4HNJCJCESHT7IC6CV3R67YLYMILTRVNQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.040837964 (13h16m36.199603698s) [noise=true , address=104.36.82.60:4368 , piece_id=PWOT4GGYLV4OTRYMAKA2P4MFYZSOLMDOKHTAKBCK5N3XBYLTVDNA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041114594 (13h16m36.199880328s) [noise=true , address=77.90.31.11:4576 , piece_id=3JN5UL56HXWRHVG4CIBMTMW3RR7XNDNCV6Z3VUI633ZTSOR2O6VA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041374380 (13h16m36.200140124s) [noise=true , address=64.49.13.140:4506 , piece_id=BAZ7RRWU2MAENE5FODO6MSQBEVWKDPMMVU3RAAL2L6YK4TAYRMVQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041850352 (13h16m36.200616086s) [noise=true , address=79.127.201.215:4343 , piece_id=XRKC4YZ3IL2WTAALIIN4EGBE6UKV7T6CEN7BT2KOTKNEMNMO6WKA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042078558 (13h16m36.200844292s) [noise=true , address=104.36.82.53:4141 , piece_id=4ISMLDGON2J4BBJJVEHFDGNIFELBWS5YG2DI2UY276P3Z6A4M4KA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042390615 (13h16m36.201156349s) [noise=true , address=79.127.205.246:4287 , piece_id=UF7NUTKFW3CAGTCH2AB5P7QQANAJHDENEIKML3FBLB62EJLMJOIQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042650462 (13h16m36.201416196s) [noise=true , address=104.36.82.15:4292 , piece_id=SMMGQR4W7PG6KIVDGGH3DMECOTO6T7HKBFSAGCRFQB3EG7ONKNRA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042895591 (13h16m36.201661325s) [noise=true , address=79.127.201.215:4347 , piece_id=JA4RE5YRNLG37DOCFFJP3TLW54YYPSXIUEMSAM3KMYIZXI5TPLTA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.043189333 (13h16m36.201955067s) [noise=true , address=104.36.82.50:4015 , piece_id=7BZL7UJXCOIT7TJLXI4BMFFJ3PUBJM7GNAC6QMRQMWNUJF2B54XQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044156835 (13h16m36.202922569s) [noise=true , address=79.127.219.51:4202 , piece_id=G2GKBNKERODT2M6JQ6JZARAX5K2ZMWAQGDFE4GX6JOFP6J7VVS6Q, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044491365 (13h16m36.203257099s) [noise=true , address=79.127.205.234:4605 , piece_id=3JGKPG7KPH7RVD7HOME2NMNYM3ZYWVFXMWRSXUGKSSU3H2PKHTJQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044695925 (13h16m36.20346166s) [noise=true , address=45.91.116.14:4204 , piece_id=DCTPTWAW4AYLHMJHYSKEDPGYQKNTAYPWPPJMLGAED7NVIYVR2H6Q, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044925215 (13h16m36.203690949s) [noise=true , address=104.36.82.23:4465 , piece_id=OA4ATMH4RGHDQ6I32LADFK2SNFUIHQKHEGTLTQ7NOG7PSTHAS7RA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045146799 (13h16m36.203912533s) [noise=true , address=77.90.31.16:4767 , piece_id=OWZDUMBXAII6HT6USU4JSIE2X3MQNPEOTA2CTGEDM4ZDCC2YYUWA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045348043 (13h16m36.204113778s) [noise=true , address=104.36.82.14:4250 , piece_id=KQMCRUME7YR4VWLFULUA3VU5W65WPJQ5LSFEZ7LTCW7DVPDP5YXQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045553778 (13h16m36.204319502s) [noise=true , address=45.91.116.11:4141 , piece_id=2GWU7ODUGTLK3FOBAYZYCQ3H2KK5DZJ4ENE7XQVZNP3RRDX555IQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045746587 (13h16m36.204512321s) [noise=true , address=104.36.82.5:4848 , piece_id=5FADMC5XSNP7DPHFTDNWGDVZ5Q3NFRBZC75JOL7QTIM4T3CEEREQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:10.183014379 (13h16m37.341780113s) [upload=11633]: Next returned nil segment Aug 26 05:20:10.183030920 (13h16m37.341796654s) [upload=11633]: Waiting for error group managing segments... Aug 26 05:20:10.466427261 (13h16m37.625192995s) [noise=true , address=79.127.205.234:4605 , piece_id=3JGKPG7KPH7RVD7HOME2NMNYM3ZYWVFXMWRSXUGKSSU3H2PKHTJQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.510444354 (13h16m37.669210088s) [noise=true , address=79.127.205.246:4287 , piece_id=UF7NUTKFW3CAGTCH2AB5P7QQANAJHDENEIKML3FBLB62EJLMJOIQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.534999918 (13h16m37.693765652s) [noise=true , address=193.149.164.143:4701 , piece_id=W3JJBBLK4LFTQMGSORFC4HNJCJCESHT7IC6CV3R67YLYMILTRVNQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.568447728 (13h16m37.727213462s) [noise=true , address=64.49.13.140:4506 , piece_id=BAZ7RRWU2MAENE5FODO6MSQBEVWKDPMMVU3RAAL2L6YK4TAYRMVQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.932122524 (13h16m38.090888258s) [noise=true , address=77.90.31.11:4576 , piece_id=3JN5UL56HXWRHVG4CIBMTMW3RR7XNDNCV6Z3VUI633ZTSOR2O6VA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.938362394 (13h16m38.097128128s) [noise=true , address=77.90.31.16:4767 , piece_id=OWZDUMBXAII6HT6USU4JSIE2X3MQNPEOTA2CTGEDM4ZDCC2YYUWA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.941562006 (13h16m38.100327741s) [noise=true , address=45.91.116.14:4204 , piece_id=DCTPTWAW4AYLHMJHYSKEDPGYQKNTAYPWPPJMLGAED7NVIYVR2H6Q, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.975333905 (13h16m38.134099639s) [noise=true , address=45.91.116.11:4141 , piece_id=2GWU7ODUGTLK3FOBAYZYCQ3H2KK5DZJ4ENE7XQVZNP3RRDX555IQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.990482701 (13h16m38.149248435s) [noise=true , address=104.36.82.60:4368 , piece_id=PWOT4GGYLV4OTRYMAKA2P4MFYZSOLMDOKHTAKBCK5N3XBYLTVDNA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.993408219 (13h16m38.152173953s) [noise=true , address=79.127.201.215:4347 , piece_id=JA4RE5YRNLG37DOCFFJP3TLW54YYPSXIUEMSAM3KMYIZXI5TPLTA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.995616023 (13h16m38.154381757s) [noise=true , address=79.127.219.51:4202 , piece_id=G2GKBNKERODT2M6JQ6JZARAX5K2ZMWAQGDFE4GX6JOFP6J7VVS6Q, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.022846246 (13h16m38.18161198s) [noise=true , address=79.127.201.215:4343 , piece_id=XRKC4YZ3IL2WTAALIIN4EGBE6UKV7T6CEN7BT2KOTKNEMNMO6WKA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023149567 (13h16m38.181915301s) [noise=true , address=104.36.82.14:4250 , piece_id=KQMCRUME7YR4VWLFULUA3VU5W65WPJQ5LSFEZ7LTCW7DVPDP5YXQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023303982 (13h16m38.182069716s) [noise=true , address=104.36.82.23:4465 , piece_id=OA4ATMH4RGHDQ6I32LADFK2SNFUIHQKHEGTLTQ7NOG7PSTHAS7RA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023326725 (13h16m38.182092459s) [seg_pos={0 0}, upload=11633]: Segment reached optimal threshold of 14 pieces. Aug 26 05:20:11.023515707 (13h16m38.182281441s) [noise=true , address=104.36.82.50:4015 , piece_id=7BZL7UJXCOIT7TJLXI4BMFFJ3PUBJM7GNAC6QMRQMWNUJF2B54XQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18etsqD4wpYunpwdbPETCAn3JGJawbFAK9mwTkVUYKuWB7ypQE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023629204 (13h16m38.182394948s) [noise=true , address=104.36.82.15:4292 , piece_id=SMMGQR4W7PG6KIVDGGH3DMECOTO6T7HKBFSAGCRFQB3EG7ONKNRA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023737050 (13h16m38.182502784s) [noise=true , address=104.36.82.5:4848 , piece_id=5FADMC5XSNP7DPHFTDNWGDVZ5Q3NFRBZC75JOL7QTIM4T3CEEREQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023841651 (13h16m38.182607385s) [noise=true , address=104.36.82.53:4141 , piece_id=4ISMLDGON2J4BBJJVEHFDGNIFELBWS5YG2DI2UY276P3Z6A4M4KA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15wUF135h4QsyvF7Cr3eb6rxtx8KPz1LHbgRjQYwiF5xpmE2nn): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023856258 (13h16m38.182621992s) [seg_pos={0 0}, upload=11633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:20:11.023946702 (13h16m38.182712436s) [upload=11633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:11.023970407 (13h16m38.182736151s) [upload=11633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:11.764169676 (13h16m38.92293542s) [upload=11633]: Done uploading segments... Aug 26 05:20:11.764258155 (13h16m38.9230239s) [upload=11633]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 11.262015623s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........................................X.XX........X....] duration: 23.889101355s FAIL (2025-08-26 05:23:08 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F397B138BB539, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 23.889122985s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........................X...................X...X.X.....X..] duration: 51.47516047s FAIL (2025-08-26 05:22:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== oad Aug 26 05:20:04.595909240 (13h16m31.754674994s) [upload=11633]: Done starting upload Aug 26 05:20:04.596022267 (13h16m31.754788001s) [upload=11633]: Uploading segments... Aug 26 05:20:04.596164129 (13h16m31.754929863s) [upload=11633]: Got next segment. Inline: false Aug 26 05:20:04.596322702 (13h16m31.755088436s) [upload=11633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:04.596329215 (13h16m31.755094949s) [upload=11633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:09.040386360 (13h16m36.199152094s) [seg_pos={0 0}, upload=11633]: Begin upload segment... Aug 26 05:20:09.040434532 (13h16m36.199200266s) [seg_pos={0 0}, upload=11633]: Done begin upload segment. Aug 26 05:20:09.040455482 (13h16m36.199221217s) [noise=true , address=193.149.164.143:4701 , piece_id=W3JJBBLK4LFTQMGSORFC4HNJCJCESHT7IC6CV3R67YLYMILTRVNQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.040837964 (13h16m36.199603698s) [noise=true , address=104.36.82.60:4368 , piece_id=PWOT4GGYLV4OTRYMAKA2P4MFYZSOLMDOKHTAKBCK5N3XBYLTVDNA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041114594 (13h16m36.199880328s) [noise=true , address=77.90.31.11:4576 , piece_id=3JN5UL56HXWRHVG4CIBMTMW3RR7XNDNCV6Z3VUI633ZTSOR2O6VA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041374380 (13h16m36.200140124s) [noise=true , address=64.49.13.140:4506 , piece_id=BAZ7RRWU2MAENE5FODO6MSQBEVWKDPMMVU3RAAL2L6YK4TAYRMVQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041850352 (13h16m36.200616086s) [noise=true , address=79.127.201.215:4343 , piece_id=XRKC4YZ3IL2WTAALIIN4EGBE6UKV7T6CEN7BT2KOTKNEMNMO6WKA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042078558 (13h16m36.200844292s) [noise=true , address=104.36.82.53:4141 , piece_id=4ISMLDGON2J4BBJJVEHFDGNIFELBWS5YG2DI2UY276P3Z6A4M4KA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042390615 (13h16m36.201156349s) [noise=true , address=79.127.205.246:4287 , piece_id=UF7NUTKFW3CAGTCH2AB5P7QQANAJHDENEIKML3FBLB62EJLMJOIQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042650462 (13h16m36.201416196s) [noise=true , address=104.36.82.15:4292 , piece_id=SMMGQR4W7PG6KIVDGGH3DMECOTO6T7HKBFSAGCRFQB3EG7ONKNRA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042895591 (13h16m36.201661325s) [noise=true , address=79.127.201.215:4347 , piece_id=JA4RE5YRNLG37DOCFFJP3TLW54YYPSXIUEMSAM3KMYIZXI5TPLTA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.043189333 (13h16m36.201955067s) [noise=true , address=104.36.82.50:4015 , piece_id=7BZL7UJXCOIT7TJLXI4BMFFJ3PUBJM7GNAC6QMRQMWNUJF2B54XQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044156835 (13h16m36.202922569s) [noise=true , address=79.127.219.51:4202 , piece_id=G2GKBNKERODT2M6JQ6JZARAX5K2ZMWAQGDFE4GX6JOFP6J7VVS6Q, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044491365 (13h16m36.203257099s) [noise=true , address=79.127.205.234:4605 , piece_id=3JGKPG7KPH7RVD7HOME2NMNYM3ZYWVFXMWRSXUGKSSU3H2PKHTJQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044695925 (13h16m36.20346166s) [noise=true , address=45.91.116.14:4204 , piece_id=DCTPTWAW4AYLHMJHYSKEDPGYQKNTAYPWPPJMLGAED7NVIYVR2H6Q, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044925215 (13h16m36.203690949s) [noise=true , address=104.36.82.23:4465 , piece_id=OA4ATMH4RGHDQ6I32LADFK2SNFUIHQKHEGTLTQ7NOG7PSTHAS7RA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045146799 (13h16m36.203912533s) [noise=true , address=77.90.31.16:4767 , piece_id=OWZDUMBXAII6HT6USU4JSIE2X3MQNPEOTA2CTGEDM4ZDCC2YYUWA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045348043 (13h16m36.204113778s) [noise=true , address=104.36.82.14:4250 , piece_id=KQMCRUME7YR4VWLFULUA3VU5W65WPJQ5LSFEZ7LTCW7DVPDP5YXQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045553778 (13h16m36.204319502s) [noise=true , address=45.91.116.11:4141 , piece_id=2GWU7ODUGTLK3FOBAYZYCQ3H2KK5DZJ4ENE7XQVZNP3RRDX555IQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045746587 (13h16m36.204512321s) [noise=true , address=104.36.82.5:4848 , piece_id=5FADMC5XSNP7DPHFTDNWGDVZ5Q3NFRBZC75JOL7QTIM4T3CEEREQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:10.183014379 (13h16m37.341780113s) [upload=11633]: Next returned nil segment Aug 26 05:20:10.183030920 (13h16m37.341796654s) [upload=11633]: Waiting for error group managing segments... Aug 26 05:20:10.466427261 (13h16m37.625192995s) [noise=true , address=79.127.205.234:4605 , piece_id=3JGKPG7KPH7RVD7HOME2NMNYM3ZYWVFXMWRSXUGKSSU3H2PKHTJQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.510444354 (13h16m37.669210088s) [noise=true , address=79.127.205.246:4287 , piece_id=UF7NUTKFW3CAGTCH2AB5P7QQANAJHDENEIKML3FBLB62EJLMJOIQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.534999918 (13h16m37.693765652s) [noise=true , address=193.149.164.143:4701 , piece_id=W3JJBBLK4LFTQMGSORFC4HNJCJCESHT7IC6CV3R67YLYMILTRVNQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.568447728 (13h16m37.727213462s) [noise=true , address=64.49.13.140:4506 , piece_id=BAZ7RRWU2MAENE5FODO6MSQBEVWKDPMMVU3RAAL2L6YK4TAYRMVQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.932122524 (13h16m38.090888258s) [noise=true , address=77.90.31.11:4576 , piece_id=3JN5UL56HXWRHVG4CIBMTMW3RR7XNDNCV6Z3VUI633ZTSOR2O6VA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.938362394 (13h16m38.097128128s) [noise=true , address=77.90.31.16:4767 , piece_id=OWZDUMBXAII6HT6USU4JSIE2X3MQNPEOTA2CTGEDM4ZDCC2YYUWA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.941562006 (13h16m38.100327741s) [noise=true , address=45.91.116.14:4204 , piece_id=DCTPTWAW4AYLHMJHYSKEDPGYQKNTAYPWPPJMLGAED7NVIYVR2H6Q, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.975333905 (13h16m38.134099639s) [noise=true , address=45.91.116.11:4141 , piece_id=2GWU7ODUGTLK3FOBAYZYCQ3H2KK5DZJ4ENE7XQVZNP3RRDX555IQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.990482701 (13h16m38.149248435s) [noise=true , address=104.36.82.60:4368 , piece_id=PWOT4GGYLV4OTRYMAKA2P4MFYZSOLMDOKHTAKBCK5N3XBYLTVDNA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.993408219 (13h16m38.152173953s) [noise=true , address=79.127.201.215:4347 , piece_id=JA4RE5YRNLG37DOCFFJP3TLW54YYPSXIUEMSAM3KMYIZXI5TPLTA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.995616023 (13h16m38.154381757s) [noise=true , address=79.127.219.51:4202 , piece_id=G2GKBNKERODT2M6JQ6JZARAX5K2ZMWAQGDFE4GX6JOFP6J7VVS6Q, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.022846246 (13h16m38.18161198s) [noise=true , address=79.127.201.215:4343 , piece_id=XRKC4YZ3IL2WTAALIIN4EGBE6UKV7T6CEN7BT2KOTKNEMNMO6WKA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023149567 (13h16m38.181915301s) [noise=true , address=104.36.82.14:4250 , piece_id=KQMCRUME7YR4VWLFULUA3VU5W65WPJQ5LSFEZ7LTCW7DVPDP5YXQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023303982 (13h16m38.182069716s) [noise=true , address=104.36.82.23:4465 , piece_id=OA4ATMH4RGHDQ6I32LADFK2SNFUIHQKHEGTLTQ7NOG7PSTHAS7RA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023326725 (13h16m38.182092459s) [seg_pos={0 0}, upload=11633]: Segment reached optimal threshold of 14 pieces. Aug 26 05:20:11.023515707 (13h16m38.182281441s) [noise=true , address=104.36.82.50:4015 , piece_id=7BZL7UJXCOIT7TJLXI4BMFFJ3PUBJM7GNAC6QMRQMWNUJF2B54XQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18etsqD4wpYunpwdbPETCAn3JGJawbFAK9mwTkVUYKuWB7ypQE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023629204 (13h16m38.182394948s) [noise=true , address=104.36.82.15:4292 , piece_id=SMMGQR4W7PG6KIVDGGH3DMECOTO6T7HKBFSAGCRFQB3EG7ONKNRA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023737050 (13h16m38.182502784s) [noise=true , address=104.36.82.5:4848 , piece_id=5FADMC5XSNP7DPHFTDNWGDVZ5Q3NFRBZC75JOL7QTIM4T3CEEREQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023841651 (13h16m38.182607385s) [noise=true , address=104.36.82.53:4141 , piece_id=4ISMLDGON2J4BBJJVEHFDGNIFELBWS5YG2DI2UY276P3Z6A4M4KA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15wUF135h4QsyvF7Cr3eb6rxtx8KPz1LHbgRjQYwiF5xpmE2nn): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023856258 (13h16m38.182621992s) [seg_pos={0 0}, upload=11633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:20:11.023946702 (13h16m38.182712436s) [upload=11633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:11.023970407 (13h16m38.182736151s) [upload=11633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:11.764169676 (13h16m38.92293542s) [upload=11633]: Done uploading segments... Aug 26 05:20:11.764258155 (13h16m38.9230239s) [upload=11633]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 51.475194506s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [..........................X................XX...........X...] duration: 2.525919364s remote: "tcp:185.244.226.2:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Methods=GET, HEAD X-Request-Id=RUZraZXZvFb Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:20:32 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:22:55 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 2.525946305s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 17 out of 60 is failed (threshold=3) [.......................XXX....XX........XX..XX.XXXX...XXX..X] duration: 30.002619902s FAIL (2025-08-26 05:22:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:22:24.692908479 (13h18m51.851674213s) [upload=11664]: Starting upload Aug 26 05:22:24.692965057 (13h18m51.851730791s) [upload=11664]: Done starting upload Aug 26 05:22:24.693021445 (13h18m51.851787179s) [upload=11664]: Uploading segments... Aug 26 05:22:24.693067183 (13h18m51.851832917s) [upload=11664]: Got next segment. Inline: true Aug 26 05:22:24.693071240 (13h18m51.851836974s) [upload=11664]: Waiting for error group managing segments... Aug 26 05:22:24.693106998 (13h18m51.851872722s) [upload=11664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:22:24.693111296 (13h18m51.85187703s) [upload=11664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:22:24.693113791 (13h18m51.851879525s) [upload=11664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:22:54.044453623 (13h19m21.203219357s) [upload=11664]: Done uploading segments... Aug 26 05:22:54.044470575 (13h19m21.203236309s) [upload=11664]: Upload finished. err: metaclient: context deadline exceeded Duration:* 30.002642584s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............................................XX...X......X..] duration: 52.798192661s FAIL (2025-08-26 05:22:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:18.000025717 (13h16m45.158791451s) [upload=11637]: Starting upload Aug 26 05:20:18.000093988 (13h16m45.158859722s) [upload=11637]: Done starting upload Aug 26 05:20:18.000148342 (13h16m45.158914066s) [upload=11637]: Uploading segments... Aug 26 05:20:18.000183359 (13h16m45.158949093s) [upload=11637]: Got next segment. Inline: true Aug 26 05:20:18.000256940 (13h16m45.159022674s) [upload=11637]: Waiting for error group managing segments... Aug 26 05:20:18.000297667 (13h16m45.159063401s) [upload=11637]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:18.000302246 (13h16m45.15906798s) [upload=11637]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:20:18.000305281 (13h16m45.159071015s) [upload=11637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:39.528469747 (13h17m6.687235481s) [upload=11637]: Done uploading segments... Aug 26 05:20:39.528487431 (13h17m6.687253165s) [upload=11637]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 52.798237167s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...................XXX...X..............X.X...XXX....XXX....] duration: 16.578694385s FAIL (2025-08-26 05:22:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:20.009104374 (13h16m47.167870108s) [upload=11638]: Starting upload Aug 26 05:20:20.009177123 (13h16m47.167942857s) [upload=11638]: Done starting upload Aug 26 05:20:20.009487938 (13h16m47.168253772s) [upload=11638]: Uploading segments... Aug 26 05:20:20.009551900 (13h16m47.168317634s) [upload=11638]: Got next segment. Inline: false Aug 26 05:20:20.009587307 (13h16m47.168353041s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:20.009592938 (13h16m47.168358692s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:24.249473770 (13h16m51.408239504s) [seg_pos={0 0}, upload=11638]: Begin upload segment... Aug 26 05:20:24.249510921 (13h16m51.408276645s) [seg_pos={0 0}, upload=11638]: Done begin upload segment. Aug 26 05:20:24.249529397 (13h16m51.408295131s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249545949 (13h16m51.408311683s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249880088 (13h16m51.408645822s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249941786 (13h16m51.40870752s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250105790 (13h16m51.408871524s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250213606 (13h16m51.40897933s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250326021 (13h16m51.409091755s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250484965 (13h16m51.409250699s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250541844 (13h16m51.409307578s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250759721 (13h16m51.409525455s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250809266 (13h16m51.409575s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250970333 (13h16m51.409736067s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251052360 (13h16m51.409818094s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251279666 (13h16m51.4100454s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251521318 (13h16m51.410287042s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251737351 (13h16m51.410503085s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:25.976881200 (13h16m53.135646934s) [upload=11638]: Next returned nil segment Aug 26 05:20:25.976899275 (13h16m53.135665009s) [upload=11638]: Waiting for error group managing segments... Aug 26 05:20:26.279055872 (13h16m53.437821606s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.284159517 (13h16m53.442925251s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.292293732 (13h16m53.451059476s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.297107562 (13h16m53.455873336s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.317633216 (13h16m53.47639895s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.322231294 (13h16m53.480997028s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.330197897 (13h16m53.488963631s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351459338 (13h16m53.510225072s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351904902 (13h16m53.510670636s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.368061736 (13h16m53.52682747s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.371712331 (13h16m53.530478055s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.398177028 (13h16m53.556942762s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427000680 (13h16m53.585766444s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427065153 (13h16m53.585830877s) [seg_pos={0 0}, upload=11638]: Segment reached optimal threshold of 13 pieces. Aug 26 05:20:26.427195283 (13h16m53.585961017s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427261379 (13h16m53.586027153s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427283992 (13h16m53.586049726s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427295144 (13h16m53.586060878s) [seg_pos={0 0}, upload=11638]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:20:26.427357523 (13h16m53.586123257s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:26.427361481 (13h16m53.586127215s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:46.008171151 (13h17m13.166936875s) [upload=11638]: Done uploading segments... Aug 26 05:20:46.008235204 (13h17m13.167000938s) [upload=11638]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 16.578720143s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.............................XX..X........XXXX.X..X...X....X] duration: 30.000664504s FAIL (2025-08-26 05:22:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000684712s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [................................X.........X..X..XXX.........] duration: 25.039843225s remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:15:21 GMT Content-Length=423 Server=Storj X-Amz-Request-Id=185F393E89D07B67 X-Request-Id=WURxSo7gKen target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:22:41 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F393E89D07B67</RequestId><HostId></HostId></Error>" Duration: 25.039873442s edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [...............................X...............XX.X.....X...] duration: 6.519832642s remote: "tcp:45.38.24.2:443" response headers: Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=433 X-Amz-Request-Id=185F398389014659 X-Request-Id=HpqiBYmFHdL Date=Tue, 26 Aug 2025 05:20:17 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:22:35 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F398389014659</RequestId><HostId></HostId></Error>" Duration: 6.519859362s edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [...........................X................XX...........X..] duration: 8.240432311s remote: "tcp:185.244.226.2:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Methods=GET, HEAD X-Request-Id=RUZraZXZvFb Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:20:32 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:22:27 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 8.240458821s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.....................XXX.....XX.........XXX.X.XXX..XX.......] duration: 25.901308459s FAIL (2025-08-26 05:22:25 UTC) orbiter warning: operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 25.901339649s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [...........................X.X...X.......XXX.X..XXX......X.X] duration: 30.001061129s FAIL (2025-08-26 05:22:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001084193s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 9 out of 60 is failed (threshold=3) [......................X..X...XX.........X...X...XXX.........] duration: 3.938141688s FAIL (2025-08-26 05:22:17 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 3.938167357s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............................................X.XX........X...] duration: 24.274060186s FAIL (2025-08-26 05:22:12 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F397B138BB539, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 24.27407851s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....................XXX...X..............X.X...XXX....XXX...] duration: 6.015774796s FAIL (2025-08-26 05:21:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:20.009104374 (13h16m47.167870108s) [upload=11638]: Starting upload Aug 26 05:20:20.009177123 (13h16m47.167942857s) [upload=11638]: Done starting upload Aug 26 05:20:20.009487938 (13h16m47.168253772s) [upload=11638]: Uploading segments... Aug 26 05:20:20.009551900 (13h16m47.168317634s) [upload=11638]: Got next segment. Inline: false Aug 26 05:20:20.009587307 (13h16m47.168353041s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:20.009592938 (13h16m47.168358692s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:24.249473770 (13h16m51.408239504s) [seg_pos={0 0}, upload=11638]: Begin upload segment... Aug 26 05:20:24.249510921 (13h16m51.408276645s) [seg_pos={0 0}, upload=11638]: Done begin upload segment. Aug 26 05:20:24.249529397 (13h16m51.408295131s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249545949 (13h16m51.408311683s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249880088 (13h16m51.408645822s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249941786 (13h16m51.40870752s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250105790 (13h16m51.408871524s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250213606 (13h16m51.40897933s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250326021 (13h16m51.409091755s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250484965 (13h16m51.409250699s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250541844 (13h16m51.409307578s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250759721 (13h16m51.409525455s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250809266 (13h16m51.409575s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250970333 (13h16m51.409736067s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251052360 (13h16m51.409818094s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251279666 (13h16m51.4100454s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251521318 (13h16m51.410287042s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251737351 (13h16m51.410503085s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:25.976881200 (13h16m53.135646934s) [upload=11638]: Next returned nil segment Aug 26 05:20:25.976899275 (13h16m53.135665009s) [upload=11638]: Waiting for error group managing segments... Aug 26 05:20:26.279055872 (13h16m53.437821606s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.284159517 (13h16m53.442925251s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.292293732 (13h16m53.451059476s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.297107562 (13h16m53.455873336s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.317633216 (13h16m53.47639895s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.322231294 (13h16m53.480997028s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.330197897 (13h16m53.488963631s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351459338 (13h16m53.510225072s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351904902 (13h16m53.510670636s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.368061736 (13h16m53.52682747s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.371712331 (13h16m53.530478055s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.398177028 (13h16m53.556942762s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427000680 (13h16m53.585766444s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427065153 (13h16m53.585830877s) [seg_pos={0 0}, upload=11638]: Segment reached optimal threshold of 13 pieces. Aug 26 05:20:26.427195283 (13h16m53.585961017s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427261379 (13h16m53.586027153s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427283992 (13h16m53.586049726s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427295144 (13h16m53.586060878s) [seg_pos={0 0}, upload=11638]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:20:26.427357523 (13h16m53.586123257s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:26.427361481 (13h16m53.586127215s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:46.008171151 (13h17m13.166936875s) [upload=11638]: Done uploading segments... Aug 26 05:20:46.008235204 (13h17m13.167000938s) [upload=11638]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 6.015806035s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [.................................X.........X..X..XXX........] duration: 364.787466ms remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:15:21 GMT Content-Length=423 Server=Storj X-Amz-Request-Id=185F393E89D07B67 X-Request-Id=WURxSo7gKen target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:21:43 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F393E89D07B67</RequestId><HostId></HostId></Error>" Duration: 364.813996ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [........................XXX....XX........XX..XX.XXXX...XXX..] duration: 2.312023341s FAIL (2025-08-26 05:21:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:22.919769379 (13h16m50.078535113s) [upload=11639]: Starting upload Aug 26 05:20:22.919825266 (13h16m50.078591s) [upload=11639]: Done starting upload Aug 26 05:20:22.919874208 (13h16m50.078639943s) [upload=11639]: Uploading segments... Aug 26 05:20:22.919909497 (13h16m50.078675221s) [upload=11639]: Got next segment. Inline: true Aug 26 05:20:22.919913534 (13h16m50.078679268s) [upload=11639]: Waiting for error group managing segments... Aug 26 05:20:22.919947639 (13h16m50.078713363s) [upload=11639]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:22.919951256 (13h16m50.07871699s) [upload=11639]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:20:22.919953741 (13h16m50.078719465s) [upload=11639]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:45.788647584 (13h17m12.947413328s) [upload=11639]: Done uploading segments... Aug 26 05:20:45.788670156 (13h17m12.94743592s) [upload=11639]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 2.312064108s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 9 out of 60 is failed (threshold=3) [.......................X..X...XX.........X...X...XXX........] duration: 8.847765388s FAIL (2025-08-26 05:21:39 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 8.847786388s core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [............................X................XX...........X.] duration: 721.989276ms remote: "tcp:185.244.226.2:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Methods=GET, HEAD X-Request-Id=RUZraZXZvFb Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:20:32 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:21:35 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 722.017151ms edge linksharing bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............................................X.XX........X..] duration: 9.143912727s FAIL (2025-08-26 05:21:35 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F397B138BB539, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 9.143933667s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....................XXX...X..............X.X...XXX....XXX..] duration: 17.151324298s FAIL (2025-08-26 05:21:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:20.009104374 (13h16m47.167870108s) [upload=11638]: Starting upload Aug 26 05:20:20.009177123 (13h16m47.167942857s) [upload=11638]: Done starting upload Aug 26 05:20:20.009487938 (13h16m47.168253772s) [upload=11638]: Uploading segments... Aug 26 05:20:20.009551900 (13h16m47.168317634s) [upload=11638]: Got next segment. Inline: false Aug 26 05:20:20.009587307 (13h16m47.168353041s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:20.009592938 (13h16m47.168358692s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:24.249473770 (13h16m51.408239504s) [seg_pos={0 0}, upload=11638]: Begin upload segment... Aug 26 05:20:24.249510921 (13h16m51.408276645s) [seg_pos={0 0}, upload=11638]: Done begin upload segment. Aug 26 05:20:24.249529397 (13h16m51.408295131s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249545949 (13h16m51.408311683s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249880088 (13h16m51.408645822s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249941786 (13h16m51.40870752s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250105790 (13h16m51.408871524s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250213606 (13h16m51.40897933s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250326021 (13h16m51.409091755s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250484965 (13h16m51.409250699s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250541844 (13h16m51.409307578s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250759721 (13h16m51.409525455s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250809266 (13h16m51.409575s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250970333 (13h16m51.409736067s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251052360 (13h16m51.409818094s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251279666 (13h16m51.4100454s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251521318 (13h16m51.410287042s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251737351 (13h16m51.410503085s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:25.976881200 (13h16m53.135646934s) [upload=11638]: Next returned nil segment Aug 26 05:20:25.976899275 (13h16m53.135665009s) [upload=11638]: Waiting for error group managing segments... Aug 26 05:20:26.279055872 (13h16m53.437821606s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.284159517 (13h16m53.442925251s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.292293732 (13h16m53.451059476s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.297107562 (13h16m53.455873336s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.317633216 (13h16m53.47639895s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.322231294 (13h16m53.480997028s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.330197897 (13h16m53.488963631s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351459338 (13h16m53.510225072s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351904902 (13h16m53.510670636s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.368061736 (13h16m53.52682747s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.371712331 (13h16m53.530478055s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.398177028 (13h16m53.556942762s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427000680 (13h16m53.585766444s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427065153 (13h16m53.585830877s) [seg_pos={0 0}, upload=11638]: Segment reached optimal threshold of 13 pieces. Aug 26 05:20:26.427195283 (13h16m53.585961017s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427261379 (13h16m53.586027153s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427283992 (13h16m53.586049726s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427295144 (13h16m53.586060878s) [seg_pos={0 0}, upload=11638]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:20:26.427357523 (13h16m53.586123257s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:26.427361481 (13h16m53.586127215s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:46.008171151 (13h17m13.166936875s) [upload=11638]: Done uploading segments... Aug 26 05:20:46.008235204 (13h17m13.167000938s) [upload=11638]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 17.151355649s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........................X...................X...X.X.....X.] duration: 30.759201552s FAIL (2025-08-26 05:21:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== oad Aug 26 05:20:04.595909240 (13h16m31.754674994s) [upload=11633]: Done starting upload Aug 26 05:20:04.596022267 (13h16m31.754788001s) [upload=11633]: Uploading segments... Aug 26 05:20:04.596164129 (13h16m31.754929863s) [upload=11633]: Got next segment. Inline: false Aug 26 05:20:04.596322702 (13h16m31.755088436s) [upload=11633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:04.596329215 (13h16m31.755094949s) [upload=11633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:09.040386360 (13h16m36.199152094s) [seg_pos={0 0}, upload=11633]: Begin upload segment... Aug 26 05:20:09.040434532 (13h16m36.199200266s) [seg_pos={0 0}, upload=11633]: Done begin upload segment. Aug 26 05:20:09.040455482 (13h16m36.199221217s) [noise=true , address=193.149.164.143:4701 , piece_id=W3JJBBLK4LFTQMGSORFC4HNJCJCESHT7IC6CV3R67YLYMILTRVNQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.040837964 (13h16m36.199603698s) [noise=true , address=104.36.82.60:4368 , piece_id=PWOT4GGYLV4OTRYMAKA2P4MFYZSOLMDOKHTAKBCK5N3XBYLTVDNA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041114594 (13h16m36.199880328s) [noise=true , address=77.90.31.11:4576 , piece_id=3JN5UL56HXWRHVG4CIBMTMW3RR7XNDNCV6Z3VUI633ZTSOR2O6VA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041374380 (13h16m36.200140124s) [noise=true , address=64.49.13.140:4506 , piece_id=BAZ7RRWU2MAENE5FODO6MSQBEVWKDPMMVU3RAAL2L6YK4TAYRMVQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.041850352 (13h16m36.200616086s) [noise=true , address=79.127.201.215:4343 , piece_id=XRKC4YZ3IL2WTAALIIN4EGBE6UKV7T6CEN7BT2KOTKNEMNMO6WKA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042078558 (13h16m36.200844292s) [noise=true , address=104.36.82.53:4141 , piece_id=4ISMLDGON2J4BBJJVEHFDGNIFELBWS5YG2DI2UY276P3Z6A4M4KA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042390615 (13h16m36.201156349s) [noise=true , address=79.127.205.246:4287 , piece_id=UF7NUTKFW3CAGTCH2AB5P7QQANAJHDENEIKML3FBLB62EJLMJOIQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042650462 (13h16m36.201416196s) [noise=true , address=104.36.82.15:4292 , piece_id=SMMGQR4W7PG6KIVDGGH3DMECOTO6T7HKBFSAGCRFQB3EG7ONKNRA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.042895591 (13h16m36.201661325s) [noise=true , address=79.127.201.215:4347 , piece_id=JA4RE5YRNLG37DOCFFJP3TLW54YYPSXIUEMSAM3KMYIZXI5TPLTA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.043189333 (13h16m36.201955067s) [noise=true , address=104.36.82.50:4015 , piece_id=7BZL7UJXCOIT7TJLXI4BMFFJ3PUBJM7GNAC6QMRQMWNUJF2B54XQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044156835 (13h16m36.202922569s) [noise=true , address=79.127.219.51:4202 , piece_id=G2GKBNKERODT2M6JQ6JZARAX5K2ZMWAQGDFE4GX6JOFP6J7VVS6Q, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044491365 (13h16m36.203257099s) [noise=true , address=79.127.205.234:4605 , piece_id=3JGKPG7KPH7RVD7HOME2NMNYM3ZYWVFXMWRSXUGKSSU3H2PKHTJQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044695925 (13h16m36.20346166s) [noise=true , address=45.91.116.14:4204 , piece_id=DCTPTWAW4AYLHMJHYSKEDPGYQKNTAYPWPPJMLGAED7NVIYVR2H6Q, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.044925215 (13h16m36.203690949s) [noise=true , address=104.36.82.23:4465 , piece_id=OA4ATMH4RGHDQ6I32LADFK2SNFUIHQKHEGTLTQ7NOG7PSTHAS7RA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045146799 (13h16m36.203912533s) [noise=true , address=77.90.31.16:4767 , piece_id=OWZDUMBXAII6HT6USU4JSIE2X3MQNPEOTA2CTGEDM4ZDCC2YYUWA, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045348043 (13h16m36.204113778s) [noise=true , address=104.36.82.14:4250 , piece_id=KQMCRUME7YR4VWLFULUA3VU5W65WPJQ5LSFEZ7LTCW7DVPDP5YXQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045553778 (13h16m36.204319502s) [noise=true , address=45.91.116.11:4141 , piece_id=2GWU7ODUGTLK3FOBAYZYCQ3H2KK5DZJ4ENE7XQVZNP3RRDX555IQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:09.045746587 (13h16m36.204512321s) [noise=true , address=104.36.82.5:4848 , piece_id=5FADMC5XSNP7DPHFTDNWGDVZ5Q3NFRBZC75JOL7QTIM4T3CEEREQ, seg_pos={0 0}, upload=11633]: Uploading piece... Aug 26 05:20:10.183014379 (13h16m37.341780113s) [upload=11633]: Next returned nil segment Aug 26 05:20:10.183030920 (13h16m37.341796654s) [upload=11633]: Waiting for error group managing segments... Aug 26 05:20:10.466427261 (13h16m37.625192995s) [noise=true , address=79.127.205.234:4605 , piece_id=3JGKPG7KPH7RVD7HOME2NMNYM3ZYWVFXMWRSXUGKSSU3H2PKHTJQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.510444354 (13h16m37.669210088s) [noise=true , address=79.127.205.246:4287 , piece_id=UF7NUTKFW3CAGTCH2AB5P7QQANAJHDENEIKML3FBLB62EJLMJOIQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.534999918 (13h16m37.693765652s) [noise=true , address=193.149.164.143:4701 , piece_id=W3JJBBLK4LFTQMGSORFC4HNJCJCESHT7IC6CV3R67YLYMILTRVNQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.568447728 (13h16m37.727213462s) [noise=true , address=64.49.13.140:4506 , piece_id=BAZ7RRWU2MAENE5FODO6MSQBEVWKDPMMVU3RAAL2L6YK4TAYRMVQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.932122524 (13h16m38.090888258s) [noise=true , address=77.90.31.11:4576 , piece_id=3JN5UL56HXWRHVG4CIBMTMW3RR7XNDNCV6Z3VUI633ZTSOR2O6VA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.938362394 (13h16m38.097128128s) [noise=true , address=77.90.31.16:4767 , piece_id=OWZDUMBXAII6HT6USU4JSIE2X3MQNPEOTA2CTGEDM4ZDCC2YYUWA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.941562006 (13h16m38.100327741s) [noise=true , address=45.91.116.14:4204 , piece_id=DCTPTWAW4AYLHMJHYSKEDPGYQKNTAYPWPPJMLGAED7NVIYVR2H6Q, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.975333905 (13h16m38.134099639s) [noise=true , address=45.91.116.11:4141 , piece_id=2GWU7ODUGTLK3FOBAYZYCQ3H2KK5DZJ4ENE7XQVZNP3RRDX555IQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.990482701 (13h16m38.149248435s) [noise=true , address=104.36.82.60:4368 , piece_id=PWOT4GGYLV4OTRYMAKA2P4MFYZSOLMDOKHTAKBCK5N3XBYLTVDNA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.993408219 (13h16m38.152173953s) [noise=true , address=79.127.201.215:4347 , piece_id=JA4RE5YRNLG37DOCFFJP3TLW54YYPSXIUEMSAM3KMYIZXI5TPLTA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:10.995616023 (13h16m38.154381757s) [noise=true , address=79.127.219.51:4202 , piece_id=G2GKBNKERODT2M6JQ6JZARAX5K2ZMWAQGDFE4GX6JOFP6J7VVS6Q, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.022846246 (13h16m38.18161198s) [noise=true , address=79.127.201.215:4343 , piece_id=XRKC4YZ3IL2WTAALIIN4EGBE6UKV7T6CEN7BT2KOTKNEMNMO6WKA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023149567 (13h16m38.181915301s) [noise=true , address=104.36.82.14:4250 , piece_id=KQMCRUME7YR4VWLFULUA3VU5W65WPJQ5LSFEZ7LTCW7DVPDP5YXQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023303982 (13h16m38.182069716s) [noise=true , address=104.36.82.23:4465 , piece_id=OA4ATMH4RGHDQ6I32LADFK2SNFUIHQKHEGTLTQ7NOG7PSTHAS7RA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: <nil> Aug 26 05:20:11.023326725 (13h16m38.182092459s) [seg_pos={0 0}, upload=11633]: Segment reached optimal threshold of 14 pieces. Aug 26 05:20:11.023515707 (13h16m38.182281441s) [noise=true , address=104.36.82.50:4015 , piece_id=7BZL7UJXCOIT7TJLXI4BMFFJ3PUBJM7GNAC6QMRQMWNUJF2B54XQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18etsqD4wpYunpwdbPETCAn3JGJawbFAK9mwTkVUYKuWB7ypQE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023629204 (13h16m38.182394948s) [noise=true , address=104.36.82.15:4292 , piece_id=SMMGQR4W7PG6KIVDGGH3DMECOTO6T7HKBFSAGCRFQB3EG7ONKNRA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023737050 (13h16m38.182502784s) [noise=true , address=104.36.82.5:4848 , piece_id=5FADMC5XSNP7DPHFTDNWGDVZ5Q3NFRBZC75JOL7QTIM4T3CEEREQ, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023841651 (13h16m38.182607385s) [noise=true , address=104.36.82.53:4141 , piece_id=4ISMLDGON2J4BBJJVEHFDGNIFELBWS5YG2DI2UY276P3Z6A4M4KA, seg_pos={0 0}, upload=11633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15wUF135h4QsyvF7Cr3eb6rxtx8KPz1LHbgRjQYwiF5xpmE2nn): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:11.023856258 (13h16m38.182621992s) [seg_pos={0 0}, upload=11633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:20:11.023946702 (13h16m38.182712436s) [upload=11633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:11.023970407 (13h16m38.182736151s) [upload=11633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:11.764169676 (13h16m38.92293542s) [upload=11633]: Done uploading segments... Aug 26 05:20:11.764258155 (13h16m38.9230239s) [upload=11633]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 30.759230055s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..............................XX..X........XXXX.X..X...X....] duration: 12.528681668s FAIL (2025-08-26 05:21:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.528706254s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [.........................XXX....XX........XX..XX.XXXX...XXX.] duration: 10.702577812s FAIL (2025-08-26 05:21:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:22.919769379 (13h16m50.078535113s) [upload=11639]: Starting upload Aug 26 05:20:22.919825266 (13h16m50.078591s) [upload=11639]: Done starting upload Aug 26 05:20:22.919874208 (13h16m50.078639943s) [upload=11639]: Uploading segments... Aug 26 05:20:22.919909497 (13h16m50.078675221s) [upload=11639]: Got next segment. Inline: true Aug 26 05:20:22.919913534 (13h16m50.078679268s) [upload=11639]: Waiting for error group managing segments... Aug 26 05:20:22.919947639 (13h16m50.078713363s) [upload=11639]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:22.919951256 (13h16m50.07871699s) [upload=11639]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:20:22.919953741 (13h16m50.078719465s) [upload=11639]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:45.788647584 (13h17m12.947413328s) [upload=11639]: Done uploading segments... Aug 26 05:20:45.788670156 (13h17m12.94743592s) [upload=11639]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 10.702610775s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [............................X.X...X.......XXX.X..XXX......X.] duration: 3.762944713s FAIL (2025-08-26 05:21:33 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F398B9F81D107, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 3.762975512s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [................................X...............XX.X.....X..] duration: 12.300976894s remote: "tcp:45.38.24.2:443" response headers: Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=433 X-Amz-Request-Id=185F398389014659 X-Request-Id=HpqiBYmFHdL Date=Tue, 26 Aug 2025 05:20:17 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:21:32 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F398389014659</RequestId><HostId></HostId></Error>" Duration: 12.301013213s edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [..................................X.........X..X..XXX.......] duration: 7.881451878s remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:15:21 GMT Content-Length=423 Server=Storj X-Amz-Request-Id=185F393E89D07B67 X-Request-Id=WURxSo7gKen target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:21:27 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F393E89D07B67</RequestId><HostId></HostId></Error>" Duration: 7.881474672s edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [.................................X...............XX.X.....X.] duration: 16.214240788s remote: "tcp:45.38.24.2:443" response headers: Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=433 X-Amz-Request-Id=185F398389014659 X-Request-Id=HpqiBYmFHdL Date=Tue, 26 Aug 2025 05:20:17 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:21:16 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F398389014659</RequestId><HostId></HostId></Error>" Duration: 16.214264074s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............................................XX...X......X.] duration: 3.688079035s FAIL (2025-08-26 05:21:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:18.000025717 (13h16m45.158791451s) [upload=11637]: Starting upload Aug 26 05:20:18.000093988 (13h16m45.158859722s) [upload=11637]: Done starting upload Aug 26 05:20:18.000148342 (13h16m45.158914066s) [upload=11637]: Uploading segments... Aug 26 05:20:18.000183359 (13h16m45.158949093s) [upload=11637]: Got next segment. Inline: true Aug 26 05:20:18.000256940 (13h16m45.159022674s) [upload=11637]: Waiting for error group managing segments... Aug 26 05:20:18.000297667 (13h16m45.159063401s) [upload=11637]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:18.000302246 (13h16m45.15906798s) [upload=11637]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:20:18.000305281 (13h16m45.159071015s) [upload=11637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:39.528469747 (13h17m6.687235481s) [upload=11637]: Done uploading segments... Aug 26 05:20:39.528487431 (13h17m6.687253165s) [upload=11637]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 3.68810707s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......................XXX...X..............X.X...XXX....XXX.] duration: 18.69996419s FAIL (2025-08-26 05:21:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:20.009104374 (13h16m47.167870108s) [upload=11638]: Starting upload Aug 26 05:20:20.009177123 (13h16m47.167942857s) [upload=11638]: Done starting upload Aug 26 05:20:20.009487938 (13h16m47.168253772s) [upload=11638]: Uploading segments... Aug 26 05:20:20.009551900 (13h16m47.168317634s) [upload=11638]: Got next segment. Inline: false Aug 26 05:20:20.009587307 (13h16m47.168353041s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:20.009592938 (13h16m47.168358692s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:24.249473770 (13h16m51.408239504s) [seg_pos={0 0}, upload=11638]: Begin upload segment... Aug 26 05:20:24.249510921 (13h16m51.408276645s) [seg_pos={0 0}, upload=11638]: Done begin upload segment. Aug 26 05:20:24.249529397 (13h16m51.408295131s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249545949 (13h16m51.408311683s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249880088 (13h16m51.408645822s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249941786 (13h16m51.40870752s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250105790 (13h16m51.408871524s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250213606 (13h16m51.40897933s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250326021 (13h16m51.409091755s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250484965 (13h16m51.409250699s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250541844 (13h16m51.409307578s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250759721 (13h16m51.409525455s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250809266 (13h16m51.409575s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250970333 (13h16m51.409736067s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251052360 (13h16m51.409818094s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251279666 (13h16m51.4100454s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251521318 (13h16m51.410287042s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251737351 (13h16m51.410503085s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:25.976881200 (13h16m53.135646934s) [upload=11638]: Next returned nil segment Aug 26 05:20:25.976899275 (13h16m53.135665009s) [upload=11638]: Waiting for error group managing segments... Aug 26 05:20:26.279055872 (13h16m53.437821606s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.284159517 (13h16m53.442925251s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.292293732 (13h16m53.451059476s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.297107562 (13h16m53.455873336s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.317633216 (13h16m53.47639895s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.322231294 (13h16m53.480997028s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.330197897 (13h16m53.488963631s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351459338 (13h16m53.510225072s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351904902 (13h16m53.510670636s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.368061736 (13h16m53.52682747s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.371712331 (13h16m53.530478055s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.398177028 (13h16m53.556942762s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427000680 (13h16m53.585766444s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427065153 (13h16m53.585830877s) [seg_pos={0 0}, upload=11638]: Segment reached optimal threshold of 13 pieces. Aug 26 05:20:26.427195283 (13h16m53.585961017s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427261379 (13h16m53.586027153s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427283992 (13h16m53.586049726s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427295144 (13h16m53.586060878s) [seg_pos={0 0}, upload=11638]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:20:26.427357523 (13h16m53.586123257s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:26.427361481 (13h16m53.586127215s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:46.008171151 (13h17m13.166936875s) [upload=11638]: Done uploading segments... Aug 26 05:20:46.008235204 (13h17m13.167000938s) [upload=11638]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 18.700007401s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 14 out of 60 is failed (threshold=3) [......................XXX.....XX.........XXX.X.XXX..XX......] duration: 19.446454767s FAIL (2025-08-26 05:21:07 UTC) orbiter warning: operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 19.446481728s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............................................X.XX........X.] duration: 19.477347849s FAIL (2025-08-26 05:21:03 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F397B138BB539, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 19.477370853s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [...............................XX..X........XXXX.X..X...X...] duration: 6.010238803s FAIL (2025-08-26 05:20:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.010249792s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [................................XX..X........XXXX.X..X...X..] duration: 21.875708953s FAIL (2025-08-26 05:20:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.875724392s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [.............................X.X...X.......XXX.X..XXX......X] duration: 4.717006418s FAIL (2025-08-26 05:20:51 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F398B9F81D107, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 4.717058909s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......................XXX...X..............X.X...XXX....XXX] duration: 26.648632297s FAIL (2025-08-26 05:20:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:20.009104374 (13h16m47.167870108s) [upload=11638]: Starting upload Aug 26 05:20:20.009177123 (13h16m47.167942857s) [upload=11638]: Done starting upload Aug 26 05:20:20.009487938 (13h16m47.168253772s) [upload=11638]: Uploading segments... Aug 26 05:20:20.009551900 (13h16m47.168317634s) [upload=11638]: Got next segment. Inline: false Aug 26 05:20:20.009587307 (13h16m47.168353041s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:20.009592938 (13h16m47.168358692s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:20:24.249473770 (13h16m51.408239504s) [seg_pos={0 0}, upload=11638]: Begin upload segment... Aug 26 05:20:24.249510921 (13h16m51.408276645s) [seg_pos={0 0}, upload=11638]: Done begin upload segment. Aug 26 05:20:24.249529397 (13h16m51.408295131s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249545949 (13h16m51.408311683s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249880088 (13h16m51.408645822s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.249941786 (13h16m51.40870752s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250105790 (13h16m51.408871524s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250213606 (13h16m51.40897933s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250326021 (13h16m51.409091755s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250484965 (13h16m51.409250699s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250541844 (13h16m51.409307578s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250759721 (13h16m51.409525455s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250809266 (13h16m51.409575s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.250970333 (13h16m51.409736067s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251052360 (13h16m51.409818094s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251279666 (13h16m51.4100454s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251521318 (13h16m51.410287042s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:24.251737351 (13h16m51.410503085s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Uploading piece... Aug 26 05:20:25.976881200 (13h16m53.135646934s) [upload=11638]: Next returned nil segment Aug 26 05:20:25.976899275 (13h16m53.135665009s) [upload=11638]: Waiting for error group managing segments... Aug 26 05:20:26.279055872 (13h16m53.437821606s) [noise=true , address=45.91.116.8:4047 , piece_id=V3XODZAQUS3IMCBK3F54Q7YH5QIGNJ6R5M5T4CTBIFIUCYTIXZAQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.284159517 (13h16m53.442925251s) [noise=true , address=45.91.116.12:4226 , piece_id=GLZBKOGQXMASG7NO26A7GHZGG7AYYELHN6LCQ2DRA44YJ2BQSYYQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.292293732 (13h16m53.451059476s) [noise=true , address=77.90.31.21:4879 , piece_id=XYAKPMZ225LVV36IG6LGOMX5JBS2B5ODOSBAYVW2DJC56WVDCQSA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.297107562 (13h16m53.455873336s) [noise=true , address=45.91.116.6:4974 , piece_id=BKQ2WZQC3Q3DCLKBR7D7ENKSGA2LVTVJ4P5DTTUH75GPNYNT6BWQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.317633216 (13h16m53.47639895s) [noise=true , address=45.91.116.6:4975 , piece_id=JVCXBGBPW4QUXXFQFGB6EK4P4CJUFYAOZUAARWLIIGEZSBWRE2BA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.322231294 (13h16m53.480997028s) [noise=true , address=77.90.31.15:4699 , piece_id=C5BJRDR27R7WZAAA7JNIQ2UFMNXX7XCBFGOHAQETRY4VA5AI53SQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.330197897 (13h16m53.488963631s) [noise=true , address=45.91.116.12:4225 , piece_id=6KGDGEU675MSELUANW7EYW2KR2CTM75UQOQF4DLLPBMVS4PR4GCA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351459338 (13h16m53.510225072s) [noise=true , address=77.90.31.11:4554 , piece_id=Z352K37SOL7CRUI76BHPICYA2WKSC3KJ72COM6LNYNA54QKBMYRA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.351904902 (13h16m53.510670636s) [noise=true , address=45.91.116.5:4297 , piece_id=Q6OUUS7X4VGG5ZXI7FIPPXKZUWBA6YQNHVL2TLROUNXEKZVO3E4Q, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.368061736 (13h16m53.52682747s) [noise=true , address=77.90.31.11:4553 , piece_id=KQBMBX354IWGT77OCNVLFEKAJ3VL6Z7E3TMMXEJH4C5T6WCUOVFA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.371712331 (13h16m53.530478055s) [noise=true , address=45.91.116.7:4010 , piece_id=R2SGT7URJVHPEG2XALMQOUOCWLICLJ3QHCP2ZXDU3FTBWSY7XUZQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.398177028 (13h16m53.556942762s) [noise=true , address=45.91.116.14:4190 , piece_id=ZSG7V6H3QBSA7E35CRUCMKQHAQF7VD7GEYLR4CBFI6ADG7M6GA7A, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427000680 (13h16m53.585766444s) [noise=true , address=77.90.31.15:4698 , piece_id=2GBBONXAU3RS54RVUAG2TNSUBJLOB3YGHDMATDIB3GGXRGHREVHQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: <nil> Aug 26 05:20:26.427065153 (13h16m53.585830877s) [seg_pos={0 0}, upload=11638]: Segment reached optimal threshold of 13 pieces. Aug 26 05:20:26.427195283 (13h16m53.585961017s) [noise=true , address=77.90.31.16:4734 , piece_id=7ASDH6P3AGFWBZ5TOWUFN57SU6T5JCBXLSYYPXZVCFPPAXTES2BQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427261379 (13h16m53.586027153s) [noise=true , address=104.36.82.8:4969 , piece_id=X72T4AX5HYONVM44NMFIJDLWXCOFGI2F3HNFTJILBJ2BUNZPW3NQ, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427283992 (13h16m53.586049726s) [noise=true , address=45.91.116.7:4009 , piece_id=KH73E7SOEEU4TTHMSNXFXW2QQB27PRMKY7F3WVVLAWCSRGJK5HBA, seg_pos={0 0}, upload=11638]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Aug 26 05:20:26.427295144 (13h16m53.586060878s) [seg_pos={0 0}, upload=11638]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:20:26.427357523 (13h16m53.586123257s) [upload=11638]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:20:26.427361481 (13h16m53.586127215s) [upload=11638]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:46.008171151 (13h17m13.166936875s) [upload=11638]: Done uploading segments... Aug 26 05:20:46.008235204 (13h17m13.167000938s) [upload=11638]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 26.648661734s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [..........................XXX....XX........XX..XX.XXXX...XXX] duration: 23.517329541s FAIL (2025-08-26 05:20:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:22.919769379 (13h16m50.078535113s) [upload=11639]: Starting upload Aug 26 05:20:22.919825266 (13h16m50.078591s) [upload=11639]: Done starting upload Aug 26 05:20:22.919874208 (13h16m50.078639943s) [upload=11639]: Uploading segments... Aug 26 05:20:22.919909497 (13h16m50.078675221s) [upload=11639]: Got next segment. Inline: true Aug 26 05:20:22.919913534 (13h16m50.078679268s) [upload=11639]: Waiting for error group managing segments... Aug 26 05:20:22.919947639 (13h16m50.078713363s) [upload=11639]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:22.919951256 (13h16m50.07871699s) [upload=11639]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:20:22.919953741 (13h16m50.078719465s) [upload=11639]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:45.788647584 (13h17m12.947413328s) [upload=11639]: Done uploading segments... Aug 26 05:20:45.788670156 (13h17m12.94743592s) [upload=11639]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 23.517348648s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............................................XX...X......X] duration: 22.175617574s FAIL (2025-08-26 05:20:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:20:18.000025717 (13h16m45.158791451s) [upload=11637]: Starting upload Aug 26 05:20:18.000093988 (13h16m45.158859722s) [upload=11637]: Done starting upload Aug 26 05:20:18.000148342 (13h16m45.158914066s) [upload=11637]: Uploading segments... Aug 26 05:20:18.000183359 (13h16m45.158949093s) [upload=11637]: Got next segment. Inline: true Aug 26 05:20:18.000256940 (13h16m45.159022674s) [upload=11637]: Waiting for error group managing segments... Aug 26 05:20:18.000297667 (13h16m45.159063401s) [upload=11637]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:20:18.000302246 (13h16m45.15906798s) [upload=11637]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:20:18.000305281 (13h16m45.159071015s) [upload=11637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:20:39.528469747 (13h17m6.687235481s) [upload=11637]: Done uploading segments... Aug 26 05:20:39.528487431 (13h17m6.687253165s) [upload=11637]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 22.17564173s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 9 out of 60 is failed (threshold=3) [........................X..X...XX.........X...X...XXX.......] duration: 21.866565062s FAIL (2025-08-26 05:20:39 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 21.866596321s core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [.............................X................XX...........X] duration: 4.257370788s remote: "tcp:185.244.226.2:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Methods=GET, HEAD X-Request-Id=RUZraZXZvFb Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:20:32 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:20:32 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 4.257393411s edge linksharing bgp us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)