Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.......................................XX..X........XXXX.X..] duration: 25.153118417s FAIL (2025-08-26 05:15:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 25.153144678s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 9 out of 60 is failed (threshold=3) [.....................................X.X...X.......XXX.X..XX] duration: 30.000973799s FAIL (2025-08-26 05:15:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001001882s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.............................XXX.....XX.........XXX.X.XXX..X] duration: 48.379608267s FAIL (2025-08-26 05:15:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 48.379631521s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X...............XX.] duration: 10.497157238s remote: "tcp:45.38.24.2:443" response headers: Vary=Origin X-Amz-Request-Id=185F39288F4A5A63 X-Request-Id=5K7ijR78zbf Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:13:46 GMT Server=Storj target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:15:06 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F39288F4A5A63</RequestId><HostId></HostId></Error>" Duration: 10.497189359s edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 3 out of 60 is failed (threshold=6) [......................................X................XX...] duration: 8.567440682s remote: "tcp:185.244.226.2:443" response headers: Date=Tue, 26 Aug 2025 05:12:19 GMT Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=dD8wM4mmfux Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:15:03 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 8.567466713s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X...................X...X.] duration: 35.495250599s FAIL (2025-08-26 05:15:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== 13h9m53.691805268s) [upload=11539]: Starting upload Aug 26 05:13:26.533106392 (13h9m53.691872116s) [upload=11539]: Done starting upload Aug 26 05:13:26.533334328 (13h9m53.692100073s) [upload=11539]: Uploading segments... Aug 26 05:13:26.533413730 (13h9m53.692179454s) [upload=11539]: Got next segment. Inline: false Aug 26 05:13:26.533437896 (13h9m53.69220362s) [upload=11539]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:13:26.533444760 (13h9m53.692210494s) [upload=11539]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:13:30.979080398 (13h9m58.137846132s) [seg_pos={0 0}, upload=11539]: Begin upload segment... Aug 26 05:13:30.979132277 (13h9m58.137898011s) [seg_pos={0 0}, upload=11539]: Done begin upload segment. Aug 26 05:13:30.979152605 (13h9m58.137918339s) [noise=true , address=79.127.205.234:4616 , piece_id=WUGLF2QYM6FSW4D6LDGVLR5HW2WP44DEOF45WP2BRNRCPGNZ774A, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.979255142 (13h9m58.138020876s) [noise=true , address=45.91.116.7:4025 , piece_id=5NJHSDC3ULXROJ4BQKXOMYWKKIL3SD6MU4VXJXCVUAN72HG3VHXQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.979518135 (13h9m58.138283869s) [noise=true , address=45.91.116.4:4951 , piece_id=QBAWZ6IWH3TRH6PTEGZZEP6ZIQLJECHKU7VO23RI5VV3EWX4MICA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.979796197 (13h9m58.138561931s) [noise=true , address=45.91.116.7:4030 , piece_id=UFGP2YL5F32XYHJIFGWYFFDTAW2ENPZWWUUDC45KZZQN5XTGC6FA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.979928440 (13h9m58.138694265s) [noise=true , address=45.91.116.5:4310 , piece_id=7CCUOR3ZV3FVDQHNJRZRHBPGV3IJWPOXI5EHHPC2MI7P7NBGQ5IQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980077485 (13h9m58.138843219s) [noise=true , address=104.36.82.50:4016 , piece_id=33SKSFJ6MCHS42HS4SZOLYM7B2CW3EXAAL3IQBJGWE2PJWSVUTCQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980412015 (13h9m58.139177749s) [noise=true , address=77.90.31.18:4827 , piece_id=JRSEKVDJKAHFXZ6VLBRRWSWZGSQBR2NAXY3CEQWZ3SIKEM625ZVQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980424239 (13h9m58.139189973s) [noise=true , address=104.36.82.60:4346 , piece_id=W5LIDJ26ZASWKCB2JUCWJ4A4HSIPQIR6MJJCNC6GWFXRH22D3U2A, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980701369 (13h9m58.139467093s) [noise=true , address=45.91.116.9:4277 , piece_id=7RJRVT75E4PPPLTGRMIRVSBD44JBEY6APDFNFK5YTAFNMHX3VNZA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980855825 (13h9m58.139621559s) [noise=true , address=104.36.82.53:4129 , piece_id=AQGH2LPPC6GXGCZW3LA2ZXR56SVI5Q2MNAYWHNEGXE2LPMM4C3RA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.981019418 (13h9m58.139785152s) [noise=true , address=104.36.82.15:4264 , piece_id=CXU63LRJDOZUXEZZSI3QK6MPKQMR22JCEKSEENIN5V2C57IPHIGQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.981207026 (13h9m58.13997276s) [noise=true , address=104.36.82.5:4870 , piece_id=YX5ZNF5FK5AA2KT3NA4A4X3SJO6VP2JBBBX27VA7OF3QGI4E45OQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.981552999 (13h9m58.140318733s) [noise=true , address=45.91.116.12:4237 , piece_id=7YJRSHPEG2KOWRLKL7PVQ3E5HRSYBNP343CLBDUXIM5VHGPEPM6Q, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.982384770 (13h9m58.141150504s) [noise=true , address=79.127.219.47:4067 , piece_id=EILJ5LQG4BZ7NCAEVSIOEP3AGQB7UUWJOTCE333KPP5VAJBNSGJQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.986051095 (13h9m58.144816829s) [noise=true , address=64.49.13.137:4503 , piece_id=R4QR3LQKVL3FJ66IC4JAJMP5NYUIRKYLXNQTVCPFPMAJIIU6GBYQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.986346170 (13h9m58.145111904s) [noise=true , address=104.36.82.23:4476 , piece_id=EIZYKMAIYDGBMU6BVZKM4AW6Z2DMD4BBTYN2TV4GT6MLLZUFGDAA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.986840967 (13h9m58.145606731s) [noise=true , address=45.91.116.8:4049 , piece_id=KXMRX76JKJS5JOG6KQWIITYG7YSF3KBTGPM66OJI5J4RKMYWZGEA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.991518838 (13h9m58.150284572s) [noise=true , address=77.90.31.15:4715 , piece_id=CEQZ5YSDT5736Y4DA7XWVBP6RNC3RKCKNVH3PZNRPEK4C2MPNMSQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:32.121679708 (13h9m59.280445442s) [upload=11539]: Next returned nil segment Aug 26 05:13:32.121693524 (13h9m59.280459258s) [upload=11539]: Waiting for error group managing segments... Aug 26 05:13:32.410653901 (13h9m59.569419635s) [noise=true , address=79.127.205.234:4616 , piece_id=WUGLF2QYM6FSW4D6LDGVLR5HW2WP44DEOF45WP2BRNRCPGNZ774A, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.418062867 (13h9m59.576828601s) [noise=true , address=64.49.13.137:4503 , piece_id=R4QR3LQKVL3FJ66IC4JAJMP5NYUIRKYLXNQTVCPFPMAJIIU6GBYQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.872015110 (13h10m0.030780844s) [noise=true , address=45.91.116.9:4277 , piece_id=7RJRVT75E4PPPLTGRMIRVSBD44JBEY6APDFNFK5YTAFNMHX3VNZA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.874479585 (13h10m0.033245319s) [noise=true , address=45.91.116.4:4951 , piece_id=QBAWZ6IWH3TRH6PTEGZZEP6ZIQLJECHKU7VO23RI5VV3EWX4MICA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.875739707 (13h10m0.034505441s) [noise=true , address=45.91.116.12:4237 , piece_id=7YJRSHPEG2KOWRLKL7PVQ3E5HRSYBNP343CLBDUXIM5VHGPEPM6Q, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.876831045 (13h10m0.035596769s) [noise=true , address=45.91.116.7:4025 , piece_id=5NJHSDC3ULXROJ4BQKXOMYWKKIL3SD6MU4VXJXCVUAN72HG3VHXQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.881391751 (13h10m0.040157485s) [noise=true , address=45.91.116.7:4030 , piece_id=UFGP2YL5F32XYHJIFGWYFFDTAW2ENPZWWUUDC45KZZQN5XTGC6FA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.882125225 (13h10m0.040890959s) [noise=true , address=45.91.116.5:4310 , piece_id=7CCUOR3ZV3FVDQHNJRZRHBPGV3IJWPOXI5EHHPC2MI7P7NBGQ5IQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.886042058 (13h10m0.044807792s) [noise=true , address=77.90.31.18:4827 , piece_id=JRSEKVDJKAHFXZ6VLBRRWSWZGSQBR2NAXY3CEQWZ3SIKEM625ZVQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.906624451 (13h10m0.065390215s) [noise=true , address=45.91.116.8:4049 , piece_id=KXMRX76JKJS5JOG6KQWIITYG7YSF3KBTGPM66OJI5J4RKMYWZGEA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.911752994 (13h10m0.070518728s) [noise=true , address=79.127.219.47:4067 , piece_id=EILJ5LQG4BZ7NCAEVSIOEP3AGQB7UUWJOTCE333KPP5VAJBNSGJQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.919694089 (13h10m0.078459823s) [noise=true , address=104.36.82.5:4870 , piece_id=YX5ZNF5FK5AA2KT3NA4A4X3SJO6VP2JBBBX27VA7OF3QGI4E45OQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.925093088 (13h10m0.083858823s) [noise=true , address=77.90.31.15:4715 , piece_id=CEQZ5YSDT5736Y4DA7XWVBP6RNC3RKCKNVH3PZNRPEK4C2MPNMSQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.954273382 (13h10m0.113039106s) [noise=true , address=104.36.82.15:4264 , piece_id=CXU63LRJDOZUXEZZSI3QK6MPKQMR22JCEKSEENIN5V2C57IPHIGQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.954298981 (13h10m0.113064715s) [seg_pos={0 0}, upload=11539]: Segment reached optimal threshold of 14 pieces. Aug 26 05:13:32.954438438 (13h10m0.113204172s) [noise=true , address=104.36.82.53:4129 , piece_id=AQGH2LPPC6GXGCZW3LA2ZXR56SVI5Q2MNAYWHNEGXE2LPMM4C3RA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYQbZWuwwz7cypYmPhVwM4wygB3DsJtr3M5vxx296ZPVb3B1Z): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:32.954496059 (13h10m0.113261793s) [noise=true , address=104.36.82.50:4016 , piece_id=33SKSFJ6MCHS42HS4SZOLYM7B2CW3EXAAL3IQBJGWE2PJWSVUTCQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jC98jEWn6K8jFHPA9knJeHAkuNEmcS7ThxUvbySDfbq6FmKVR): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:32.954574117 (13h10m0.113339841s) [noise=true , address=104.36.82.60:4346 , piece_id=W5LIDJ26ZASWKCB2JUCWJ4A4HSIPQIR6MJJCNC6GWFXRH22D3U2A, seg_pos={0 0}, upload=11539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:32.954613133 (13h10m0.113378867s) [noise=true , address=104.36.82.23:4476 , piece_id=EIZYKMAIYDGBMU6BVZKM4AW6Z2DMD4BBTYN2TV4GT6MLLZUFGDAA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:32.954680040 (13h10m0.113445774s) [seg_pos={0 0}, upload=11539]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:13:32.954769602 (13h10m0.113535336s) [upload=11539]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:13:32.954774111 (13h10m0.113539845s) [upload=11539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:13:38.764463199 (13h10m5.923228933s) [upload=11539]: Done uploading segments... Aug 26 05:13:38.764494800 (13h10m5.923260544s) [upload=11539]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 35.495275137s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....................................................X.XX...] duration: 24.640888926s FAIL (2025-08-26 05:14:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 24.640910537s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 11.194082298s FAIL (2025-08-26 05:14:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:12:51.473649410 (13h9m18.632415144s) [upload=11530]: Starting upload Aug 26 05:12:51.473735445 (13h9m18.632501179s) [upload=11530]: Done starting upload Aug 26 05:12:51.473829374 (13h9m18.632595098s) [upload=11530]: Uploading segments... Aug 26 05:12:51.473925689 (13h9m18.632691423s) [upload=11530]: Got next segment. Inline: true Aug 26 05:12:51.473930889 (13h9m18.632696623s) [upload=11530]: Waiting for error group managing segments... Aug 26 05:12:51.473976456 (13h9m18.63274219s) [upload=11530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:12:51.473981656 (13h9m18.63274739s) [upload=11530]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:12:51.473984131 (13h9m18.632749865s) [upload=11530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:13:16.909514208 (13h9m44.068279942s) [upload=11530]: Done uploading segments... Aug 26 05:13:16.909528365 (13h9m44.0682941s) [upload=11530]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 11.194109128s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 7 out of 60 is failed (threshold=3) [.................................X..X...XX.........X...X...X] duration: 30.000358295s FAIL (2025-08-26 05:14:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000369607s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 11 out of 60 is failed (threshold=3) [..................................XXX....XX........XX..XX.XX] duration: 30.000509996s FAIL (2025-08-26 05:14:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:14:15.406413735 (13h10m42.565179459s) [upload=11549]: Starting upload Aug 26 05:14:15.406467598 (13h10m42.565233332s) [upload=11549]: Done starting upload Aug 26 05:14:15.406516081 (13h10m42.565281815s) [upload=11549]: Uploading segments... Aug 26 05:14:15.406551909 (13h10m42.565317643s) [upload=11549]: Got next segment. Inline: true Aug 26 05:14:15.406556027 (13h10m42.565321761s) [upload=11549]: Waiting for error group managing segments... Aug 26 05:14:15.406596074 (13h10m42.565361808s) [upload=11549]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:14:15.406601224 (13h10m42.565366958s) [upload=11549]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:14:15.406604299 (13h10m42.565370033s) [upload=11549]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:14:27.715485669 (13h10m54.874251403s) [upload=11549]: Done uploading segments... Aug 26 05:14:27.715503513 (13h10m54.874269247s) [upload=11549]: Upload finished. err: <nil> Duration:* 30.000531848s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................................................X.XX..] duration: 49.883720397s FAIL (2025-08-26 05:14:25 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 49.883740485s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [...............................XXX...X..............X.X...XX] duration: 30.00113444s FAIL (2025-08-26 05:14:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:13:53.630178104 (13h10m20.788943838s) [upload=11545]: Starting upload Aug 26 05:13:53.630244632 (13h10m20.789010366s) [upload=11545]: Done starting upload Aug 26 05:13:53.630344913 (13h10m20.789110647s) [upload=11545]: Uploading segments... Aug 26 05:13:53.630486806 (13h10m20.78925253s) [upload=11545]: Got next segment. Inline: false Aug 26 05:13:53.630530128 (13h10m20.789295862s) [upload=11545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:13:53.630535288 (13h10m20.789301022s) [upload=11545]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:13:59.364314514 (13h10m26.523080258s) [seg_pos={0 0}, upload=11545]: Begin upload segment... Aug 26 05:13:59.364386091 (13h10m26.523151885s) [seg_pos={0 0}, upload=11545]: Done begin upload segment. Aug 26 05:13:59.364431257 (13h10m26.523197011s) [noise=true , address=104.36.82.11:4115 , piece_id=P73JDBPQPLZ5H2E5HRFTGZXMRTLSLT33MRLGFYKGPHRPVOPXYC2Q, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.364441306 (13h10m26.52320704s) [noise=true , address=104.36.82.7:4912 , piece_id=K2HOZUWCKTUGOK3X5MTPNN74KXSZVKHZJ46Q5D34WOW2VFG7QMTA, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.365233552 (13h10m26.523999316s) [noise=true , address=45.91.116.4:4937 , piece_id=YPDGV7HA5JWQNLTRJBNYN3XYHL52O3JNBBV5E4X3GLV3UJYPZ4DQ, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.365889307 (13h10m26.524655041s) [noise=true , address=45.91.116.4:4939 , piece_id=PHTOVQP3B6WQZ3F3S3SYRCEPZF4UGWLJEJIC7OAO3KAIHEUN2QOA, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.366287660 (13h10m26.525053394s) [noise=true , address=45.91.116.12:4227 , piece_id=CEQHI2FJCOL75EBJF2LO2AFKDMHVSIL6XTLMADNQH6CXCKCHRKWA, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.366322145 (13h10m26.52508788s) [noise=true , address=77.90.31.19:4841 , piece_id=RNW3U4VUR42PUKGTY64OEIFJ4SJSECOQBYQ64IX26WACRQYSMWZQ, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.366673518 (13h10m26.525439252s) [noise=true , address=77.90.31.18:4805 , piece_id=FAIRQ4C7FLB6IDKHUVUVK7Q2BFOXBEU3W6UI4RC4CS4KXZ7YETNQ, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.366784631 (13h10m26.525550365s) [noise=true , address=104.36.82.13:4185 , piece_id=3EYSAUUODMM53PDHCMMRW7CRPGKBIORMXMW6ZSXPPEYXXFCOJBTQ, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.366973382 (13h10m26.525739116s) [noise=true , address=104.36.82.6:4875 , piece_id=OU6EEDAVFUBHNC5S7IKJTPYODHHTFKFXAEDOWUOXI23N74NZ4EUQ, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.367132877 (13h10m26.525898611s) [noise=true , address=104.36.82.16:4295 , piece_id=XG6GU3UGT5SFBIOSFZSZNLTTGUXKN3SCRC7TF5THT2VLWXQQHX3Q, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.367292341 (13h10m26.526058076s) [noise=true , address=45.91.116.5:4297 , piece_id=6NWG7GS3FKJZ4UU4FVZXGCYI6HPDUVULNWZSOPGNIZ7AHDYDNVVA, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.367581094 (13h10m26.526346818s) [noise=true , address=45.91.116.10:4082 , piece_id=6XRFIP65N6LNGHPSUT2FPWADIMNLOFTEERLDWUX6746SIP2BCWRA, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.367930944 (13h10m26.526696678s) [noise=true , address=77.90.31.15:4697 , piece_id=GXB2VJPTIX7ZWZXP5CVYVPJN4I47W5XLN3CCSF53CC534BHQL2WQ, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.368278939 (13h10m26.527044673s) [noise=true , address=104.36.82.7:4911 , piece_id=QQZN4WVY3I7MX4RTBLFJVUPE4XVWHZXN4VH3HXKC6RBFMDDQ6ZDQ, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.368561651 (13h10m26.527327385s) [noise=true , address=104.36.82.2:4732 , piece_id=HQVM3UTZH27BVJHOHM7NQ5D54ZS7G6EJ36N2GWA7RRS3QOFFSJKQ, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:13:59.368826026 (13h10m26.52759176s) [noise=true , address=77.90.31.10:4519 , piece_id=VOMOIQROOMBQX4555J5L3AJCHORJDZ5VSSUQPKIA6QAJROTKH6RA, seg_pos={0 0}, upload=11545]: Uploading piece... Aug 26 05:14:01.014135411 (13h10m28.172901136s) [upload=11545]: Next returned nil segment Aug 26 05:14:01.014153285 (13h10m28.172919019s) [upload=11545]: Waiting for error group managing segments... Aug 26 05:14:01.383969291 (13h10m28.542735035s) [noise=true , address=45.91.116.5:4297 , piece_id=6NWG7GS3FKJZ4UU4FVZXGCYI6HPDUVULNWZSOPGNIZ7AHDYDNVVA, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.393282581 (13h10m28.552048315s) [noise=true , address=45.91.116.4:4937 , piece_id=YPDGV7HA5JWQNLTRJBNYN3XYHL52O3JNBBV5E4X3GLV3UJYPZ4DQ, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.397635680 (13h10m28.556401414s) [noise=true , address=45.91.116.4:4939 , piece_id=PHTOVQP3B6WQZ3F3S3SYRCEPZF4UGWLJEJIC7OAO3KAIHEUN2QOA, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.402271640 (13h10m28.561037375s) [noise=true , address=77.90.31.15:4697 , piece_id=GXB2VJPTIX7ZWZXP5CVYVPJN4I47W5XLN3CCSF53CC534BHQL2WQ, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.409456278 (13h10m28.568222012s) [noise=true , address=45.91.116.12:4227 , piece_id=CEQHI2FJCOL75EBJF2LO2AFKDMHVSIL6XTLMADNQH6CXCKCHRKWA, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.410228005 (13h10m28.568993739s) [noise=true , address=104.36.82.2:4732 , piece_id=HQVM3UTZH27BVJHOHM7NQ5D54ZS7G6EJ36N2GWA7RRS3QOFFSJKQ, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.413246350 (13h10m28.572012084s) [noise=true , address=45.91.116.10:4082 , piece_id=6XRFIP65N6LNGHPSUT2FPWADIMNLOFTEERLDWUX6746SIP2BCWRA, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.424836807 (13h10m28.583602541s) [noise=true , address=104.36.82.16:4295 , piece_id=XG6GU3UGT5SFBIOSFZSZNLTTGUXKN3SCRC7TF5THT2VLWXQQHX3Q, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.462355466 (13h10m28.6211212s) [noise=true , address=77.90.31.19:4841 , piece_id=RNW3U4VUR42PUKGTY64OEIFJ4SJSECOQBYQ64IX26WACRQYSMWZQ, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.474818462 (13h10m28.633584196s) [noise=true , address=77.90.31.10:4519 , piece_id=VOMOIQROOMBQX4555J5L3AJCHORJDZ5VSSUQPKIA6QAJROTKH6RA, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.476317500 (13h10m28.635083234s) [noise=true , address=104.36.82.11:4115 , piece_id=P73JDBPQPLZ5H2E5HRFTGZXMRTLSLT33MRLGFYKGPHRPVOPXYC2Q, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.476659544 (13h10m28.635425278s) [noise=true , address=104.36.82.6:4875 , piece_id=OU6EEDAVFUBHNC5S7IKJTPYODHHTFKFXAEDOWUOXI23N74NZ4EUQ, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.491440707 (13h10m28.650206441s) [noise=true , address=104.36.82.13:4185 , piece_id=3EYSAUUODMM53PDHCMMRW7CRPGKBIORMXMW6ZSXPPEYXXFCOJBTQ, seg_pos={0 0}, upload=11545]: Done uploading piece. err: <nil> Aug 26 05:14:01.491467207 (13h10m28.650232941s) [seg_pos={0 0}, upload=11545]: Segment reached optimal threshold of 13 pieces. Aug 26 05:14:01.491586266 (13h10m28.650352s) [noise=true , address=104.36.82.7:4911 , piece_id=QQZN4WVY3I7MX4RTBLFJVUPE4XVWHZXN4VH3HXKC6RBFMDDQ6ZDQ, seg_pos={0 0}, upload=11545]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Aug 26 05:14:01.491645038 (13h10m28.650410772s) [noise=true , address=77.90.31.18:4805 , piece_id=FAIRQ4C7FLB6IDKHUVUVK7Q2BFOXBEU3W6UI4RC4CS4KXZ7YETNQ, seg_pos={0 0}, upload=11545]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Aug 26 05:14:01.491825062 (13h10m28.650590796s) [noise=true , address=104.36.82.7:4912 , piece_id=K2HOZUWCKTUGOK3X5MTPNN74KXSZVKHZJ46Q5D34WOW2VFG7QMTA, seg_pos={0 0}, upload=11545]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: write tcp 188.166.225.170:51042->104.36.82.7:4912: use of closed network connection; write tcp 188.166.225.170:51042->104.36.82.7:4912: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51042->104.36.82.7:4912: use of closed network connection Aug 26 05:14:01.491894525 (13h10m28.650660259s) [seg_pos={0 0}, upload=11545]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:14:01.491998855 (13h10m28.650764599s) [upload=11545]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:14:01.492005738 (13h10m28.650771472s) [upload=11545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:14:06.239027108 (13h10m33.397792842s) [upload=11545]: Done uploading segments... Aug 26 05:14:06.239050784 (13h10m33.397816518s) [upload=11545]: Upload finished. err: <nil> Duration: 30.001155161s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 3 out of 60 is failed (threshold=6) [.......................................X................XX..] duration: 30.430242118s remote: "tcp:185.244.226.2:443" response headers: Date=Tue, 26 Aug 2025 05:12:19 GMT Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=dD8wM4mmfux Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:14:21 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 30.430266646s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..............................XXX.....XX.........XXX.X.XXX..] duration: 24.315527291s FAIL (2025-08-26 05:14:18 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 24.315557439s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 6 out of 60 is failed (threshold=3) [..................................X..X...XX.........X...X...] duration: 22.175091808s FAIL (2025-08-26 05:14:18 UTC) orbiter warning: operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 22.175119192s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [..........................................X.........X..X..XX] duration: 621.383748ms remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=185F39300DA6BA10 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:14:18 GMT Content-Length=423 Content-Type=application/xml X-Request-Id=bn7zYWpT3zz target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:14:18 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F39300DA6BA10</RequestId><HostId></HostId></Error>" Duration: 621.407574ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [........................................XX..X........XXXX.X.] duration: 21.000285788s FAIL (2025-08-26 05:14:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.000308581s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 8 out of 60 is failed (threshold=3) [......................................X.X...X.......XXX.X..X] duration: 30.000799247s FAIL (2025-08-26 05:14:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000814277s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [................................XXX...X..............X.X...X] duration: 30.0020328s FAIL (2025-08-26 05:13:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:13:22.290172205 (13h9m49.448937949s) [upload=11538]: Starting upload Aug 26 05:13:22.290228884 (13h9m49.448994628s) [upload=11538]: Done starting upload Aug 26 05:13:22.290286464 (13h9m49.449052218s) [upload=11538]: Uploading segments... Aug 26 05:13:22.290432774 (13h9m49.449198519s) [upload=11538]: Got next segment. Inline: false Aug 26 05:13:22.290470065 (13h9m49.44923583s) [upload=11538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:13:22.290478101 (13h9m49.449243845s) [upload=11538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:13:26.525944218 (13h9m53.684709952s) [seg_pos={0 0}, upload=11538]: Begin upload segment... Aug 26 05:13:26.525993422 (13h9m53.684759146s) [seg_pos={0 0}, upload=11538]: Done begin upload segment. Aug 26 05:13:26.526006457 (13h9m53.684772181s) [noise=true , address=104.36.82.4:4804 , piece_id=LHGYONHUZS73BU4EQECDCARHC6OIKFINPCYK6ITGYWXT3LAL4G7Q, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.526018711 (13h9m53.684784435s) [noise=true , address=104.36.82.13:4185 , piece_id=BXNLAXPPUZPYWK4OS7FHGWJA3PHRWBBXNHHKVZK7C2GUIH7NK36A, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.526380092 (13h9m53.685145826s) [noise=true , address=45.91.116.9:4263 , piece_id=UZ3SLJIAJMXQOVATDFBKKRV3SPNKETIJ2YVZTL7ISFSTKPUUFSEA, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.526413986 (13h9m53.685179721s) [noise=true , address=104.36.82.14:4221 , piece_id=7XF7FAZZ3UPGJGT3VDGZNZJSAZEHYMJT3KBOR3EZWR7OZXROZ4KQ, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.526657823 (13h9m53.685423557s) [noise=true , address=104.36.82.2:4729 , piece_id=ZC4XKS5QMYRWUS5YBAGLUEC5G24EPKXFR2NBD7ZXA5CPUTA7ILLQ, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.526702830 (13h9m53.685468564s) [noise=true , address=45.91.116.8:4045 , piece_id=S2Q3NLUNWEM6VFUY7A627NUVXPRUAAZM2QF7ZHWHUAQZYRYFOOAA, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.526997392 (13h9m53.685763127s) [noise=true , address=77.90.31.10:4517 , piece_id=NGEL4KLJJSPZEE4XRUH2UV62OV33SBYBCFMKUD4PZNWLYFO4JC5Q, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.527265636 (13h9m53.68603137s) [noise=true , address=45.91.116.14:4191 , piece_id=XB2DWU46DPG3BBSICYOU24NAWMXIVK4UMWYGBR2DK72AECA225DQ, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.527478734 (13h9m53.686244468s) [noise=true , address=45.91.116.4:4940 , piece_id=MQ5IRHA3N5HMV4Y5CMBOTFEB2YPOPDFTDPDMCZ7EYEIHP5BPGC2A, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.527773658 (13h9m53.686539393s) [noise=true , address=45.91.116.4:4938 , piece_id=PIVYWO5S7GV44OF7RBXDFZWO2JGS2O7NMOB46O76MXYKRGCJUNTQ, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.528044777 (13h9m53.686810501s) [noise=true , address=77.90.31.18:4806 , piece_id=TEW5OX5YYTYXK6TINHJCNM2PGBPVOP4U6ZQJ76X26MWATN7ONMRQ, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.528367384 (13h9m53.687133118s) [noise=true , address=45.91.116.13:4153 , piece_id=H2GK5Q4JFZ5VYEWVHBYG2I3ID26YDZ7UM7UA25Y4A6MFLLTEKXEQ, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.528597355 (13h9m53.687363089s) [noise=true , address=45.91.116.12:4225 , piece_id=SAZ43NG3FGM4HASGO22665GWG3ROINKBZF3C7CZLVEDO2L5EIK7A, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.528835530 (13h9m53.687601264s) [noise=true , address=45.91.116.5:4297 , piece_id=P2PUERXV4WF6A7JMGN2KK2SQGAP2N7Y4LGJ2QJHLJVPBPKNP6FBA, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.529041184 (13h9m53.687806918s) [noise=true , address=45.91.116.6:4974 , piece_id=G7HBG4XKS2CKF63DXTJJ2BYCSMPVR2NEFEIZCZMF2Z6J7UL4KUQA, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:26.529242589 (13h9m53.688008323s) [noise=true , address=77.90.31.13:4627 , piece_id=DKM4NHW2J6TLUEYGB2AMBYAFATV3DHY5KCJSXRUHL7Q4HWGMVL4A, seg_pos={0 0}, upload=11538]: Uploading piece... Aug 26 05:13:28.246668301 (13h9m55.405434035s) [upload=11538]: Next returned nil segment Aug 26 05:13:28.246708779 (13h9m55.405474503s) [upload=11538]: Waiting for error group managing segments... Aug 26 05:13:28.554383684 (13h9m55.713149418s) [noise=true , address=45.91.116.8:4045 , piece_id=S2Q3NLUNWEM6VFUY7A627NUVXPRUAAZM2QF7ZHWHUAQZYRYFOOAA, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.556169320 (13h9m55.714935055s) [noise=true , address=45.91.116.9:4263 , piece_id=UZ3SLJIAJMXQOVATDFBKKRV3SPNKETIJ2YVZTL7ISFSTKPUUFSEA, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.560214521 (13h9m55.718980255s) [noise=true , address=45.91.116.13:4153 , piece_id=H2GK5Q4JFZ5VYEWVHBYG2I3ID26YDZ7UM7UA25Y4A6MFLLTEKXEQ, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.563930571 (13h9m55.722696305s) [noise=true , address=77.90.31.10:4517 , piece_id=NGEL4KLJJSPZEE4XRUH2UV62OV33SBYBCFMKUD4PZNWLYFO4JC5Q, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.565733641 (13h9m55.724499375s) [noise=true , address=45.91.116.12:4225 , piece_id=SAZ43NG3FGM4HASGO22665GWG3ROINKBZF3C7CZLVEDO2L5EIK7A, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.566553590 (13h9m55.725319324s) [noise=true , address=45.91.116.4:4938 , piece_id=PIVYWO5S7GV44OF7RBXDFZWO2JGS2O7NMOB46O76MXYKRGCJUNTQ, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.568349025 (13h9m55.727114759s) [noise=true , address=77.90.31.13:4627 , piece_id=DKM4NHW2J6TLUEYGB2AMBYAFATV3DHY5KCJSXRUHL7Q4HWGMVL4A, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.568699486 (13h9m55.72746522s) [noise=true , address=45.91.116.4:4940 , piece_id=MQ5IRHA3N5HMV4Y5CMBOTFEB2YPOPDFTDPDMCZ7EYEIHP5BPGC2A, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.571092244 (13h9m55.729857978s) [noise=true , address=45.91.116.6:4974 , piece_id=G7HBG4XKS2CKF63DXTJJ2BYCSMPVR2NEFEIZCZMF2Z6J7UL4KUQA, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.580945688 (13h9m55.739711412s) [noise=true , address=104.36.82.13:4185 , piece_id=BXNLAXPPUZPYWK4OS7FHGWJA3PHRWBBXNHHKVZK7C2GUIH7NK36A, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.609979021 (13h9m55.768744755s) [noise=true , address=77.90.31.18:4806 , piece_id=TEW5OX5YYTYXK6TINHJCNM2PGBPVOP4U6ZQJ76X26MWATN7ONMRQ, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.616839968 (13h9m55.775605702s) [noise=true , address=45.91.116.5:4297 , piece_id=P2PUERXV4WF6A7JMGN2KK2SQGAP2N7Y4LGJ2QJHLJVPBPKNP6FBA, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.623373539 (13h9m55.782139273s) [noise=true , address=104.36.82.4:4804 , piece_id=LHGYONHUZS73BU4EQECDCARHC6OIKFINPCYK6ITGYWXT3LAL4G7Q, seg_pos={0 0}, upload=11538]: Done uploading piece. err: <nil> Aug 26 05:13:28.623390432 (13h9m55.782156166s) [seg_pos={0 0}, upload=11538]: Segment reached optimal threshold of 13 pieces. Aug 26 05:13:28.623515320 (13h9m55.782281054s) [noise=true , address=104.36.82.2:4729 , piece_id=ZC4XKS5QMYRWUS5YBAGLUEC5G24EPKXFR2NBD7ZXA5CPUTA7ILLQ, seg_pos={0 0}, upload=11538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:28.623573712 (13h9m55.782339446s) [noise=true , address=104.36.82.14:4221 , piece_id=7XF7FAZZ3UPGJGT3VDGZNZJSAZEHYMJT3KBOR3EZWR7OZXROZ4KQ, seg_pos={0 0}, upload=11538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:28.623781941 (13h9m55.782547715s) [noise=true , address=45.91.116.14:4191 , piece_id=XB2DWU46DPG3BBSICYOU24NAWMXIVK4UMWYGBR2DK72AECA225DQ, seg_pos={0 0}, upload=11538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:28.623858858 (13h9m55.782624592s) [seg_pos={0 0}, upload=11538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:13:28.623978697 (13h9m55.782744471s) [upload=11538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:13:28.623986361 (13h9m55.782752095s) [upload=11538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:13:36.901950288 (13h10m4.060716022s) [upload=11538]: Done uploading segments... Aug 26 05:13:36.901972901 (13h10m4.060738635s) [upload=11538]: Upload finished. err: <nil> Duration: 30.002063059s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 2.456147101s FAIL (2025-08-26 05:13:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:12:51.473649410 (13h9m18.632415144s) [upload=11530]: Starting upload Aug 26 05:12:51.473735445 (13h9m18.632501179s) [upload=11530]: Done starting upload Aug 26 05:12:51.473829374 (13h9m18.632595098s) [upload=11530]: Uploading segments... Aug 26 05:12:51.473925689 (13h9m18.632691423s) [upload=11530]: Got next segment. Inline: true Aug 26 05:12:51.473930889 (13h9m18.632696623s) [upload=11530]: Waiting for error group managing segments... Aug 26 05:12:51.473976456 (13h9m18.63274219s) [upload=11530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:12:51.473981656 (13h9m18.63274739s) [upload=11530]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:12:51.473984131 (13h9m18.632749865s) [upload=11530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:13:16.909514208 (13h9m44.068279942s) [upload=11530]: Done uploading segments... Aug 26 05:13:16.909528365 (13h9m44.0682941s) [upload=11530]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 2.456172959s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X...............XX] duration: 847.804778ms remote: "tcp:45.38.24.2:443" response headers: Vary=Origin X-Amz-Request-Id=185F39288F4A5A63 X-Request-Id=5K7ijR78zbf Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:13:46 GMT Server=Storj target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:13:46 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F39288F4A5A63</RequestId><HostId></HostId></Error>" Duration: 847.828193ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 28.226175407s FAIL (2025-08-26 05:13:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:12:51.473649410 (13h9m18.632415144s) [upload=11530]: Starting upload Aug 26 05:12:51.473735445 (13h9m18.632501179s) [upload=11530]: Done starting upload Aug 26 05:12:51.473829374 (13h9m18.632595098s) [upload=11530]: Uploading segments... Aug 26 05:12:51.473925689 (13h9m18.632691423s) [upload=11530]: Got next segment. Inline: true Aug 26 05:12:51.473930889 (13h9m18.632696623s) [upload=11530]: Waiting for error group managing segments... Aug 26 05:12:51.473976456 (13h9m18.63274219s) [upload=11530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:12:51.473981656 (13h9m18.63274739s) [upload=11530]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:12:51.473984131 (13h9m18.632749865s) [upload=11530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:13:16.909514208 (13h9m44.068279942s) [upload=11530]: Done uploading segments... Aug 26 05:13:16.909528365 (13h9m44.0682941s) [upload=11530]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 28.226193712s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 10 out of 60 is failed (threshold=3) [...................................XXX....XX........XX..XX.X] duration: 1.116460195s FAIL (2025-08-26 05:13:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:13:39.936607410 (13h10m7.095373134s) [upload=11542]: Starting upload Aug 26 05:13:39.936661333 (13h10m7.095427067s) [upload=11542]: Done starting upload Aug 26 05:13:39.936711700 (13h10m7.095477434s) [upload=11542]: Uploading segments... Aug 26 05:13:39.936753800 (13h10m7.095519534s) [upload=11542]: Got next segment. Inline: true Aug 26 05:13:39.936757627 (13h10m7.095523361s) [upload=11542]: Waiting for error group managing segments... Aug 26 05:13:39.936798486 (13h10m7.09556422s) [upload=11542]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:13:39.936802794 (13h10m7.095568528s) [upload=11542]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:13:39.936805529 (13h10m7.095571253s) [upload=11542]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:13:40.396508505 (13h10m7.555274239s) [upload=11542]: Done uploading segments... Aug 26 05:13:40.396525056 (13h10m7.55529079s) [upload=11542]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 1.116482366s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X...................X...X] duration: 12.879631004s FAIL (2025-08-26 05:13:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== 13h9m53.691805268s) [upload=11539]: Starting upload Aug 26 05:13:26.533106392 (13h9m53.691872116s) [upload=11539]: Done starting upload Aug 26 05:13:26.533334328 (13h9m53.692100073s) [upload=11539]: Uploading segments... Aug 26 05:13:26.533413730 (13h9m53.692179454s) [upload=11539]: Got next segment. Inline: false Aug 26 05:13:26.533437896 (13h9m53.69220362s) [upload=11539]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:13:26.533444760 (13h9m53.692210494s) [upload=11539]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:13:30.979080398 (13h9m58.137846132s) [seg_pos={0 0}, upload=11539]: Begin upload segment... Aug 26 05:13:30.979132277 (13h9m58.137898011s) [seg_pos={0 0}, upload=11539]: Done begin upload segment. Aug 26 05:13:30.979152605 (13h9m58.137918339s) [noise=true , address=79.127.205.234:4616 , piece_id=WUGLF2QYM6FSW4D6LDGVLR5HW2WP44DEOF45WP2BRNRCPGNZ774A, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.979255142 (13h9m58.138020876s) [noise=true , address=45.91.116.7:4025 , piece_id=5NJHSDC3ULXROJ4BQKXOMYWKKIL3SD6MU4VXJXCVUAN72HG3VHXQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.979518135 (13h9m58.138283869s) [noise=true , address=45.91.116.4:4951 , piece_id=QBAWZ6IWH3TRH6PTEGZZEP6ZIQLJECHKU7VO23RI5VV3EWX4MICA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.979796197 (13h9m58.138561931s) [noise=true , address=45.91.116.7:4030 , piece_id=UFGP2YL5F32XYHJIFGWYFFDTAW2ENPZWWUUDC45KZZQN5XTGC6FA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.979928440 (13h9m58.138694265s) [noise=true , address=45.91.116.5:4310 , piece_id=7CCUOR3ZV3FVDQHNJRZRHBPGV3IJWPOXI5EHHPC2MI7P7NBGQ5IQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980077485 (13h9m58.138843219s) [noise=true , address=104.36.82.50:4016 , piece_id=33SKSFJ6MCHS42HS4SZOLYM7B2CW3EXAAL3IQBJGWE2PJWSVUTCQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980412015 (13h9m58.139177749s) [noise=true , address=77.90.31.18:4827 , piece_id=JRSEKVDJKAHFXZ6VLBRRWSWZGSQBR2NAXY3CEQWZ3SIKEM625ZVQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980424239 (13h9m58.139189973s) [noise=true , address=104.36.82.60:4346 , piece_id=W5LIDJ26ZASWKCB2JUCWJ4A4HSIPQIR6MJJCNC6GWFXRH22D3U2A, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980701369 (13h9m58.139467093s) [noise=true , address=45.91.116.9:4277 , piece_id=7RJRVT75E4PPPLTGRMIRVSBD44JBEY6APDFNFK5YTAFNMHX3VNZA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.980855825 (13h9m58.139621559s) [noise=true , address=104.36.82.53:4129 , piece_id=AQGH2LPPC6GXGCZW3LA2ZXR56SVI5Q2MNAYWHNEGXE2LPMM4C3RA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.981019418 (13h9m58.139785152s) [noise=true , address=104.36.82.15:4264 , piece_id=CXU63LRJDOZUXEZZSI3QK6MPKQMR22JCEKSEENIN5V2C57IPHIGQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.981207026 (13h9m58.13997276s) [noise=true , address=104.36.82.5:4870 , piece_id=YX5ZNF5FK5AA2KT3NA4A4X3SJO6VP2JBBBX27VA7OF3QGI4E45OQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.981552999 (13h9m58.140318733s) [noise=true , address=45.91.116.12:4237 , piece_id=7YJRSHPEG2KOWRLKL7PVQ3E5HRSYBNP343CLBDUXIM5VHGPEPM6Q, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.982384770 (13h9m58.141150504s) [noise=true , address=79.127.219.47:4067 , piece_id=EILJ5LQG4BZ7NCAEVSIOEP3AGQB7UUWJOTCE333KPP5VAJBNSGJQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.986051095 (13h9m58.144816829s) [noise=true , address=64.49.13.137:4503 , piece_id=R4QR3LQKVL3FJ66IC4JAJMP5NYUIRKYLXNQTVCPFPMAJIIU6GBYQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.986346170 (13h9m58.145111904s) [noise=true , address=104.36.82.23:4476 , piece_id=EIZYKMAIYDGBMU6BVZKM4AW6Z2DMD4BBTYN2TV4GT6MLLZUFGDAA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.986840967 (13h9m58.145606731s) [noise=true , address=45.91.116.8:4049 , piece_id=KXMRX76JKJS5JOG6KQWIITYG7YSF3KBTGPM66OJI5J4RKMYWZGEA, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:30.991518838 (13h9m58.150284572s) [noise=true , address=77.90.31.15:4715 , piece_id=CEQZ5YSDT5736Y4DA7XWVBP6RNC3RKCKNVH3PZNRPEK4C2MPNMSQ, seg_pos={0 0}, upload=11539]: Uploading piece... Aug 26 05:13:32.121679708 (13h9m59.280445442s) [upload=11539]: Next returned nil segment Aug 26 05:13:32.121693524 (13h9m59.280459258s) [upload=11539]: Waiting for error group managing segments... Aug 26 05:13:32.410653901 (13h9m59.569419635s) [noise=true , address=79.127.205.234:4616 , piece_id=WUGLF2QYM6FSW4D6LDGVLR5HW2WP44DEOF45WP2BRNRCPGNZ774A, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.418062867 (13h9m59.576828601s) [noise=true , address=64.49.13.137:4503 , piece_id=R4QR3LQKVL3FJ66IC4JAJMP5NYUIRKYLXNQTVCPFPMAJIIU6GBYQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.872015110 (13h10m0.030780844s) [noise=true , address=45.91.116.9:4277 , piece_id=7RJRVT75E4PPPLTGRMIRVSBD44JBEY6APDFNFK5YTAFNMHX3VNZA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.874479585 (13h10m0.033245319s) [noise=true , address=45.91.116.4:4951 , piece_id=QBAWZ6IWH3TRH6PTEGZZEP6ZIQLJECHKU7VO23RI5VV3EWX4MICA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.875739707 (13h10m0.034505441s) [noise=true , address=45.91.116.12:4237 , piece_id=7YJRSHPEG2KOWRLKL7PVQ3E5HRSYBNP343CLBDUXIM5VHGPEPM6Q, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.876831045 (13h10m0.035596769s) [noise=true , address=45.91.116.7:4025 , piece_id=5NJHSDC3ULXROJ4BQKXOMYWKKIL3SD6MU4VXJXCVUAN72HG3VHXQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.881391751 (13h10m0.040157485s) [noise=true , address=45.91.116.7:4030 , piece_id=UFGP2YL5F32XYHJIFGWYFFDTAW2ENPZWWUUDC45KZZQN5XTGC6FA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.882125225 (13h10m0.040890959s) [noise=true , address=45.91.116.5:4310 , piece_id=7CCUOR3ZV3FVDQHNJRZRHBPGV3IJWPOXI5EHHPC2MI7P7NBGQ5IQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.886042058 (13h10m0.044807792s) [noise=true , address=77.90.31.18:4827 , piece_id=JRSEKVDJKAHFXZ6VLBRRWSWZGSQBR2NAXY3CEQWZ3SIKEM625ZVQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.906624451 (13h10m0.065390215s) [noise=true , address=45.91.116.8:4049 , piece_id=KXMRX76JKJS5JOG6KQWIITYG7YSF3KBTGPM66OJI5J4RKMYWZGEA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.911752994 (13h10m0.070518728s) [noise=true , address=79.127.219.47:4067 , piece_id=EILJ5LQG4BZ7NCAEVSIOEP3AGQB7UUWJOTCE333KPP5VAJBNSGJQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.919694089 (13h10m0.078459823s) [noise=true , address=104.36.82.5:4870 , piece_id=YX5ZNF5FK5AA2KT3NA4A4X3SJO6VP2JBBBX27VA7OF3QGI4E45OQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.925093088 (13h10m0.083858823s) [noise=true , address=77.90.31.15:4715 , piece_id=CEQZ5YSDT5736Y4DA7XWVBP6RNC3RKCKNVH3PZNRPEK4C2MPNMSQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.954273382 (13h10m0.113039106s) [noise=true , address=104.36.82.15:4264 , piece_id=CXU63LRJDOZUXEZZSI3QK6MPKQMR22JCEKSEENIN5V2C57IPHIGQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: <nil> Aug 26 05:13:32.954298981 (13h10m0.113064715s) [seg_pos={0 0}, upload=11539]: Segment reached optimal threshold of 14 pieces. Aug 26 05:13:32.954438438 (13h10m0.113204172s) [noise=true , address=104.36.82.53:4129 , piece_id=AQGH2LPPC6GXGCZW3LA2ZXR56SVI5Q2MNAYWHNEGXE2LPMM4C3RA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYQbZWuwwz7cypYmPhVwM4wygB3DsJtr3M5vxx296ZPVb3B1Z): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:32.954496059 (13h10m0.113261793s) [noise=true , address=104.36.82.50:4016 , piece_id=33SKSFJ6MCHS42HS4SZOLYM7B2CW3EXAAL3IQBJGWE2PJWSVUTCQ, seg_pos={0 0}, upload=11539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jC98jEWn6K8jFHPA9knJeHAkuNEmcS7ThxUvbySDfbq6FmKVR): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:32.954574117 (13h10m0.113339841s) [noise=true , address=104.36.82.60:4346 , piece_id=W5LIDJ26ZASWKCB2JUCWJ4A4HSIPQIR6MJJCNC6GWFXRH22D3U2A, seg_pos={0 0}, upload=11539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:32.954613133 (13h10m0.113378867s) [noise=true , address=104.36.82.23:4476 , piece_id=EIZYKMAIYDGBMU6BVZKM4AW6Z2DMD4BBTYN2TV4GT6MLLZUFGDAA, seg_pos={0 0}, upload=11539]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: expected piece hash; context canceled; EOF Aug 26 05:13:32.954680040 (13h10m0.113445774s) [seg_pos={0 0}, upload=11539]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:13:32.954769602 (13h10m0.113535336s) [upload=11539]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:13:32.954774111 (13h10m0.113539845s) [upload=11539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:13:38.764463199 (13h10m5.923228933s) [upload=11539]: Done uploading segments... Aug 26 05:13:38.764494800 (13h10m5.923260544s) [upload=11539]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 12.879661552s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.........................................XX..X........XXXX.X] duration: 30.000857408s FAIL (2025-08-26 05:13:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000877648s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X...............X] duration: 33.475796197s remote: "tcp:45.38.24.2:443" response headers: X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:13:27 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F391C8B2F1CC8 X-Request-Id=TLUAUSe14Tp Content-Length=433 Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:13:27 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F391C8B2F1CC8</RequestId><HostId></HostId></Error>" Duration: 33.475821234s edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [...........................................X.........X..X..X] duration: 656.674464ms remote: "tcp:207.211.208.129:443" response headers: Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=185F39234B9665A8 X-Request-Id=d27fn4QQd6m X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=423 Content-Type=application/xml Server=Storj Date=Tue, 26 Aug 2025 05:13:24 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:13:24 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F39234B9665A8</RequestId><HostId></HostId></Error>" Duration: 656.695574ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 26.090316867s FAIL (2025-08-26 05:13:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:12:51.473649410 (13h9m18.632415144s) [upload=11530]: Starting upload Aug 26 05:12:51.473735445 (13h9m18.632501179s) [upload=11530]: Done starting upload Aug 26 05:12:51.473829374 (13h9m18.632595098s) [upload=11530]: Uploading segments... Aug 26 05:12:51.473925689 (13h9m18.632691423s) [upload=11530]: Got next segment. Inline: true Aug 26 05:12:51.473930889 (13h9m18.632696623s) [upload=11530]: Waiting for error group managing segments... Aug 26 05:12:51.473976456 (13h9m18.63274219s) [upload=11530]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:12:51.473981656 (13h9m18.63274739s) [upload=11530]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:12:51.473984131 (13h9m18.632749865s) [upload=11530]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:13:16.909514208 (13h9m44.068279942s) [upload=11530]: Done uploading segments... Aug 26 05:13:16.909528365 (13h9m44.0682941s) [upload=11530]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 26.090333097s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...............................XXX.....XX.........XXX.X.XXX.] duration: 13.795599568s FAIL (2025-08-26 05:13:13 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 13.795702675s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 6 out of 60 is failed (threshold=3) [...................................X..X...XX.........X...X..] duration: 22.101245077s FAIL (2025-08-26 05:13:13 UTC) orbiter warning: operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 22.101279501s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X...................X...] duration: 14.74051078s FAIL (2025-08-26 05:13:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:10:30.572840343 (13h6m57.731606067s) [upload=11496]: Starting upload Aug 26 05:10:30.572899486 (13h6m57.73166522s) [upload=11496]: Done starting upload Aug 26 05:10:30.573011170 (13h6m57.731776904s) [upload=11496]: Uploading segments... Aug 26 05:10:30.573090452 (13h6m57.731856186s) [upload=11496]: Got next segment. Inline: false Aug 26 05:10:30.573118185 (13h6m57.731883919s) [upload=11496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:10:30.573123014 (13h6m57.731888748s) [upload=11496]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:10:35.032513462 (13h7m2.191279196s) [seg_pos={0 0}, upload=11496]: Begin upload segment... Aug 26 05:10:35.032569869 (13h7m2.191335604s) [seg_pos={0 0}, upload=11496]: Done begin upload segment. Aug 26 05:10:35.032591852 (13h7m2.191357586s) [noise=true , address=79.127.205.246:4266 , piece_id=Z5QJRGZJJJBCOGZOQ5IUGHLTR7BAKEVM3JQS7LDF4CXGZSAGBXWQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.032618443 (13h7m2.191384207s) [noise=true , address=45.91.116.12:4251 , piece_id=CR3ESI5I3YBRE7GOKSZM2XZLZOGTGDSJDKVXBZ5EXT7K5L4EMFJA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.032952932 (13h7m2.191718667s) [noise=true , address=77.90.31.19:4860 , piece_id=74Q4ELBBD4D23WIT52MAQCEHFWJUCTUDQ7HQSJPRKVUKLU4IMB6A, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033174617 (13h7m2.191940361s) [noise=true , address=104.36.82.60:4372 , piece_id=S4KC2PDNN4NWRL5XVFMOLEIZMFJIAZDJWGP7Z4IO2FSDI7ESVWLQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033207100 (13h7m2.191972834s) [noise=true , address=104.36.82.44:4881 , piece_id=MBMEIUR6ELEAXEEEBRQDPVSQBSUAYX7EIAKVS5GTL6YL5EY4HV5A, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033463830 (13h7m2.192229554s) [noise=true , address=104.36.82.11:4132 , piece_id=OXTZSJ2OKGIDGKM2BDTBGEK3XPC3T6SUOV2LWRJYYLIHH6ORNCYQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033624508 (13h7m2.192390242s) [noise=true , address=64.49.13.139:4472 , piece_id=ZINKK3G2Q4OJAYNJF5YJJGFFQE5NOEAKZXS6DAEWO7RBJGQOLGSQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033755569 (13h7m2.192521303s) [noise=true , address=104.36.82.53:4147 , piece_id=TLIKYHFGPP3KHF2UAEZ2IX6TPHOVFVC2POW3LL22H3G3574XJRJA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034031928 (13h7m2.192797662s) [noise=true , address=79.127.201.215:4347 , piece_id=T2DAAJQFH3QY5NG2HVSL2OFLYOFRVCOCEEZISQN7VO53NH52XXJA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034052637 (13h7m2.192818371s) [noise=true , address=79.127.219.51:4207 , piece_id=OR4CFXDLPBXWHCL22LQSPL4JPRLKUXNFX3FLIMC6PLXPEO3HE7OA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034285543 (13h7m2.193051277s) [noise=true , address=45.91.116.14:4214 , piece_id=G5VFCECTQ4DHENZ2U6DELAJZECKTHA7DWVHRT2OAYCOZ6Q2YG6EQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034475256 (13h7m2.19324099s) [noise=true , address=45.91.116.4:4941 , piece_id=BZKNLJ4L6U4RAVNICH47Z3B6V2M2FC5E42LNPXLNAYEFQ3UPI2CQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034513018 (13h7m2.193278752s) [noise=true , address=79.127.205.234:4587 , piece_id=VK6I735DJGSQK3EEBJCS5CIYV4LL5SAJ4NN7PG2ZANTR4LOITYQQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034713903 (13h7m2.193479637s) [noise=true , address=45.91.116.7:4044 , piece_id=SCPS3JAMYFA7LJSLYNTU4E2CHZZNLLOI6WWZNDCPAIXYHZCU5OOQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034863809 (13h7m2.193629553s) [noise=true , address=77.90.31.12:4618 , piece_id=KTB6NPVEEI4D5W6XOB3AOXTWTGH7YYVPAPAL6Z7YOFFIVBH3CBGA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.035232214 (13h7m2.193997948s) [noise=true , address=156.146.43.225:4450 , piece_id=2Z2KXCP3HEYB5MMB6JWXQSKXVWRWPJP3CBVFIH7L6LQB3GM3JYUQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.035598144 (13h7m2.194363878s) [noise=true , address=104.36.82.23:4468 , piece_id=OOU2MQYD32HXLLJOSRZKGND7C74MM54NRELR7RTHBWMNRVAPQ5OA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.035914710 (13h7m2.194680444s) [noise=true , address=79.127.220.98:4402 , piece_id=TKAFL7UUKHLHPDXDPE3KAZVGZ63CKSXF64SNGY2PIMJG4DAACR3A, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:36.176681855 (13h7m3.335447579s) [upload=11496]: Next returned nil segment Aug 26 05:10:36.176701162 (13h7m3.335466896s) [upload=11496]: Waiting for error group managing segments... Aug 26 05:10:36.469918093 (13h7m3.628683827s) [noise=true , address=79.127.205.246:4266 , piece_id=Z5QJRGZJJJBCOGZOQ5IUGHLTR7BAKEVM3JQS7LDF4CXGZSAGBXWQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.483554515 (13h7m3.642320249s) [noise=true , address=64.49.13.139:4472 , piece_id=ZINKK3G2Q4OJAYNJF5YJJGFFQE5NOEAKZXS6DAEWO7RBJGQOLGSQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.491322799 (13h7m3.650088533s) [noise=true , address=79.127.205.234:4587 , piece_id=VK6I735DJGSQK3EEBJCS5CIYV4LL5SAJ4NN7PG2ZANTR4LOITYQQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.878552534 (13h7m4.037318268s) [noise=true , address=79.127.220.98:4402 , piece_id=TKAFL7UUKHLHPDXDPE3KAZVGZ63CKSXF64SNGY2PIMJG4DAACR3A, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.916592210 (13h7m4.075357944s) [noise=true , address=77.90.31.19:4860 , piece_id=74Q4ELBBD4D23WIT52MAQCEHFWJUCTUDQ7HQSJPRKVUKLU4IMB6A, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.930943940 (13h7m4.089709684s) [noise=true , address=45.91.116.12:4251 , piece_id=CR3ESI5I3YBRE7GOKSZM2XZLZOGTGDSJDKVXBZ5EXT7K5L4EMFJA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.932286960 (13h7m4.091052694s) [noise=true , address=45.91.116.14:4214 , piece_id=G5VFCECTQ4DHENZ2U6DELAJZECKTHA7DWVHRT2OAYCOZ6Q2YG6EQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.934749812 (13h7m4.093515546s) [noise=true , address=77.90.31.12:4618 , piece_id=KTB6NPVEEI4D5W6XOB3AOXTWTGH7YYVPAPAL6Z7YOFFIVBH3CBGA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.936791809 (13h7m4.095557543s) [noise=true , address=45.91.116.7:4044 , piece_id=SCPS3JAMYFA7LJSLYNTU4E2CHZZNLLOI6WWZNDCPAIXYHZCU5OOQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.953481573 (13h7m4.112247308s) [noise=true , address=104.36.82.11:4132 , piece_id=OXTZSJ2OKGIDGKM2BDTBGEK3XPC3T6SUOV2LWRJYYLIHH6ORNCYQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.956771078 (13h7m4.115536812s) [noise=true , address=104.36.82.53:4147 , piece_id=TLIKYHFGPP3KHF2UAEZ2IX6TPHOVFVC2POW3LL22H3G3574XJRJA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.998054810 (13h7m4.156820574s) [noise=true , address=79.127.201.215:4347 , piece_id=T2DAAJQFH3QY5NG2HVSL2OFLYOFRVCOCEEZISQN7VO53NH52XXJA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:37.004117030 (13h7m4.162882764s) [noise=true , address=104.36.82.44:4881 , piece_id=MBMEIUR6ELEAXEEEBRQDPVSQBSUAYX7EIAKVS5GTL6YL5EY4HV5A, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:37.010131748 (13h7m4.168897482s) [noise=true , address=156.146.43.225:4450 , piece_id=2Z2KXCP3HEYB5MMB6JWXQSKXVWRWPJP3CBVFIH7L6LQB3GM3JYUQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:37.010170994 (13h7m4.168936728s) [seg_pos={0 0}, upload=11496]: Segment reached optimal threshold of 14 pieces. Aug 26 05:10:37.010279420 (13h7m4.169045154s) [noise=true , address=104.36.82.23:4468 , piece_id=OOU2MQYD32HXLLJOSRZKGND7C74MM54NRELR7RTHBWMNRVAPQ5OA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:37.010490314 (13h7m4.169256048s) [noise=true , address=104.36.82.60:4372 , piece_id=S4KC2PDNN4NWRL5XVFMOLEIZMFJIAZDJWGP7Z4IO2FSDI7ESVWLQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kJnsSPzFa7JwUMHuvosMmFrGvQ8tCsQbjwWdxbqjHNHgTfaL3): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:37.010578122 (13h7m4.169343856s) [noise=true , address=79.127.219.51:4207 , piece_id=OR4CFXDLPBXWHCL22LQSPL4JPRLKUXNFX3FLIMC6PLXPEO3HE7OA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127Hq7E6VY8yeWGC2f2viGq4yLeUVJwaYzYPxtmFkv4GRsZbxn3): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:37.010676851 (13h7m4.169442585s) [noise=true , address=45.91.116.4:4941 , piece_id=BZKNLJ4L6U4RAVNICH47Z3B6V2M2FC5E42LNPXLNAYEFQ3UPI2CQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:37.010710796 (13h7m4.16947653s) [seg_pos={0 0}, upload=11496]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:10:37.010772423 (13h7m4.169538158s) [upload=11496]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:10:37.010776362 (13h7m4.169542096s) [upload=11496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:10:45.331017771 (13h7m12.489783505s) [upload=11496]: Done uploading segments... Aug 26 05:10:45.331040455 (13h7m12.489806189s) [upload=11496]: Upload finished. err: <nil> Duration: 14.740535677s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 12 out of 60 is failed (threshold=3) [................................XXX.....XX.........XXX.X.XXX] duration: 30.004593584s FAIL (2025-08-26 05:12:59 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.004620145s core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 3 out of 60 is failed (threshold=6) [........................................X................XX.] duration: 6.386245751s remote: "tcp:185.244.226.2:443" response headers: Date=Tue, 26 Aug 2025 05:12:19 GMT Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=dD8wM4mmfux Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:12:58 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 6.386265479s edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 7 out of 60 is failed (threshold=3) [.......................................X.X...X.......XXX.X..] duration: 19.397409789s FAIL (2025-08-26 05:12:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 19.397430409s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X...................X..] duration: 59.047581467s FAIL (2025-08-26 05:12:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:10:30.572840343 (13h6m57.731606067s) [upload=11496]: Starting upload Aug 26 05:10:30.572899486 (13h6m57.73166522s) [upload=11496]: Done starting upload Aug 26 05:10:30.573011170 (13h6m57.731776904s) [upload=11496]: Uploading segments... Aug 26 05:10:30.573090452 (13h6m57.731856186s) [upload=11496]: Got next segment. Inline: false Aug 26 05:10:30.573118185 (13h6m57.731883919s) [upload=11496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:10:30.573123014 (13h6m57.731888748s) [upload=11496]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:10:35.032513462 (13h7m2.191279196s) [seg_pos={0 0}, upload=11496]: Begin upload segment... Aug 26 05:10:35.032569869 (13h7m2.191335604s) [seg_pos={0 0}, upload=11496]: Done begin upload segment. Aug 26 05:10:35.032591852 (13h7m2.191357586s) [noise=true , address=79.127.205.246:4266 , piece_id=Z5QJRGZJJJBCOGZOQ5IUGHLTR7BAKEVM3JQS7LDF4CXGZSAGBXWQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.032618443 (13h7m2.191384207s) [noise=true , address=45.91.116.12:4251 , piece_id=CR3ESI5I3YBRE7GOKSZM2XZLZOGTGDSJDKVXBZ5EXT7K5L4EMFJA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.032952932 (13h7m2.191718667s) [noise=true , address=77.90.31.19:4860 , piece_id=74Q4ELBBD4D23WIT52MAQCEHFWJUCTUDQ7HQSJPRKVUKLU4IMB6A, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033174617 (13h7m2.191940361s) [noise=true , address=104.36.82.60:4372 , piece_id=S4KC2PDNN4NWRL5XVFMOLEIZMFJIAZDJWGP7Z4IO2FSDI7ESVWLQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033207100 (13h7m2.191972834s) [noise=true , address=104.36.82.44:4881 , piece_id=MBMEIUR6ELEAXEEEBRQDPVSQBSUAYX7EIAKVS5GTL6YL5EY4HV5A, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033463830 (13h7m2.192229554s) [noise=true , address=104.36.82.11:4132 , piece_id=OXTZSJ2OKGIDGKM2BDTBGEK3XPC3T6SUOV2LWRJYYLIHH6ORNCYQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033624508 (13h7m2.192390242s) [noise=true , address=64.49.13.139:4472 , piece_id=ZINKK3G2Q4OJAYNJF5YJJGFFQE5NOEAKZXS6DAEWO7RBJGQOLGSQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.033755569 (13h7m2.192521303s) [noise=true , address=104.36.82.53:4147 , piece_id=TLIKYHFGPP3KHF2UAEZ2IX6TPHOVFVC2POW3LL22H3G3574XJRJA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034031928 (13h7m2.192797662s) [noise=true , address=79.127.201.215:4347 , piece_id=T2DAAJQFH3QY5NG2HVSL2OFLYOFRVCOCEEZISQN7VO53NH52XXJA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034052637 (13h7m2.192818371s) [noise=true , address=79.127.219.51:4207 , piece_id=OR4CFXDLPBXWHCL22LQSPL4JPRLKUXNFX3FLIMC6PLXPEO3HE7OA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034285543 (13h7m2.193051277s) [noise=true , address=45.91.116.14:4214 , piece_id=G5VFCECTQ4DHENZ2U6DELAJZECKTHA7DWVHRT2OAYCOZ6Q2YG6EQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034475256 (13h7m2.19324099s) [noise=true , address=45.91.116.4:4941 , piece_id=BZKNLJ4L6U4RAVNICH47Z3B6V2M2FC5E42LNPXLNAYEFQ3UPI2CQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034513018 (13h7m2.193278752s) [noise=true , address=79.127.205.234:4587 , piece_id=VK6I735DJGSQK3EEBJCS5CIYV4LL5SAJ4NN7PG2ZANTR4LOITYQQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034713903 (13h7m2.193479637s) [noise=true , address=45.91.116.7:4044 , piece_id=SCPS3JAMYFA7LJSLYNTU4E2CHZZNLLOI6WWZNDCPAIXYHZCU5OOQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.034863809 (13h7m2.193629553s) [noise=true , address=77.90.31.12:4618 , piece_id=KTB6NPVEEI4D5W6XOB3AOXTWTGH7YYVPAPAL6Z7YOFFIVBH3CBGA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.035232214 (13h7m2.193997948s) [noise=true , address=156.146.43.225:4450 , piece_id=2Z2KXCP3HEYB5MMB6JWXQSKXVWRWPJP3CBVFIH7L6LQB3GM3JYUQ, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.035598144 (13h7m2.194363878s) [noise=true , address=104.36.82.23:4468 , piece_id=OOU2MQYD32HXLLJOSRZKGND7C74MM54NRELR7RTHBWMNRVAPQ5OA, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:35.035914710 (13h7m2.194680444s) [noise=true , address=79.127.220.98:4402 , piece_id=TKAFL7UUKHLHPDXDPE3KAZVGZ63CKSXF64SNGY2PIMJG4DAACR3A, seg_pos={0 0}, upload=11496]: Uploading piece... Aug 26 05:10:36.176681855 (13h7m3.335447579s) [upload=11496]: Next returned nil segment Aug 26 05:10:36.176701162 (13h7m3.335466896s) [upload=11496]: Waiting for error group managing segments... Aug 26 05:10:36.469918093 (13h7m3.628683827s) [noise=true , address=79.127.205.246:4266 , piece_id=Z5QJRGZJJJBCOGZOQ5IUGHLTR7BAKEVM3JQS7LDF4CXGZSAGBXWQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.483554515 (13h7m3.642320249s) [noise=true , address=64.49.13.139:4472 , piece_id=ZINKK3G2Q4OJAYNJF5YJJGFFQE5NOEAKZXS6DAEWO7RBJGQOLGSQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.491322799 (13h7m3.650088533s) [noise=true , address=79.127.205.234:4587 , piece_id=VK6I735DJGSQK3EEBJCS5CIYV4LL5SAJ4NN7PG2ZANTR4LOITYQQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.878552534 (13h7m4.037318268s) [noise=true , address=79.127.220.98:4402 , piece_id=TKAFL7UUKHLHPDXDPE3KAZVGZ63CKSXF64SNGY2PIMJG4DAACR3A, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.916592210 (13h7m4.075357944s) [noise=true , address=77.90.31.19:4860 , piece_id=74Q4ELBBD4D23WIT52MAQCEHFWJUCTUDQ7HQSJPRKVUKLU4IMB6A, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.930943940 (13h7m4.089709684s) [noise=true , address=45.91.116.12:4251 , piece_id=CR3ESI5I3YBRE7GOKSZM2XZLZOGTGDSJDKVXBZ5EXT7K5L4EMFJA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.932286960 (13h7m4.091052694s) [noise=true , address=45.91.116.14:4214 , piece_id=G5VFCECTQ4DHENZ2U6DELAJZECKTHA7DWVHRT2OAYCOZ6Q2YG6EQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.934749812 (13h7m4.093515546s) [noise=true , address=77.90.31.12:4618 , piece_id=KTB6NPVEEI4D5W6XOB3AOXTWTGH7YYVPAPAL6Z7YOFFIVBH3CBGA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.936791809 (13h7m4.095557543s) [noise=true , address=45.91.116.7:4044 , piece_id=SCPS3JAMYFA7LJSLYNTU4E2CHZZNLLOI6WWZNDCPAIXYHZCU5OOQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.953481573 (13h7m4.112247308s) [noise=true , address=104.36.82.11:4132 , piece_id=OXTZSJ2OKGIDGKM2BDTBGEK3XPC3T6SUOV2LWRJYYLIHH6ORNCYQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.956771078 (13h7m4.115536812s) [noise=true , address=104.36.82.53:4147 , piece_id=TLIKYHFGPP3KHF2UAEZ2IX6TPHOVFVC2POW3LL22H3G3574XJRJA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:36.998054810 (13h7m4.156820574s) [noise=true , address=79.127.201.215:4347 , piece_id=T2DAAJQFH3QY5NG2HVSL2OFLYOFRVCOCEEZISQN7VO53NH52XXJA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:37.004117030 (13h7m4.162882764s) [noise=true , address=104.36.82.44:4881 , piece_id=MBMEIUR6ELEAXEEEBRQDPVSQBSUAYX7EIAKVS5GTL6YL5EY4HV5A, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:37.010131748 (13h7m4.168897482s) [noise=true , address=156.146.43.225:4450 , piece_id=2Z2KXCP3HEYB5MMB6JWXQSKXVWRWPJP3CBVFIH7L6LQB3GM3JYUQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: <nil> Aug 26 05:10:37.010170994 (13h7m4.168936728s) [seg_pos={0 0}, upload=11496]: Segment reached optimal threshold of 14 pieces. Aug 26 05:10:37.010279420 (13h7m4.169045154s) [noise=true , address=104.36.82.23:4468 , piece_id=OOU2MQYD32HXLLJOSRZKGND7C74MM54NRELR7RTHBWMNRVAPQ5OA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:37.010490314 (13h7m4.169256048s) [noise=true , address=104.36.82.60:4372 , piece_id=S4KC2PDNN4NWRL5XVFMOLEIZMFJIAZDJWGP7Z4IO2FSDI7ESVWLQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kJnsSPzFa7JwUMHuvosMmFrGvQ8tCsQbjwWdxbqjHNHgTfaL3): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:37.010578122 (13h7m4.169343856s) [noise=true , address=79.127.219.51:4207 , piece_id=OR4CFXDLPBXWHCL22LQSPL4JPRLKUXNFX3FLIMC6PLXPEO3HE7OA, seg_pos={0 0}, upload=11496]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127Hq7E6VY8yeWGC2f2viGq4yLeUVJwaYzYPxtmFkv4GRsZbxn3): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:37.010676851 (13h7m4.169442585s) [noise=true , address=45.91.116.4:4941 , piece_id=BZKNLJ4L6U4RAVNICH47Z3B6V2M2FC5E42LNPXLNAYEFQ3UPI2CQ, seg_pos={0 0}, upload=11496]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:37.010710796 (13h7m4.16947653s) [seg_pos={0 0}, upload=11496]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:10:37.010772423 (13h7m4.169538158s) [upload=11496]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:10:37.010776362 (13h7m4.169542096s) [upload=11496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:10:45.331017771 (13h7m12.489783505s) [upload=11496]: Done uploading segments... Aug 26 05:10:45.331040455 (13h7m12.489806189s) [upload=11496]: Upload finished. err: <nil> Duration: 59.04760874s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [............................................X.........X..X..] duration: 13.244970716s remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3906C1A6017D X-Request-Id=GChhLjUfBVZ Content-Length=423 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:11:21 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:12:54 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3906C1A6017D</RequestId><HostId></HostId></Error>" Duration: 13.244993239s edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......................................................X.XX.] duration: 23.363021101s FAIL (2025-08-26 05:12:53 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 23.363030929s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [..........................................XX..X........XXXX.] duration: 21.79991802s FAIL (2025-08-26 05:12:50 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 185F3909AA277A5E, HostID: , api error SlowDown: Please reduce your request rate. Duration: 21.799941183s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 9 out of 60 is failed (threshold=3) [....................................XXX....XX........XX..XX.] duration: 19.013187952s FAIL (2025-08-26 05:12:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:11:23.519574536 (13h7m50.67834027s) [upload=11510]: Starting upload Aug 26 05:11:23.519630132 (13h7m50.678395866s) [upload=11510]: Done starting upload Aug 26 05:11:23.519672193 (13h7m50.678437927s) [upload=11510]: Uploading segments... Aug 26 05:11:23.519714494 (13h7m50.678480228s) [upload=11510]: Got next segment. Inline: true Aug 26 05:11:23.519718492 (13h7m50.678484226s) [upload=11510]: Waiting for error group managing segments... Aug 26 05:11:23.519765732 (13h7m50.678531466s) [upload=11510]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:11:23.519770321 (13h7m50.678536055s) [upload=11510]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:11:23.519772706 (13h7m50.67853844s) [upload=11510]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:11:52.490915682 (13h8m19.649681416s) [upload=11510]: Done uploading segments... Aug 26 05:11:52.490933236 (13h8m19.64969896s) [upload=11510]: Upload finished. err: <nil> Duration:* 19.01321292s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001486305s FAIL (2025-08-26 05:12:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:11:45.927063770 (13h8m13.085829504s) [upload=11516]: Starting upload Aug 26 05:11:45.927123955 (13h8m13.085889679s) [upload=11516]: Done starting upload Aug 26 05:11:45.927177227 (13h8m13.085942961s) [upload=11516]: Uploading segments... Aug 26 05:11:45.927225911 (13h8m13.085991645s) [upload=11516]: Got next segment. Inline: true Aug 26 05:11:45.927231872 (13h8m13.085997606s) [upload=11516]: Waiting for error group managing segments... Aug 26 05:11:45.927271447 (13h8m13.086037181s) [upload=11516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:11:45.927275736 (13h8m13.08604147s) [upload=11516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:11:45.927278842 (13h8m13.086044576s) [upload=11516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:12:36.681010186 (13h9m3.83977597s) [upload=11516]: Done uploading segments... Aug 26 05:12:36.681055763 (13h9m3.839821527s) [upload=11516]: Upload finished. err: <nil> Duration:* 1m0.001508708s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.................................XXX...X..............X.X...] duration: 25.660268256s FAIL (2025-08-26 05:12:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:09:56.008953276 (13h6m23.16771901s) [upload=11489]: Starting upload Aug 26 05:09:56.009072044 (13h6m23.167837788s) [upload=11489]: Done starting upload Aug 26 05:09:56.009383028 (13h6m23.168148762s) [upload=11489]: Uploading segments... Aug 26 05:09:56.009423316 (13h6m23.16818906s) [upload=11489]: Got next segment. Inline: false Aug 26 05:09:56.009453183 (13h6m23.168218917s) [upload=11489]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:09:56.009459585 (13h6m23.168225329s) [upload=11489]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:10:00.458966751 (13h6m27.617732486s) [seg_pos={0 0}, upload=11489]: Begin upload segment... Aug 26 05:10:00.459008721 (13h6m27.617774455s) [seg_pos={0 0}, upload=11489]: Done begin upload segment. Aug 26 05:10:00.459034110 (13h6m27.617799844s) [noise=true , address=45.91.116.4:4940 , piece_id=JV6GL6TUFP4TR56EWH4ATSB7CNPI3FB6IQSDYQXUBDFXJ6APXP7Q, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.459134011 (13h6m27.617899826s) [noise=true , address=77.90.31.11:4555 , piece_id=WO7BT6STTZVKUA5BDXUSD3SWYYBAZJVCUR37P62ETA5KL6NOM6BA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.459421741 (13h6m27.618187475s) [noise=true , address=45.91.116.9:4262 , piece_id=4BO666AS6IQZT5PG4KQBLUTIDOMMVD4YUVOXQQBIUXCV6UZSKTYQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.459694333 (13h6m27.618460067s) [noise=true , address=45.91.116.10:4083 , piece_id=KHW4R4N355H2U4CRKNYOZIUYF2KR6H43MR5OPMUARP53UDV33CUQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.459700084 (13h6m27.618465818s) [noise=true , address=45.91.116.7:4009 , piece_id=FXWX6FMOHAQAJ4RE2KMYRU2FXLCDWIO3N53X26XIEMLD45FPH3SA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460006460 (13h6m27.618772204s) [noise=true , address=104.36.82.9:4005 , piece_id=CBV4WJSIWHOZH4T5IUVEQQ35FVG23O7RBUCHVC22XFDQUZ2TIP4Q, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460018193 (13h6m27.618783927s) [noise=true , address=77.90.31.18:4806 , piece_id=SDZICVRR7IUNYOLSROBRHFE2VXG4C5NN3TAV6QTMNX5MI3O67FJA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460307496 (13h6m27.61907323s) [noise=true , address=45.91.116.5:4298 , piece_id=6BN2RQPJTBBQJU6UKVUBDJSRANPE72XUNQIU4T3QC3DAU5CXF4AQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460360708 (13h6m27.619126442s) [noise=true , address=45.91.116.8:4048 , piece_id=7XC2GOTOY3XHOHG5N7N7P4X2BFWLUDZ76NE2M4XZW4SBV5BBLDIA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460566983 (13h6m27.619332717s) [noise=true , address=45.91.116.13:4153 , piece_id=DYGOMRBOQMRG5FYFB5KQTJA7E6M4VKE4PBLZV6CNFHGO7RKKRGJA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460628390 (13h6m27.619394124s) [noise=true , address=104.36.82.4:4804 , piece_id=AM23DPXX35AGULHHAQF53MVXMP4QWFNMU42UB5DIQU2WVPFRXHZQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460783097 (13h6m27.619548831s) [noise=true , address=45.91.116.10:4082 , piece_id=BJLH6T6U3KX2NFULVBHBV5CN22A4EYIW4WZ72DLQR2RGO2Z5CH6Q, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460888809 (13h6m27.619654543s) [noise=true , address=45.91.116.11:4117 , piece_id=67PBXUQUCPQD7VMHRLID5FF7SQ4WERZ2JSQYTNXA5XNSI5OPV5BQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.461003889 (13h6m27.619769623s) [noise=true , address=45.91.116.4:4937 , piece_id=PBXT4AETJ6VHFM2JZT2NDRYAVSTM2TARFFSUIA7VHL5UK5EMA5LA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.461104701 (13h6m27.619870435s) [noise=true , address=45.91.116.6:4974 , piece_id=ZMWMMXNFKXM53RR5SJ7EOETPLKE5OF3M2XWPZK6KRRHIYGGOF6IQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.461325174 (13h6m27.620090908s) [noise=true , address=45.91.116.6:4975 , piece_id=JUBQY6XEVD6CE6XBGV4SQRXP3RNKS3UGOGHISKWCD45FKZ664EVA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:02.151727790 (13h6m29.310493534s) [upload=11489]: Next returned nil segment Aug 26 05:10:02.151748860 (13h6m29.310514604s) [upload=11489]: Waiting for error group managing segments... Aug 26 05:10:02.473440315 (13h6m29.632206049s) [noise=true , address=45.91.116.4:4940 , piece_id=JV6GL6TUFP4TR56EWH4ATSB7CNPI3FB6IQSDYQXUBDFXJ6APXP7Q, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.484373384 (13h6m29.643139118s) [noise=true , address=45.91.116.7:4009 , piece_id=FXWX6FMOHAQAJ4RE2KMYRU2FXLCDWIO3N53X26XIEMLD45FPH3SA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.490159856 (13h6m29.6489256s) [noise=true , address=45.91.116.11:4117 , piece_id=67PBXUQUCPQD7VMHRLID5FF7SQ4WERZ2JSQYTNXA5XNSI5OPV5BQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.492152268 (13h6m29.650918012s) [noise=true , address=45.91.116.10:4082 , piece_id=BJLH6T6U3KX2NFULVBHBV5CN22A4EYIW4WZ72DLQR2RGO2Z5CH6Q, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.494433594 (13h6m29.653199338s) [noise=true , address=45.91.116.10:4083 , piece_id=KHW4R4N355H2U4CRKNYOZIUYF2KR6H43MR5OPMUARP53UDV33CUQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.495329237 (13h6m29.654094971s) [noise=true , address=45.91.116.6:4975 , piece_id=JUBQY6XEVD6CE6XBGV4SQRXP3RNKS3UGOGHISKWCD45FKZ664EVA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.496820270 (13h6m29.655586004s) [noise=true , address=45.91.116.13:4153 , piece_id=DYGOMRBOQMRG5FYFB5KQTJA7E6M4VKE4PBLZV6CNFHGO7RKKRGJA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.500361856 (13h6m29.659127591s) [noise=true , address=45.91.116.4:4937 , piece_id=PBXT4AETJ6VHFM2JZT2NDRYAVSTM2TARFFSUIA7VHL5UK5EMA5LA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.503519689 (13h6m29.662285423s) [noise=true , address=45.91.116.8:4048 , piece_id=7XC2GOTOY3XHOHG5N7N7P4X2BFWLUDZ76NE2M4XZW4SBV5BBLDIA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.508403403 (13h6m29.667169147s) [noise=true , address=45.91.116.9:4262 , piece_id=4BO666AS6IQZT5PG4KQBLUTIDOMMVD4YUVOXQQBIUXCV6UZSKTYQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.554355438 (13h6m29.713121182s) [noise=true , address=104.36.82.4:4804 , piece_id=AM23DPXX35AGULHHAQF53MVXMP4QWFNMU42UB5DIQU2WVPFRXHZQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.560150676 (13h6m29.71891642s) [noise=true , address=45.91.116.6:4974 , piece_id=ZMWMMXNFKXM53RR5SJ7EOETPLKE5OF3M2XWPZK6KRRHIYGGOF6IQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.563885743 (13h6m29.722651488s) [noise=true , address=77.90.31.11:4555 , piece_id=WO7BT6STTZVKUA5BDXUSD3SWYYBAZJVCUR37P62ETA5KL6NOM6BA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.563915971 (13h6m29.722681715s) [seg_pos={0 0}, upload=11489]: Segment reached optimal threshold of 13 pieces. Aug 26 05:10:02.564083411 (13h6m29.722849156s) [noise=true , address=104.36.82.9:4005 , piece_id=CBV4WJSIWHOZH4T5IUVEQQ35FVG23O7RBUCHVC22XFDQUZ2TIP4Q, seg_pos={0 0}, upload=11489]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:02.564137204 (13h6m29.722902948s) [noise=true , address=77.90.31.18:4806 , piece_id=SDZICVRR7IUNYOLSROBRHFE2VXG4C5NN3TAV6QTMNX5MI3O67FJA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:02.564254889 (13h6m29.723020633s) [noise=true , address=45.91.116.5:4298 , piece_id=6BN2RQPJTBBQJU6UKVUBDJSRANPE72XUNQIU4T3QC3DAU5CXF4AQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:02.564284426 (13h6m29.72305016s) [seg_pos={0 0}, upload=11489]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:10:02.564375050 (13h6m29.723140794s) [upload=11489]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:10:02.564382143 (13h6m29.723147887s) [upload=11489]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:10:10.849376462 (13h6m38.008142186s) [upload=11489]: Done uploading segments... Aug 26 05:10:10.849392913 (13h6m38.008158647s) [upload=11489]: Upload finished. err: <nil> Duration: 25.660298994s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................................................X.XX] duration: 1m0.001568242s FAIL (2025-08-26 05:12:30 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001581387s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 8.725720231s remote: "tcp:45.38.24.2:443" response headers: Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=185F3861590E5916 X-Request-Id=CK5Mt9e6Fvi X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=433 Server=Storj Date=Tue, 26 Aug 2025 04:59:30 GMT target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:12:27 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3861590E5916</RequestId><HostId></HostId></Error>" Duration: 8.725748144s edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 3 out of 60 is failed (threshold=6) [.........................................X................XX] duration: 1.149860153s remote: "tcp:185.244.226.2:443" response headers: Date=Tue, 26 Aug 2025 05:12:19 GMT Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=dD8wM4mmfux Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:12:19 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 1.149892334s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 6 out of 60 is failed (threshold=3) [....................................X..X...XX.........X...X.] duration: 24.032898074s FAIL (2025-08-26 05:12:13 UTC) orbiter warning: operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 24.032922912s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X.........X..X.] duration: 8.244126434s remote: "tcp:207.211.208.129:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3906C1A6017D X-Request-Id=GChhLjUfBVZ Content-Length=423 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:11:21 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:12:13 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3906C1A6017D</RequestId><HostId></HostId></Error>" Duration: 8.244156731s edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 8.719069328s remote: "tcp:45.38.24.2:443" response headers: Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=185F3861590E5916 X-Request-Id=CK5Mt9e6Fvi X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=433 Server=Storj Date=Tue, 26 Aug 2025 04:59:30 GMT target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:12:10 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3861590E5916</RequestId><HostId></HostId></Error>" Duration: 8.719101137s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 7 out of 60 is failed (threshold=3) [........................................X.X...X.......XXX.X.] duration: 22.214466519s FAIL (2025-08-26 05:12:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 22.214509841s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [..................................XXX...X..............X.X..] duration: 26.845638529s FAIL (2025-08-26 05:12:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:09:56.008953276 (13h6m23.16771901s) [upload=11489]: Starting upload Aug 26 05:09:56.009072044 (13h6m23.167837788s) [upload=11489]: Done starting upload Aug 26 05:09:56.009383028 (13h6m23.168148762s) [upload=11489]: Uploading segments... Aug 26 05:09:56.009423316 (13h6m23.16818906s) [upload=11489]: Got next segment. Inline: false Aug 26 05:09:56.009453183 (13h6m23.168218917s) [upload=11489]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:09:56.009459585 (13h6m23.168225329s) [upload=11489]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:10:00.458966751 (13h6m27.617732486s) [seg_pos={0 0}, upload=11489]: Begin upload segment... Aug 26 05:10:00.459008721 (13h6m27.617774455s) [seg_pos={0 0}, upload=11489]: Done begin upload segment. Aug 26 05:10:00.459034110 (13h6m27.617799844s) [noise=true , address=45.91.116.4:4940 , piece_id=JV6GL6TUFP4TR56EWH4ATSB7CNPI3FB6IQSDYQXUBDFXJ6APXP7Q, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.459134011 (13h6m27.617899826s) [noise=true , address=77.90.31.11:4555 , piece_id=WO7BT6STTZVKUA5BDXUSD3SWYYBAZJVCUR37P62ETA5KL6NOM6BA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.459421741 (13h6m27.618187475s) [noise=true , address=45.91.116.9:4262 , piece_id=4BO666AS6IQZT5PG4KQBLUTIDOMMVD4YUVOXQQBIUXCV6UZSKTYQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.459694333 (13h6m27.618460067s) [noise=true , address=45.91.116.10:4083 , piece_id=KHW4R4N355H2U4CRKNYOZIUYF2KR6H43MR5OPMUARP53UDV33CUQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.459700084 (13h6m27.618465818s) [noise=true , address=45.91.116.7:4009 , piece_id=FXWX6FMOHAQAJ4RE2KMYRU2FXLCDWIO3N53X26XIEMLD45FPH3SA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460006460 (13h6m27.618772204s) [noise=true , address=104.36.82.9:4005 , piece_id=CBV4WJSIWHOZH4T5IUVEQQ35FVG23O7RBUCHVC22XFDQUZ2TIP4Q, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460018193 (13h6m27.618783927s) [noise=true , address=77.90.31.18:4806 , piece_id=SDZICVRR7IUNYOLSROBRHFE2VXG4C5NN3TAV6QTMNX5MI3O67FJA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460307496 (13h6m27.61907323s) [noise=true , address=45.91.116.5:4298 , piece_id=6BN2RQPJTBBQJU6UKVUBDJSRANPE72XUNQIU4T3QC3DAU5CXF4AQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460360708 (13h6m27.619126442s) [noise=true , address=45.91.116.8:4048 , piece_id=7XC2GOTOY3XHOHG5N7N7P4X2BFWLUDZ76NE2M4XZW4SBV5BBLDIA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460566983 (13h6m27.619332717s) [noise=true , address=45.91.116.13:4153 , piece_id=DYGOMRBOQMRG5FYFB5KQTJA7E6M4VKE4PBLZV6CNFHGO7RKKRGJA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460628390 (13h6m27.619394124s) [noise=true , address=104.36.82.4:4804 , piece_id=AM23DPXX35AGULHHAQF53MVXMP4QWFNMU42UB5DIQU2WVPFRXHZQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460783097 (13h6m27.619548831s) [noise=true , address=45.91.116.10:4082 , piece_id=BJLH6T6U3KX2NFULVBHBV5CN22A4EYIW4WZ72DLQR2RGO2Z5CH6Q, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.460888809 (13h6m27.619654543s) [noise=true , address=45.91.116.11:4117 , piece_id=67PBXUQUCPQD7VMHRLID5FF7SQ4WERZ2JSQYTNXA5XNSI5OPV5BQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.461003889 (13h6m27.619769623s) [noise=true , address=45.91.116.4:4937 , piece_id=PBXT4AETJ6VHFM2JZT2NDRYAVSTM2TARFFSUIA7VHL5UK5EMA5LA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.461104701 (13h6m27.619870435s) [noise=true , address=45.91.116.6:4974 , piece_id=ZMWMMXNFKXM53RR5SJ7EOETPLKE5OF3M2XWPZK6KRRHIYGGOF6IQ, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:00.461325174 (13h6m27.620090908s) [noise=true , address=45.91.116.6:4975 , piece_id=JUBQY6XEVD6CE6XBGV4SQRXP3RNKS3UGOGHISKWCD45FKZ664EVA, seg_pos={0 0}, upload=11489]: Uploading piece... Aug 26 05:10:02.151727790 (13h6m29.310493534s) [upload=11489]: Next returned nil segment Aug 26 05:10:02.151748860 (13h6m29.310514604s) [upload=11489]: Waiting for error group managing segments... Aug 26 05:10:02.473440315 (13h6m29.632206049s) [noise=true , address=45.91.116.4:4940 , piece_id=JV6GL6TUFP4TR56EWH4ATSB7CNPI3FB6IQSDYQXUBDFXJ6APXP7Q, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.484373384 (13h6m29.643139118s) [noise=true , address=45.91.116.7:4009 , piece_id=FXWX6FMOHAQAJ4RE2KMYRU2FXLCDWIO3N53X26XIEMLD45FPH3SA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.490159856 (13h6m29.6489256s) [noise=true , address=45.91.116.11:4117 , piece_id=67PBXUQUCPQD7VMHRLID5FF7SQ4WERZ2JSQYTNXA5XNSI5OPV5BQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.492152268 (13h6m29.650918012s) [noise=true , address=45.91.116.10:4082 , piece_id=BJLH6T6U3KX2NFULVBHBV5CN22A4EYIW4WZ72DLQR2RGO2Z5CH6Q, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.494433594 (13h6m29.653199338s) [noise=true , address=45.91.116.10:4083 , piece_id=KHW4R4N355H2U4CRKNYOZIUYF2KR6H43MR5OPMUARP53UDV33CUQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.495329237 (13h6m29.654094971s) [noise=true , address=45.91.116.6:4975 , piece_id=JUBQY6XEVD6CE6XBGV4SQRXP3RNKS3UGOGHISKWCD45FKZ664EVA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.496820270 (13h6m29.655586004s) [noise=true , address=45.91.116.13:4153 , piece_id=DYGOMRBOQMRG5FYFB5KQTJA7E6M4VKE4PBLZV6CNFHGO7RKKRGJA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.500361856 (13h6m29.659127591s) [noise=true , address=45.91.116.4:4937 , piece_id=PBXT4AETJ6VHFM2JZT2NDRYAVSTM2TARFFSUIA7VHL5UK5EMA5LA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.503519689 (13h6m29.662285423s) [noise=true , address=45.91.116.8:4048 , piece_id=7XC2GOTOY3XHOHG5N7N7P4X2BFWLUDZ76NE2M4XZW4SBV5BBLDIA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.508403403 (13h6m29.667169147s) [noise=true , address=45.91.116.9:4262 , piece_id=4BO666AS6IQZT5PG4KQBLUTIDOMMVD4YUVOXQQBIUXCV6UZSKTYQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.554355438 (13h6m29.713121182s) [noise=true , address=104.36.82.4:4804 , piece_id=AM23DPXX35AGULHHAQF53MVXMP4QWFNMU42UB5DIQU2WVPFRXHZQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.560150676 (13h6m29.71891642s) [noise=true , address=45.91.116.6:4974 , piece_id=ZMWMMXNFKXM53RR5SJ7EOETPLKE5OF3M2XWPZK6KRRHIYGGOF6IQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.563885743 (13h6m29.722651488s) [noise=true , address=77.90.31.11:4555 , piece_id=WO7BT6STTZVKUA5BDXUSD3SWYYBAZJVCUR37P62ETA5KL6NOM6BA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: <nil> Aug 26 05:10:02.563915971 (13h6m29.722681715s) [seg_pos={0 0}, upload=11489]: Segment reached optimal threshold of 13 pieces. Aug 26 05:10:02.564083411 (13h6m29.722849156s) [noise=true , address=104.36.82.9:4005 , piece_id=CBV4WJSIWHOZH4T5IUVEQQ35FVG23O7RBUCHVC22XFDQUZ2TIP4Q, seg_pos={0 0}, upload=11489]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:02.564137204 (13h6m29.722902948s) [noise=true , address=77.90.31.18:4806 , piece_id=SDZICVRR7IUNYOLSROBRHFE2VXG4C5NN3TAV6QTMNX5MI3O67FJA, seg_pos={0 0}, upload=11489]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:02.564254889 (13h6m29.723020633s) [noise=true , address=45.91.116.5:4298 , piece_id=6BN2RQPJTBBQJU6UKVUBDJSRANPE72XUNQIU4T3QC3DAU5CXF4AQ, seg_pos={0 0}, upload=11489]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Aug 26 05:10:02.564284426 (13h6m29.72305016s) [seg_pos={0 0}, upload=11489]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:10:02.564375050 (13h6m29.723140794s) [upload=11489]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:10:02.564382143 (13h6m29.723147887s) [upload=11489]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:10:10.849376462 (13h6m38.008142186s) [upload=11489]: Done uploading segments... Aug 26 05:10:10.849392913 (13h6m38.008158647s) [upload=11489]: Upload finished. err: <nil> Duration: 26.845656623s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 9 out of 60 is failed (threshold=3) [.....................................XXX....XX........XX..XX] duration: 30.00088738s FAIL (2025-08-26 05:11:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:11:23.519574536 (13h7m50.67834027s) [upload=11510]: Starting upload Aug 26 05:11:23.519630132 (13h7m50.678395866s) [upload=11510]: Done starting upload Aug 26 05:11:23.519672193 (13h7m50.678437927s) [upload=11510]: Uploading segments... Aug 26 05:11:23.519714494 (13h7m50.678480228s) [upload=11510]: Got next segment. Inline: true Aug 26 05:11:23.519718492 (13h7m50.678484226s) [upload=11510]: Waiting for error group managing segments... Aug 26 05:11:23.519765732 (13h7m50.678531466s) [upload=11510]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:11:23.519770321 (13h7m50.678536055s) [upload=11510]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:11:23.519772706 (13h7m50.67853844s) [upload=11510]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:11:52.490915682 (13h8m19.649681416s) [upload=11510]: Done uploading segments... Aug 26 05:11:52.490933236 (13h8m19.64969896s) [upload=11510]: Upload finished. err: <nil> Duration:* 30.000910904s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)