Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [X....X....X.XXXX..X.XX........XX..XX..XX.X..................] duration: 5.836931005s FAIL (2025-08-26 06:16:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 06:01:33.966981454 (13h58m1.125747188s) [upload=12238]: Starting upload Aug 26 06:01:33.967043734 (13h58m1.125809468s) [upload=12238]: Done starting upload Aug 26 06:01:33.967134407 (13h58m1.125900141s) [upload=12238]: Uploading segments... Aug 26 06:01:33.967231903 (13h58m1.125997637s) [upload=12238]: Got next segment. Inline: false Aug 26 06:01:33.967265127 (13h58m1.126030851s) [upload=12238]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 06:01:33.967269485 (13h58m1.126035219s) [upload=12238]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 06:01:36.228682523 (13h58m3.387448257s) [seg_pos={0 0}, upload=12238]: Begin upload segment... Aug 26 06:01:36.228721969 (13h58m3.387487693s) [seg_pos={0 0}, upload=12238]: Done begin upload segment. Aug 26 06:01:36.228741846 (13h58m3.38750757s) [noise=true , address=45.91.116.7:4011 , piece_id=N2JHFX2J2N4HJQMSGDW63KTSYRUNZ5XSSEGPAXDNC7APTVDDXZEA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.228749832 (13h58m3.387515566s) [noise=true , address=45.91.116.14:4190 , piece_id=4Z4ENOGXEXOBEGS23D3CNMDLD7KKTPRCF4UUEEYJIDURLB5NPV2Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.228790529 (13h58m3.387556264s) [noise=true , address=45.91.116.4:4940 , piece_id=EOTFWQ7IA3ZGOKGV6UL76IW3KVBH7BSDUWNJJANSH3RIXV4P3XHQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229133707 (13h58m3.387899441s) [noise=true , address=45.91.116.9:4261 , piece_id=O6EYBDQ346LA2BRQ2JXV3EZY6MIKRGTMY2LMSG7W55PCQ5NOYFHQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229175256 (13h58m3.38794099s) [noise=true , address=77.90.31.12:4590 , piece_id=TKUT2ZV7CIAF4WODX4BS3PVMUFPUB3S4Q5VWLWSOXMTQH3WSCEVA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229559611 (13h58m3.388325355s) [noise=true , address=77.90.31.21:4878 , piece_id=HGMW355XDVQ7C5V3S4TJA4TIETBKSN7TPS4P4GUBQICLN4QAEWPA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229859685 (13h58m3.388625419s) [noise=true , address=45.91.116.13:4155 , piece_id=ZQPF33BDGT3H6WQSI3P7VCFPGE5SF2VXJGPKBXBKENL3MSRRJM7A, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229933657 (13h58m3.388699381s) [noise=true , address=77.90.31.19:4841 , piece_id=ABB6E26HC74OUMTDONDWVIR3J7KQGDRJPWLE3WUPSE5OCQZXSD3Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230227839 (13h58m3.388993563s) [noise=true , address=77.90.31.16:4734 , piece_id=UJMKMSAHDH5X74RPMOKRR2SHTWZNMJPVBCOFV3T3OTCP2DOJR7JA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230234873 (13h58m3.389000607s) [noise=true , address=104.36.82.10:4077 , piece_id=SWDDXFHVEAASFT3QGRVXNJREDIIKXGJWKT2AMC5WBRV3QI356SGQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230512725 (13h58m3.389278449s) [noise=true , address=45.91.116.12:4226 , piece_id=A6YHKD5AFXRKOWQWGFKOMDLPU3OMGKSV2TVM4NRJC35GWZPD7JAQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230645098 (13h58m3.389410832s) [noise=true , address=45.91.116.13:4153 , piece_id=5KVUFP43OT4TBGY6ER7AYPA7GJHLBXURLRBCTJNH2VJM6H27XLCQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230829510 (13h58m3.389595245s) [noise=true , address=77.90.31.14:4663 , piece_id=KTCI2YDX527DYFGHLU3EN7X5CET52EPI3OPZMMM23GVUC6UEWPEA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231136609 (13h58m3.389902343s) [noise=true , address=45.91.116.7:4009 , piece_id=YWY62TMLMAC4RO3VL32S4Y4AICDG23IMLGJFLN5O5AXWJHZOREQA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231242481 (13h58m3.390008225s) [noise=true , address=45.91.116.10:4083 , piece_id=BKKDIJSBDXPFIEBFAE5K3HMZYMUV57DZZZ2PPTKSDN5W26HRUG3Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231384423 (13h58m3.390150147s) [noise=true , address=77.90.31.18:4805 , piece_id=AETDASIPJ37ICCK4EKSLOVLS77S22JBI4GVSBASTZPPSSFZDXK4Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:37.971564373 (13h58m5.130330107s) [upload=12238]: Next returned nil segment Aug 26 06:01:37.971583579 (13h58m5.130349313s) [upload=12238]: Waiting for error group managing segments... Aug 26 06:01:38.251877415 (13h58m5.410643139s) [noise=true , address=45.91.116.14:4190 , piece_id=4Z4ENOGXEXOBEGS23D3CNMDLD7KKTPRCF4UUEEYJIDURLB5NPV2Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.252547697 (13h58m5.411313431s) [noise=true , address=45.91.116.12:4226 , piece_id=A6YHKD5AFXRKOWQWGFKOMDLPU3OMGKSV2TVM4NRJC35GWZPD7JAQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.261324140 (13h58m5.420089874s) [noise=true , address=45.91.116.13:4155 , piece_id=ZQPF33BDGT3H6WQSI3P7VCFPGE5SF2VXJGPKBXBKENL3MSRRJM7A, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.262792210 (13h58m5.421557944s) [noise=true , address=77.90.31.19:4841 , piece_id=ABB6E26HC74OUMTDONDWVIR3J7KQGDRJPWLE3WUPSE5OCQZXSD3Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.267644835 (13h58m5.426410569s) [noise=true , address=45.91.116.13:4153 , piece_id=5KVUFP43OT4TBGY6ER7AYPA7GJHLBXURLRBCTJNH2VJM6H27XLCQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.269180032 (13h58m5.427945766s) [noise=true , address=45.91.116.7:4009 , piece_id=YWY62TMLMAC4RO3VL32S4Y4AICDG23IMLGJFLN5O5AXWJHZOREQA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.277360584 (13h58m5.436126318s) [noise=true , address=45.91.116.9:4261 , piece_id=O6EYBDQ346LA2BRQ2JXV3EZY6MIKRGTMY2LMSG7W55PCQ5NOYFHQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.288401611 (13h58m5.447167335s) [noise=true , address=45.91.116.7:4011 , piece_id=N2JHFX2J2N4HJQMSGDW63KTSYRUNZ5XSSEGPAXDNC7APTVDDXZEA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.326794461 (13h58m5.485560195s) [noise=true , address=45.91.116.10:4083 , piece_id=BKKDIJSBDXPFIEBFAE5K3HMZYMUV57DZZZ2PPTKSDN5W26HRUG3Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.327600795 (13h58m5.486366529s) [noise=true , address=77.90.31.12:4590 , piece_id=TKUT2ZV7CIAF4WODX4BS3PVMUFPUB3S4Q5VWLWSOXMTQH3WSCEVA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.330252889 (13h58m5.489018633s) [noise=true , address=77.90.31.14:4663 , piece_id=KTCI2YDX527DYFGHLU3EN7X5CET52EPI3OPZMMM23GVUC6UEWPEA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.337759492 (13h58m5.496525226s) [noise=true , address=104.36.82.10:4077 , piece_id=SWDDXFHVEAASFT3QGRVXNJREDIIKXGJWKT2AMC5WBRV3QI356SGQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.341411059 (13h58m5.500176803s) [noise=true , address=45.91.116.4:4940 , piece_id=EOTFWQ7IA3ZGOKGV6UL76IW3KVBH7BSDUWNJJANSH3RIXV4P3XHQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.341436287 (13h58m5.500202021s) [seg_pos={0 0}, upload=12238]: Segment reached optimal threshold of 13 pieces. Aug 26 06:01:38.341547309 (13h58m5.500313043s) [noise=true , address=77.90.31.21:4878 , piece_id=HGMW355XDVQ7C5V3S4TJA4TIETBKSN7TPS4P4GUBQICLN4QAEWPA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341666147 (13h58m5.500431882s) [noise=true , address=77.90.31.16:4734 , piece_id=UJMKMSAHDH5X74RPMOKRR2SHTWZNMJPVBCOFV3T3OTCP2DOJR7JA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341725080 (13h58m5.500490814s) [noise=true , address=77.90.31.18:4805 , piece_id=AETDASIPJ37ICCK4EKSLOVLS77S22JBI4GVSBASTZPPSSFZDXK4Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341751140 (13h58m5.500516874s) [seg_pos={0 0}, upload=12238]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 06:01:38.341841753 (13h58m5.500607487s) [upload=12238]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 06:01:38.341846252 (13h58m5.500611986s) [upload=12238]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 06:01:43.222504557 (13h58m10.381270291s) [upload=12238]: Done uploading segments... Aug 26 06:01:43.222522181 (13h58m10.381287915s) [upload=12238]: Upload finished. err: <nil> Duration: 5.836967825s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.XXX.....XXX.XX.............X...X.X.XX......................] duration: 5.878353174s FAIL (2025-08-26 06:16:31 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.878373262s edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [...........X.......X..X..........X....X.....................] duration: 233.943619ms remote: "tcp:185.244.226.2:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Date=Tue, 26 Aug 2025 06:00:37 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Origin=* X-Request-Id=77T4Bv5mHju target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 06:16:30 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 233.974177ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 15 out of 60 is failed (threshold=3) [.XX........XX.XX....X..XX.........XX.X.XXX..................] duration: 2.036893198s FAIL (2025-08-26 06:16:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 06:01:08.342560001 (13h57m35.501325736s) [upload=12234]: Starting upload Aug 26 06:01:08.342643181 (13h57m35.501408915s) [upload=12234]: Done starting upload Aug 26 06:01:08.342701543 (13h57m35.501467277s) [upload=12234]: Uploading segments... Aug 26 06:01:08.342775774 (13h57m35.501541509s) [upload=12234]: Got next segment. Inline: true Aug 26 06:01:08.342780554 (13h57m35.501546289s) [upload=12234]: Waiting for error group managing segments... Aug 26 06:01:08.342822424 (13h57m35.501588158s) [upload=12234]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 06:01:08.342827043 (13h57m35.501592777s) [upload=12234]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 06:01:08.342829718 (13h57m35.501595452s) [upload=12234]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 06:01:12.739727752 (13h57m39.898493507s) [upload=12234]: Done uploading segments... Aug 26 06:01:12.739748322 (13h57m39.898514056s) [upload=12234]: Upload finished. err: <nil> Duration:* 2.036917215s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 8 out of 60 is failed (threshold=3) [........X......XXX............XX..X..X......................] duration: 735.796195ms remote: "tcp:45.38.24.2:443" response headers: Content-Length=433 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 06:00:36 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=185F3BB6D312505B X-Request-Id=6Gw8NdfoL57 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 06:16:25 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3BB6D312505B</RequestId><HostId></HostId></Error>" Duration: 735.824969ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [......XX.X...................X..............................] duration: 235.846599ms remote: "tcp:207.211.208.129:443" response headers: X-Xss-Protection=1; mode=block Accept-Ranges=bytes Date=Tue, 26 Aug 2025 05:56:05 GMT Content-Length=423 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=185F3B77B1A24724 X-Request-Id=jE3iVaxRVjP target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 06:16:20 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3B77B1A24724</RequestId><HostId></HostId></Error>" Duration: 235.870897ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......XX..X...X.XX...........XXX.XX.X......................] duration: 5.83474947s FAIL (2025-08-26 06:16:17 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.834776232s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [XX.....X.....X....XXXX..........X..XXX.X....................] duration: 2.317390203s FAIL (2025-08-26 06:16:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.317408017s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..XXX.....XXX.XX.............X...X.X.XX.....................] duration: 6.248970575s FAIL (2025-08-26 06:16:12 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.248991424s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [X.XX........XX.XX....X..XX.........XX.X.XXX.................] duration: 1.848821623s FAIL (2025-08-26 06:16:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 06:01:08.342560001 (13h57m35.501325736s) [upload=12234]: Starting upload Aug 26 06:01:08.342643181 (13h57m35.501408915s) [upload=12234]: Done starting upload Aug 26 06:01:08.342701543 (13h57m35.501467277s) [upload=12234]: Uploading segments... Aug 26 06:01:08.342775774 (13h57m35.501541509s) [upload=12234]: Got next segment. Inline: true Aug 26 06:01:08.342780554 (13h57m35.501546289s) [upload=12234]: Waiting for error group managing segments... Aug 26 06:01:08.342822424 (13h57m35.501588158s) [upload=12234]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 06:01:08.342827043 (13h57m35.501592777s) [upload=12234]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 06:01:08.342829718 (13h57m35.501595452s) [upload=12234]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 06:01:12.739727752 (13h57m39.898493507s) [upload=12234]: Done uploading segments... Aug 26 06:01:12.739748322 (13h57m39.898514056s) [upload=12234]: Upload finished. err: <nil> Duration:* 1.848846912s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 8 out of 60 is failed (threshold=3) [.........X......XXX............XX..X..X.....................] duration: 800.513856ms remote: "tcp:45.38.24.2:443" response headers: Content-Length=433 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 06:00:36 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=185F3BB6D312505B X-Request-Id=6Gw8NdfoL57 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 06:16:04 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3BB6D312505B</RequestId><HostId></HostId></Error>" Duration: 800.53708ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 10 out of 60 is failed (threshold=3) [......XX.XX.....XXX.X...........XX..........................] duration: 1.861488522s FAIL (2025-08-26 06:16:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:56:16.833543439 (13h52m43.992309173s) [upload=12161]: Starting upload Aug 26 05:56:16.833599205 (13h52m43.992364939s) [upload=12161]: Done starting upload Aug 26 05:56:16.833651586 (13h52m43.99241731s) [upload=12161]: Uploading segments... Aug 26 05:56:16.833712372 (13h52m43.992478106s) [upload=12161]: Got next segment. Inline: true Aug 26 05:56:16.833717171 (13h52m43.992482905s) [upload=12161]: Waiting for error group managing segments... Aug 26 05:56:16.833768870 (13h52m43.992534604s) [upload=12161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:56:16.833774881 (13h52m43.992540615s) [upload=12161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:56:16.833793016 (13h52m43.99255875s) [upload=12161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:56:17.243509800 (13h52m44.402275534s) [upload=12161]: Done uploading segments... Aug 26 05:56:17.243527964 (13h52m44.402293699s) [upload=12161]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 1.861520473s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........X.....X................X..........................] duration: 6.604733962s FAIL (2025-08-26 06:15:56 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3B7C25E954D0, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 6.604754552s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 7 out of 60 is failed (threshold=3) [.......X.XX.....X.X...............XX........................] duration: 5.787763149s FAIL (2025-08-26 06:15:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:57:53.229787528 (13h54m20.388553262s) [upload=12181]: Starting upload Aug 26 05:57:53.229866149 (13h54m20.388631883s) [upload=12181]: Done starting upload Aug 26 05:57:53.229949559 (13h54m20.388715293s) [upload=12181]: Uploading segments... Aug 26 05:57:53.230047747 (13h54m20.388813481s) [upload=12181]: Got next segment. Inline: false Aug 26 05:57:53.230078435 (13h54m20.388844169s) [upload=12181]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:57:53.230083365 (13h54m20.388849099s) [upload=12181]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:57:57.671117492 (13h54m24.829883226s) [seg_pos={0 0}, upload=12181]: Begin upload segment... Aug 26 05:57:57.671158381 (13h54m24.829924115s) [seg_pos={0 0}, upload=12181]: Done begin upload segment. Aug 26 05:57:57.671178558 (13h54m24.829944293s) [noise=true , address=104.36.82.15:4290 , piece_id=WN3XAYHTTP7MLRD4JBWZA46LCU7ZZOCJG33VXTM4MKVQAMDT4D3A, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671225048 (13h54m24.829990782s) [noise=true , address=79.127.201.215:4360 , piece_id=NPFLNT5ZXPXHL2G4SBO7G6PBBCED4DVTKUQ7H4AACEBIMHM2E4VQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671552484 (13h54m24.830318208s) [noise=true , address=45.91.116.4:4960 , piece_id=7X22MD7TCFLRW4G47Q4P3HRSF2QNQCGOYWJBUFTSM66OSFBRQDEA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671741506 (13h54m24.83050724s) [noise=true , address=104.36.82.23:4468 , piece_id=OD45WJDG5OKB3IC4BULXPYHD6V7QTJMLO64KFWPGA6ZR7PO5ZBOQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671838101 (13h54m24.830603835s) [noise=true , address=77.90.31.10:4538 , piece_id=3AQWXQXBHCNYP2XQKCA4LPEDH3ZZ6WHVAYK3LTZS4WNP76DTWDEA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672083650 (13h54m24.830849384s) [noise=true , address=64.49.13.154:4934 , piece_id=T55ATJHP6AO2BIKFYO6WBOLERUI7FNFUCTSOQ4ASPD6FNDJKJWSA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672177120 (13h54m24.830942854s) [noise=true , address=77.90.31.14:4681 , piece_id=MPGCU5ZSZEL4VKCOYMS7ZX5A57BY46FLU4P3CQ4KITEWWOUDJ4LQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672491421 (13h54m24.831257155s) [noise=true , address=77.90.31.19:4862 , piece_id=FEQAYMXTAZTNP3PCTIFJMW7IOWAZ6NRBMLARTS3IUCR2CHKYMKLA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672508203 (13h54m24.831273937s) [noise=true , address=104.36.82.10:4088 , piece_id=CPDOJATUHTB5OFXSYTI2JFQ5ZSXSJCOV5B6DU3HILFJNIHGNYMRA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672788690 (13h54m24.831554414s) [noise=true , address=77.90.31.18:4823 , piece_id=SCDSAFCYWBDBAA7PMCW2OTLPMXX3ZTVQEAMGQDDKMZLVQ3JFELKA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672887669 (13h54m24.831653403s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NKL4MGXJGQPYRSOHJII3ONXFXZLYON5SAH5KYIZKG7XM3RBGAQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673083794 (13h54m24.831849518s) [noise=true , address=156.146.43.225:4450 , piece_id=P3CORXRBNMVYZR3M2VJWPDE5LKL6BYAK2VOW6PW6FO7GZNXPHHHQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673200808 (13h54m24.831966542s) [noise=true , address=79.127.219.51:4199 , piece_id=HIRZ2XKQBZ64DP3C37LGLKOZOZKI4EF6MGQYMNIQGKPZSJCWXTYQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673305198 (13h54m24.832070922s) [noise=true , address=45.91.116.12:4236 , piece_id=VYYTQ2L4NJPJYBOCKOT7MW4Q2IPPQY3GUMUYV56NQPRBQRQEP3YA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673460926 (13h54m24.83222666s) [noise=true , address=104.36.82.5:4857 , piece_id=UYH3F2UZXZPJS33QLL2TFF3QMT3RSVGIBZDPHJMTGPH5VLAZ27OA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673715744 (13h54m24.832481468s) [noise=true , address=104.36.82.16:4315 , piece_id=E2KJWAQ5YZLL3ZEGBEV4U2TL5UVDGM5Y7AF2WTOYPNKI7I7WACVA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673839791 (13h54m24.832605525s) [noise=true , address=104.36.82.44:4880 , piece_id=CCPOVQB7AUXKAXMVHLITUB6GVCFNKBCORWXOC7W5A54CDR2OFASA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.674066565 (13h54m24.832832299s) [noise=true , address=104.36.82.50:4028 , piece_id=ZF55MSIK6YVWAMZZVADOCOEMGWGV3KVF57DMBUIC5FW4G5H576ZA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:58.853667308 (13h54m26.012433042s) [upload=12181]: Next returned nil segment Aug 26 05:57:58.853685563 (13h54m26.012451287s) [upload=12181]: Waiting for error group managing segments... Aug 26 05:57:59.158597313 (13h54m26.317363047s) [noise=true , address=64.49.13.154:4934 , piece_id=T55ATJHP6AO2BIKFYO6WBOLERUI7FNFUCTSOQ4ASPD6FNDJKJWSA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.530803022 (13h54m26.689568757s) [noise=true , address=79.127.219.51:4199 , piece_id=HIRZ2XKQBZ64DP3C37LGLKOZOZKI4EF6MGQYMNIQGKPZSJCWXTYQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.590970267 (13h54m26.749735991s) [noise=true , address=45.91.116.4:4960 , piece_id=7X22MD7TCFLRW4G47Q4P3HRSF2QNQCGOYWJBUFTSM66OSFBRQDEA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.591150923 (13h54m26.749916657s) [noise=true , address=104.36.82.50:4028 , piece_id=ZF55MSIK6YVWAMZZVADOCOEMGWGV3KVF57DMBUIC5FW4G5H576ZA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.592999480 (13h54m26.751765214s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NKL4MGXJGQPYRSOHJII3ONXFXZLYON5SAH5KYIZKG7XM3RBGAQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.609956145 (13h54m26.768721879s) [noise=true , address=156.146.43.225:4450 , piece_id=P3CORXRBNMVYZR3M2VJWPDE5LKL6BYAK2VOW6PW6FO7GZNXPHHHQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.615646122 (13h54m26.774411846s) [noise=true , address=104.36.82.10:4088 , piece_id=CPDOJATUHTB5OFXSYTI2JFQ5ZSXSJCOV5B6DU3HILFJNIHGNYMRA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.618123673 (13h54m26.776889427s) [noise=true , address=104.36.82.5:4857 , piece_id=UYH3F2UZXZPJS33QLL2TFF3QMT3RSVGIBZDPHJMTGPH5VLAZ27OA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.623700524 (13h54m26.782466258s) [noise=true , address=77.90.31.14:4681 , piece_id=MPGCU5ZSZEL4VKCOYMS7ZX5A57BY46FLU4P3CQ4KITEWWOUDJ4LQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.626669584 (13h54m26.785435318s) [noise=true , address=104.36.82.44:4880 , piece_id=CCPOVQB7AUXKAXMVHLITUB6GVCFNKBCORWXOC7W5A54CDR2OFASA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.646945800 (13h54m26.805711535s) [noise=true , address=104.36.82.23:4468 , piece_id=OD45WJDG5OKB3IC4BULXPYHD6V7QTJMLO64KFWPGA6ZR7PO5ZBOQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.651400024 (13h54m26.810165758s) [noise=true , address=104.36.82.16:4315 , piece_id=E2KJWAQ5YZLL3ZEGBEV4U2TL5UVDGM5Y7AF2WTOYPNKI7I7WACVA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.657389944 (13h54m26.816155678s) [noise=true , address=77.90.31.18:4823 , piece_id=SCDSAFCYWBDBAA7PMCW2OTLPMXX3ZTVQEAMGQDDKMZLVQ3JFELKA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660101904 (13h54m26.818867638s) [noise=true , address=45.91.116.12:4236 , piece_id=VYYTQ2L4NJPJYBOCKOT7MW4Q2IPPQY3GUMUYV56NQPRBQRQEP3YA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660121592 (13h54m26.818887326s) [seg_pos={0 0}, upload=12181]: Segment reached optimal threshold of 14 pieces. Aug 26 05:57:59.660309161 (13h54m26.819074895s) [noise=true , address=104.36.82.15:4290 , piece_id=WN3XAYHTTP7MLRD4JBWZA46LCU7ZZOCJG33VXTM4MKVQAMDT4D3A, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660359727 (13h54m26.819125462s) [noise=true , address=77.90.31.19:4862 , piece_id=FEQAYMXTAZTNP3PCTIFJMW7IOWAZ6NRBMLARTS3IUCR2CHKYMKLA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660436014 (13h54m26.819201748s) [noise=true , address=79.127.201.215:4360 , piece_id=NPFLNT5ZXPXHL2G4SBO7G6PBBCED4DVTKUQ7H4AACEBIMHM2E4VQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660500126 (13h54m26.81926586s) [noise=true , address=77.90.31.10:4538 , piece_id=3AQWXQXBHCNYP2XQKCA4LPEDH3ZZ6WHVAYK3LTZS4WNP76DTWDEA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kRwLj3eRSu1a8oRSnUF5NuG6sJ9R9qMmFT89CHXMWB11WQD1N): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660521798 (13h54m26.819287532s) [seg_pos={0 0}, upload=12181]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 26 05:57:59.660580931 (13h54m26.819346665s) [upload=12181]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:57:59.660584878 (13h54m26.819350612s) [upload=12181]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:58:07.696182248 (13h54m34.854947982s) [upload=12181]: Done uploading segments... Aug 26 05:58:07.696231492 (13h54m34.854997226s) [upload=12181]: Upload finished. err: <nil> Duration: 5.787788076s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [.X....X....X.XXXX..X.XX........XX..XX..XX.X.................] duration: 5.981596236s FAIL (2025-08-26 06:15:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 06:01:33.966981454 (13h58m1.125747188s) [upload=12238]: Starting upload Aug 26 06:01:33.967043734 (13h58m1.125809468s) [upload=12238]: Done starting upload Aug 26 06:01:33.967134407 (13h58m1.125900141s) [upload=12238]: Uploading segments... Aug 26 06:01:33.967231903 (13h58m1.125997637s) [upload=12238]: Got next segment. Inline: false Aug 26 06:01:33.967265127 (13h58m1.126030851s) [upload=12238]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 06:01:33.967269485 (13h58m1.126035219s) [upload=12238]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 06:01:36.228682523 (13h58m3.387448257s) [seg_pos={0 0}, upload=12238]: Begin upload segment... Aug 26 06:01:36.228721969 (13h58m3.387487693s) [seg_pos={0 0}, upload=12238]: Done begin upload segment. Aug 26 06:01:36.228741846 (13h58m3.38750757s) [noise=true , address=45.91.116.7:4011 , piece_id=N2JHFX2J2N4HJQMSGDW63KTSYRUNZ5XSSEGPAXDNC7APTVDDXZEA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.228749832 (13h58m3.387515566s) [noise=true , address=45.91.116.14:4190 , piece_id=4Z4ENOGXEXOBEGS23D3CNMDLD7KKTPRCF4UUEEYJIDURLB5NPV2Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.228790529 (13h58m3.387556264s) [noise=true , address=45.91.116.4:4940 , piece_id=EOTFWQ7IA3ZGOKGV6UL76IW3KVBH7BSDUWNJJANSH3RIXV4P3XHQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229133707 (13h58m3.387899441s) [noise=true , address=45.91.116.9:4261 , piece_id=O6EYBDQ346LA2BRQ2JXV3EZY6MIKRGTMY2LMSG7W55PCQ5NOYFHQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229175256 (13h58m3.38794099s) [noise=true , address=77.90.31.12:4590 , piece_id=TKUT2ZV7CIAF4WODX4BS3PVMUFPUB3S4Q5VWLWSOXMTQH3WSCEVA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229559611 (13h58m3.388325355s) [noise=true , address=77.90.31.21:4878 , piece_id=HGMW355XDVQ7C5V3S4TJA4TIETBKSN7TPS4P4GUBQICLN4QAEWPA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229859685 (13h58m3.388625419s) [noise=true , address=45.91.116.13:4155 , piece_id=ZQPF33BDGT3H6WQSI3P7VCFPGE5SF2VXJGPKBXBKENL3MSRRJM7A, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229933657 (13h58m3.388699381s) [noise=true , address=77.90.31.19:4841 , piece_id=ABB6E26HC74OUMTDONDWVIR3J7KQGDRJPWLE3WUPSE5OCQZXSD3Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230227839 (13h58m3.388993563s) [noise=true , address=77.90.31.16:4734 , piece_id=UJMKMSAHDH5X74RPMOKRR2SHTWZNMJPVBCOFV3T3OTCP2DOJR7JA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230234873 (13h58m3.389000607s) [noise=true , address=104.36.82.10:4077 , piece_id=SWDDXFHVEAASFT3QGRVXNJREDIIKXGJWKT2AMC5WBRV3QI356SGQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230512725 (13h58m3.389278449s) [noise=true , address=45.91.116.12:4226 , piece_id=A6YHKD5AFXRKOWQWGFKOMDLPU3OMGKSV2TVM4NRJC35GWZPD7JAQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230645098 (13h58m3.389410832s) [noise=true , address=45.91.116.13:4153 , piece_id=5KVUFP43OT4TBGY6ER7AYPA7GJHLBXURLRBCTJNH2VJM6H27XLCQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230829510 (13h58m3.389595245s) [noise=true , address=77.90.31.14:4663 , piece_id=KTCI2YDX527DYFGHLU3EN7X5CET52EPI3OPZMMM23GVUC6UEWPEA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231136609 (13h58m3.389902343s) [noise=true , address=45.91.116.7:4009 , piece_id=YWY62TMLMAC4RO3VL32S4Y4AICDG23IMLGJFLN5O5AXWJHZOREQA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231242481 (13h58m3.390008225s) [noise=true , address=45.91.116.10:4083 , piece_id=BKKDIJSBDXPFIEBFAE5K3HMZYMUV57DZZZ2PPTKSDN5W26HRUG3Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231384423 (13h58m3.390150147s) [noise=true , address=77.90.31.18:4805 , piece_id=AETDASIPJ37ICCK4EKSLOVLS77S22JBI4GVSBASTZPPSSFZDXK4Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:37.971564373 (13h58m5.130330107s) [upload=12238]: Next returned nil segment Aug 26 06:01:37.971583579 (13h58m5.130349313s) [upload=12238]: Waiting for error group managing segments... Aug 26 06:01:38.251877415 (13h58m5.410643139s) [noise=true , address=45.91.116.14:4190 , piece_id=4Z4ENOGXEXOBEGS23D3CNMDLD7KKTPRCF4UUEEYJIDURLB5NPV2Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.252547697 (13h58m5.411313431s) [noise=true , address=45.91.116.12:4226 , piece_id=A6YHKD5AFXRKOWQWGFKOMDLPU3OMGKSV2TVM4NRJC35GWZPD7JAQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.261324140 (13h58m5.420089874s) [noise=true , address=45.91.116.13:4155 , piece_id=ZQPF33BDGT3H6WQSI3P7VCFPGE5SF2VXJGPKBXBKENL3MSRRJM7A, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.262792210 (13h58m5.421557944s) [noise=true , address=77.90.31.19:4841 , piece_id=ABB6E26HC74OUMTDONDWVIR3J7KQGDRJPWLE3WUPSE5OCQZXSD3Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.267644835 (13h58m5.426410569s) [noise=true , address=45.91.116.13:4153 , piece_id=5KVUFP43OT4TBGY6ER7AYPA7GJHLBXURLRBCTJNH2VJM6H27XLCQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.269180032 (13h58m5.427945766s) [noise=true , address=45.91.116.7:4009 , piece_id=YWY62TMLMAC4RO3VL32S4Y4AICDG23IMLGJFLN5O5AXWJHZOREQA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.277360584 (13h58m5.436126318s) [noise=true , address=45.91.116.9:4261 , piece_id=O6EYBDQ346LA2BRQ2JXV3EZY6MIKRGTMY2LMSG7W55PCQ5NOYFHQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.288401611 (13h58m5.447167335s) [noise=true , address=45.91.116.7:4011 , piece_id=N2JHFX2J2N4HJQMSGDW63KTSYRUNZ5XSSEGPAXDNC7APTVDDXZEA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.326794461 (13h58m5.485560195s) [noise=true , address=45.91.116.10:4083 , piece_id=BKKDIJSBDXPFIEBFAE5K3HMZYMUV57DZZZ2PPTKSDN5W26HRUG3Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.327600795 (13h58m5.486366529s) [noise=true , address=77.90.31.12:4590 , piece_id=TKUT2ZV7CIAF4WODX4BS3PVMUFPUB3S4Q5VWLWSOXMTQH3WSCEVA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.330252889 (13h58m5.489018633s) [noise=true , address=77.90.31.14:4663 , piece_id=KTCI2YDX527DYFGHLU3EN7X5CET52EPI3OPZMMM23GVUC6UEWPEA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.337759492 (13h58m5.496525226s) [noise=true , address=104.36.82.10:4077 , piece_id=SWDDXFHVEAASFT3QGRVXNJREDIIKXGJWKT2AMC5WBRV3QI356SGQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.341411059 (13h58m5.500176803s) [noise=true , address=45.91.116.4:4940 , piece_id=EOTFWQ7IA3ZGOKGV6UL76IW3KVBH7BSDUWNJJANSH3RIXV4P3XHQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.341436287 (13h58m5.500202021s) [seg_pos={0 0}, upload=12238]: Segment reached optimal threshold of 13 pieces. Aug 26 06:01:38.341547309 (13h58m5.500313043s) [noise=true , address=77.90.31.21:4878 , piece_id=HGMW355XDVQ7C5V3S4TJA4TIETBKSN7TPS4P4GUBQICLN4QAEWPA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341666147 (13h58m5.500431882s) [noise=true , address=77.90.31.16:4734 , piece_id=UJMKMSAHDH5X74RPMOKRR2SHTWZNMJPVBCOFV3T3OTCP2DOJR7JA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341725080 (13h58m5.500490814s) [noise=true , address=77.90.31.18:4805 , piece_id=AETDASIPJ37ICCK4EKSLOVLS77S22JBI4GVSBASTZPPSSFZDXK4Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341751140 (13h58m5.500516874s) [seg_pos={0 0}, upload=12238]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 06:01:38.341841753 (13h58m5.500607487s) [upload=12238]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 06:01:38.341846252 (13h58m5.500611986s) [upload=12238]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 06:01:43.222504557 (13h58m10.381270291s) [upload=12238]: Done uploading segments... Aug 26 06:01:43.222522181 (13h58m10.381287915s) [upload=12238]: Upload finished. err: <nil> Duration: 5.981630021s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...XXX.....XXX.XX.............X...X.X.XX....................] duration: 5.966850697s FAIL (2025-08-26 06:15:42 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.966875855s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 8 out of 60 is failed (threshold=3) [..........X......XXX............XX..X..X....................] duration: 697.045458ms remote: "tcp:45.38.24.2:443" response headers: Content-Length=433 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 06:00:36 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=185F3BB6D312505B X-Request-Id=6Gw8NdfoL57 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 06:15:36 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3BB6D312505B</RequestId><HostId></HostId></Error>" Duration: 697.066697ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [............X.......X..X..........X....X....................] duration: 280.244812ms remote: "tcp:185.244.226.2:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Date=Tue, 26 Aug 2025 06:00:37 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Origin=* X-Request-Id=77T4Bv5mHju target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 06:15:31 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 280.25981ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [.........XX.XX.....XXXX............X.....XX.................] duration: 1.89881524s FAIL (2025-08-26 06:15:30 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 1.898843733s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........XX..X...X.XX...........XXX.XX.X.....................] duration: 5.486315054s FAIL (2025-08-26 06:15:21 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.48634374s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 7 out of 60 is failed (threshold=3) [........X.XX.....X.X...............XX.......................] duration: 5.538967003s FAIL (2025-08-26 06:15:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:57:53.229787528 (13h54m20.388553262s) [upload=12181]: Starting upload Aug 26 05:57:53.229866149 (13h54m20.388631883s) [upload=12181]: Done starting upload Aug 26 05:57:53.229949559 (13h54m20.388715293s) [upload=12181]: Uploading segments... Aug 26 05:57:53.230047747 (13h54m20.388813481s) [upload=12181]: Got next segment. Inline: false Aug 26 05:57:53.230078435 (13h54m20.388844169s) [upload=12181]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:57:53.230083365 (13h54m20.388849099s) [upload=12181]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:57:57.671117492 (13h54m24.829883226s) [seg_pos={0 0}, upload=12181]: Begin upload segment... Aug 26 05:57:57.671158381 (13h54m24.829924115s) [seg_pos={0 0}, upload=12181]: Done begin upload segment. Aug 26 05:57:57.671178558 (13h54m24.829944293s) [noise=true , address=104.36.82.15:4290 , piece_id=WN3XAYHTTP7MLRD4JBWZA46LCU7ZZOCJG33VXTM4MKVQAMDT4D3A, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671225048 (13h54m24.829990782s) [noise=true , address=79.127.201.215:4360 , piece_id=NPFLNT5ZXPXHL2G4SBO7G6PBBCED4DVTKUQ7H4AACEBIMHM2E4VQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671552484 (13h54m24.830318208s) [noise=true , address=45.91.116.4:4960 , piece_id=7X22MD7TCFLRW4G47Q4P3HRSF2QNQCGOYWJBUFTSM66OSFBRQDEA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671741506 (13h54m24.83050724s) [noise=true , address=104.36.82.23:4468 , piece_id=OD45WJDG5OKB3IC4BULXPYHD6V7QTJMLO64KFWPGA6ZR7PO5ZBOQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671838101 (13h54m24.830603835s) [noise=true , address=77.90.31.10:4538 , piece_id=3AQWXQXBHCNYP2XQKCA4LPEDH3ZZ6WHVAYK3LTZS4WNP76DTWDEA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672083650 (13h54m24.830849384s) [noise=true , address=64.49.13.154:4934 , piece_id=T55ATJHP6AO2BIKFYO6WBOLERUI7FNFUCTSOQ4ASPD6FNDJKJWSA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672177120 (13h54m24.830942854s) [noise=true , address=77.90.31.14:4681 , piece_id=MPGCU5ZSZEL4VKCOYMS7ZX5A57BY46FLU4P3CQ4KITEWWOUDJ4LQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672491421 (13h54m24.831257155s) [noise=true , address=77.90.31.19:4862 , piece_id=FEQAYMXTAZTNP3PCTIFJMW7IOWAZ6NRBMLARTS3IUCR2CHKYMKLA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672508203 (13h54m24.831273937s) [noise=true , address=104.36.82.10:4088 , piece_id=CPDOJATUHTB5OFXSYTI2JFQ5ZSXSJCOV5B6DU3HILFJNIHGNYMRA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672788690 (13h54m24.831554414s) [noise=true , address=77.90.31.18:4823 , piece_id=SCDSAFCYWBDBAA7PMCW2OTLPMXX3ZTVQEAMGQDDKMZLVQ3JFELKA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672887669 (13h54m24.831653403s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NKL4MGXJGQPYRSOHJII3ONXFXZLYON5SAH5KYIZKG7XM3RBGAQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673083794 (13h54m24.831849518s) [noise=true , address=156.146.43.225:4450 , piece_id=P3CORXRBNMVYZR3M2VJWPDE5LKL6BYAK2VOW6PW6FO7GZNXPHHHQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673200808 (13h54m24.831966542s) [noise=true , address=79.127.219.51:4199 , piece_id=HIRZ2XKQBZ64DP3C37LGLKOZOZKI4EF6MGQYMNIQGKPZSJCWXTYQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673305198 (13h54m24.832070922s) [noise=true , address=45.91.116.12:4236 , piece_id=VYYTQ2L4NJPJYBOCKOT7MW4Q2IPPQY3GUMUYV56NQPRBQRQEP3YA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673460926 (13h54m24.83222666s) [noise=true , address=104.36.82.5:4857 , piece_id=UYH3F2UZXZPJS33QLL2TFF3QMT3RSVGIBZDPHJMTGPH5VLAZ27OA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673715744 (13h54m24.832481468s) [noise=true , address=104.36.82.16:4315 , piece_id=E2KJWAQ5YZLL3ZEGBEV4U2TL5UVDGM5Y7AF2WTOYPNKI7I7WACVA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673839791 (13h54m24.832605525s) [noise=true , address=104.36.82.44:4880 , piece_id=CCPOVQB7AUXKAXMVHLITUB6GVCFNKBCORWXOC7W5A54CDR2OFASA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.674066565 (13h54m24.832832299s) [noise=true , address=104.36.82.50:4028 , piece_id=ZF55MSIK6YVWAMZZVADOCOEMGWGV3KVF57DMBUIC5FW4G5H576ZA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:58.853667308 (13h54m26.012433042s) [upload=12181]: Next returned nil segment Aug 26 05:57:58.853685563 (13h54m26.012451287s) [upload=12181]: Waiting for error group managing segments... Aug 26 05:57:59.158597313 (13h54m26.317363047s) [noise=true , address=64.49.13.154:4934 , piece_id=T55ATJHP6AO2BIKFYO6WBOLERUI7FNFUCTSOQ4ASPD6FNDJKJWSA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.530803022 (13h54m26.689568757s) [noise=true , address=79.127.219.51:4199 , piece_id=HIRZ2XKQBZ64DP3C37LGLKOZOZKI4EF6MGQYMNIQGKPZSJCWXTYQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.590970267 (13h54m26.749735991s) [noise=true , address=45.91.116.4:4960 , piece_id=7X22MD7TCFLRW4G47Q4P3HRSF2QNQCGOYWJBUFTSM66OSFBRQDEA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.591150923 (13h54m26.749916657s) [noise=true , address=104.36.82.50:4028 , piece_id=ZF55MSIK6YVWAMZZVADOCOEMGWGV3KVF57DMBUIC5FW4G5H576ZA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.592999480 (13h54m26.751765214s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NKL4MGXJGQPYRSOHJII3ONXFXZLYON5SAH5KYIZKG7XM3RBGAQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.609956145 (13h54m26.768721879s) [noise=true , address=156.146.43.225:4450 , piece_id=P3CORXRBNMVYZR3M2VJWPDE5LKL6BYAK2VOW6PW6FO7GZNXPHHHQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.615646122 (13h54m26.774411846s) [noise=true , address=104.36.82.10:4088 , piece_id=CPDOJATUHTB5OFXSYTI2JFQ5ZSXSJCOV5B6DU3HILFJNIHGNYMRA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.618123673 (13h54m26.776889427s) [noise=true , address=104.36.82.5:4857 , piece_id=UYH3F2UZXZPJS33QLL2TFF3QMT3RSVGIBZDPHJMTGPH5VLAZ27OA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.623700524 (13h54m26.782466258s) [noise=true , address=77.90.31.14:4681 , piece_id=MPGCU5ZSZEL4VKCOYMS7ZX5A57BY46FLU4P3CQ4KITEWWOUDJ4LQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.626669584 (13h54m26.785435318s) [noise=true , address=104.36.82.44:4880 , piece_id=CCPOVQB7AUXKAXMVHLITUB6GVCFNKBCORWXOC7W5A54CDR2OFASA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.646945800 (13h54m26.805711535s) [noise=true , address=104.36.82.23:4468 , piece_id=OD45WJDG5OKB3IC4BULXPYHD6V7QTJMLO64KFWPGA6ZR7PO5ZBOQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.651400024 (13h54m26.810165758s) [noise=true , address=104.36.82.16:4315 , piece_id=E2KJWAQ5YZLL3ZEGBEV4U2TL5UVDGM5Y7AF2WTOYPNKI7I7WACVA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.657389944 (13h54m26.816155678s) [noise=true , address=77.90.31.18:4823 , piece_id=SCDSAFCYWBDBAA7PMCW2OTLPMXX3ZTVQEAMGQDDKMZLVQ3JFELKA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660101904 (13h54m26.818867638s) [noise=true , address=45.91.116.12:4236 , piece_id=VYYTQ2L4NJPJYBOCKOT7MW4Q2IPPQY3GUMUYV56NQPRBQRQEP3YA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660121592 (13h54m26.818887326s) [seg_pos={0 0}, upload=12181]: Segment reached optimal threshold of 14 pieces. Aug 26 05:57:59.660309161 (13h54m26.819074895s) [noise=true , address=104.36.82.15:4290 , piece_id=WN3XAYHTTP7MLRD4JBWZA46LCU7ZZOCJG33VXTM4MKVQAMDT4D3A, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660359727 (13h54m26.819125462s) [noise=true , address=77.90.31.19:4862 , piece_id=FEQAYMXTAZTNP3PCTIFJMW7IOWAZ6NRBMLARTS3IUCR2CHKYMKLA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660436014 (13h54m26.819201748s) [noise=true , address=79.127.201.215:4360 , piece_id=NPFLNT5ZXPXHL2G4SBO7G6PBBCED4DVTKUQ7H4AACEBIMHM2E4VQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660500126 (13h54m26.81926586s) [noise=true , address=77.90.31.10:4538 , piece_id=3AQWXQXBHCNYP2XQKCA4LPEDH3ZZ6WHVAYK3LTZS4WNP76DTWDEA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kRwLj3eRSu1a8oRSnUF5NuG6sJ9R9qMmFT89CHXMWB11WQD1N): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660521798 (13h54m26.819287532s) [seg_pos={0 0}, upload=12181]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 26 05:57:59.660580931 (13h54m26.819346665s) [upload=12181]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:57:59.660584878 (13h54m26.819350612s) [upload=12181]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:58:07.696182248 (13h54m34.854947982s) [upload=12181]: Done uploading segments... Aug 26 05:58:07.696231492 (13h54m34.854997226s) [upload=12181]: Upload finished. err: <nil> Duration: 5.539002372s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 10 out of 60 is failed (threshold=3) [.......XX.XX.....XXX.X...........XX.........................] duration: 1.896231205s FAIL (2025-08-26 06:15:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:56:16.833543439 (13h52m43.992309173s) [upload=12161]: Starting upload Aug 26 05:56:16.833599205 (13h52m43.992364939s) [upload=12161]: Done starting upload Aug 26 05:56:16.833651586 (13h52m43.99241731s) [upload=12161]: Uploading segments... Aug 26 05:56:16.833712372 (13h52m43.992478106s) [upload=12161]: Got next segment. Inline: true Aug 26 05:56:16.833717171 (13h52m43.992482905s) [upload=12161]: Waiting for error group managing segments... Aug 26 05:56:16.833768870 (13h52m43.992534604s) [upload=12161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:56:16.833774881 (13h52m43.992540615s) [upload=12161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:56:16.833793016 (13h52m43.99255875s) [upload=12161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:56:17.243509800 (13h52m44.402275534s) [upload=12161]: Done uploading segments... Aug 26 05:56:17.243527964 (13h52m44.402293699s) [upload=12161]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 1.896261982s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [.......XX.X...................X.............................] duration: 273.944105ms remote: "tcp:207.211.208.129:443" response headers: X-Xss-Protection=1; mode=block Accept-Ranges=bytes Date=Tue, 26 Aug 2025 05:56:05 GMT Content-Length=423 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=185F3B77B1A24724 X-Request-Id=jE3iVaxRVjP target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 06:15:14 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3B77B1A24724</RequestId><HostId></HostId></Error>" Duration: 273.969986ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [.XX.....X.....X....XXXX..........X..XXX.X...................] duration: 2.266187078s FAIL (2025-08-26 06:15:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.266212517s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [.X.XX........XX.XX....X..XX.........XX.X.XXX................] duration: 1.88649346s FAIL (2025-08-26 06:15:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 06:01:08.342560001 (13h57m35.501325736s) [upload=12234]: Starting upload Aug 26 06:01:08.342643181 (13h57m35.501408915s) [upload=12234]: Done starting upload Aug 26 06:01:08.342701543 (13h57m35.501467277s) [upload=12234]: Uploading segments... Aug 26 06:01:08.342775774 (13h57m35.501541509s) [upload=12234]: Got next segment. Inline: true Aug 26 06:01:08.342780554 (13h57m35.501546289s) [upload=12234]: Waiting for error group managing segments... Aug 26 06:01:08.342822424 (13h57m35.501588158s) [upload=12234]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 06:01:08.342827043 (13h57m35.501592777s) [upload=12234]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 06:01:08.342829718 (13h57m35.501595452s) [upload=12234]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 06:01:12.739727752 (13h57m39.898493507s) [upload=12234]: Done uploading segments... Aug 26 06:01:12.739748322 (13h57m39.898514056s) [upload=12234]: Upload finished. err: <nil> Duration:* 1.886542695s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........X.....X................X.........................] duration: 7.452963606s FAIL (2025-08-26 06:15:02 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3B7C25E954D0, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 7.452982113s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 9 out of 60 is failed (threshold=3) [X..........X......XXX............XX..X..X...................] duration: 707.527456ms remote: "tcp:45.38.24.2:443" response headers: Content-Length=433 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 06:00:36 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=185F3BB6D312505B X-Request-Id=6Gw8NdfoL57 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 06:14:58 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3BB6D312505B</RequestId><HostId></HostId></Error>" Duration: 707.551481ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [..XX.....X.....X....XXXX..........X..XXX.X..................] duration: 2.38050696s FAIL (2025-08-26 06:14:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.380531798s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [X.........XX.XX.....XXXX............X.....XX................] duration: 1.889312596s FAIL (2025-08-26 06:14:44 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 1.889337475s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [X...XXX.....XXX.XX.............X...X.X.XX...................] duration: 6.174770961s FAIL (2025-08-26 06:14:40 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.174792623s edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [.............X.......X..X..........X....X...................] duration: 237.669176ms remote: "tcp:185.244.226.2:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Date=Tue, 26 Aug 2025 06:00:37 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Origin=* X-Request-Id=77T4Bv5mHju target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 06:14:37 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 237.701549ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [..X....X....X.XXXX..X.XX........XX..XX..XX.X................] duration: 5.898715544s FAIL (2025-08-26 06:14:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 06:01:33.966981454 (13h58m1.125747188s) [upload=12238]: Starting upload Aug 26 06:01:33.967043734 (13h58m1.125809468s) [upload=12238]: Done starting upload Aug 26 06:01:33.967134407 (13h58m1.125900141s) [upload=12238]: Uploading segments... Aug 26 06:01:33.967231903 (13h58m1.125997637s) [upload=12238]: Got next segment. Inline: false Aug 26 06:01:33.967265127 (13h58m1.126030851s) [upload=12238]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 06:01:33.967269485 (13h58m1.126035219s) [upload=12238]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 06:01:36.228682523 (13h58m3.387448257s) [seg_pos={0 0}, upload=12238]: Begin upload segment... Aug 26 06:01:36.228721969 (13h58m3.387487693s) [seg_pos={0 0}, upload=12238]: Done begin upload segment. Aug 26 06:01:36.228741846 (13h58m3.38750757s) [noise=true , address=45.91.116.7:4011 , piece_id=N2JHFX2J2N4HJQMSGDW63KTSYRUNZ5XSSEGPAXDNC7APTVDDXZEA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.228749832 (13h58m3.387515566s) [noise=true , address=45.91.116.14:4190 , piece_id=4Z4ENOGXEXOBEGS23D3CNMDLD7KKTPRCF4UUEEYJIDURLB5NPV2Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.228790529 (13h58m3.387556264s) [noise=true , address=45.91.116.4:4940 , piece_id=EOTFWQ7IA3ZGOKGV6UL76IW3KVBH7BSDUWNJJANSH3RIXV4P3XHQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229133707 (13h58m3.387899441s) [noise=true , address=45.91.116.9:4261 , piece_id=O6EYBDQ346LA2BRQ2JXV3EZY6MIKRGTMY2LMSG7W55PCQ5NOYFHQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229175256 (13h58m3.38794099s) [noise=true , address=77.90.31.12:4590 , piece_id=TKUT2ZV7CIAF4WODX4BS3PVMUFPUB3S4Q5VWLWSOXMTQH3WSCEVA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229559611 (13h58m3.388325355s) [noise=true , address=77.90.31.21:4878 , piece_id=HGMW355XDVQ7C5V3S4TJA4TIETBKSN7TPS4P4GUBQICLN4QAEWPA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229859685 (13h58m3.388625419s) [noise=true , address=45.91.116.13:4155 , piece_id=ZQPF33BDGT3H6WQSI3P7VCFPGE5SF2VXJGPKBXBKENL3MSRRJM7A, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.229933657 (13h58m3.388699381s) [noise=true , address=77.90.31.19:4841 , piece_id=ABB6E26HC74OUMTDONDWVIR3J7KQGDRJPWLE3WUPSE5OCQZXSD3Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230227839 (13h58m3.388993563s) [noise=true , address=77.90.31.16:4734 , piece_id=UJMKMSAHDH5X74RPMOKRR2SHTWZNMJPVBCOFV3T3OTCP2DOJR7JA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230234873 (13h58m3.389000607s) [noise=true , address=104.36.82.10:4077 , piece_id=SWDDXFHVEAASFT3QGRVXNJREDIIKXGJWKT2AMC5WBRV3QI356SGQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230512725 (13h58m3.389278449s) [noise=true , address=45.91.116.12:4226 , piece_id=A6YHKD5AFXRKOWQWGFKOMDLPU3OMGKSV2TVM4NRJC35GWZPD7JAQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230645098 (13h58m3.389410832s) [noise=true , address=45.91.116.13:4153 , piece_id=5KVUFP43OT4TBGY6ER7AYPA7GJHLBXURLRBCTJNH2VJM6H27XLCQ, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.230829510 (13h58m3.389595245s) [noise=true , address=77.90.31.14:4663 , piece_id=KTCI2YDX527DYFGHLU3EN7X5CET52EPI3OPZMMM23GVUC6UEWPEA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231136609 (13h58m3.389902343s) [noise=true , address=45.91.116.7:4009 , piece_id=YWY62TMLMAC4RO3VL32S4Y4AICDG23IMLGJFLN5O5AXWJHZOREQA, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231242481 (13h58m3.390008225s) [noise=true , address=45.91.116.10:4083 , piece_id=BKKDIJSBDXPFIEBFAE5K3HMZYMUV57DZZZ2PPTKSDN5W26HRUG3Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:36.231384423 (13h58m3.390150147s) [noise=true , address=77.90.31.18:4805 , piece_id=AETDASIPJ37ICCK4EKSLOVLS77S22JBI4GVSBASTZPPSSFZDXK4Q, seg_pos={0 0}, upload=12238]: Uploading piece... Aug 26 06:01:37.971564373 (13h58m5.130330107s) [upload=12238]: Next returned nil segment Aug 26 06:01:37.971583579 (13h58m5.130349313s) [upload=12238]: Waiting for error group managing segments... Aug 26 06:01:38.251877415 (13h58m5.410643139s) [noise=true , address=45.91.116.14:4190 , piece_id=4Z4ENOGXEXOBEGS23D3CNMDLD7KKTPRCF4UUEEYJIDURLB5NPV2Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.252547697 (13h58m5.411313431s) [noise=true , address=45.91.116.12:4226 , piece_id=A6YHKD5AFXRKOWQWGFKOMDLPU3OMGKSV2TVM4NRJC35GWZPD7JAQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.261324140 (13h58m5.420089874s) [noise=true , address=45.91.116.13:4155 , piece_id=ZQPF33BDGT3H6WQSI3P7VCFPGE5SF2VXJGPKBXBKENL3MSRRJM7A, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.262792210 (13h58m5.421557944s) [noise=true , address=77.90.31.19:4841 , piece_id=ABB6E26HC74OUMTDONDWVIR3J7KQGDRJPWLE3WUPSE5OCQZXSD3Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.267644835 (13h58m5.426410569s) [noise=true , address=45.91.116.13:4153 , piece_id=5KVUFP43OT4TBGY6ER7AYPA7GJHLBXURLRBCTJNH2VJM6H27XLCQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.269180032 (13h58m5.427945766s) [noise=true , address=45.91.116.7:4009 , piece_id=YWY62TMLMAC4RO3VL32S4Y4AICDG23IMLGJFLN5O5AXWJHZOREQA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.277360584 (13h58m5.436126318s) [noise=true , address=45.91.116.9:4261 , piece_id=O6EYBDQ346LA2BRQ2JXV3EZY6MIKRGTMY2LMSG7W55PCQ5NOYFHQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.288401611 (13h58m5.447167335s) [noise=true , address=45.91.116.7:4011 , piece_id=N2JHFX2J2N4HJQMSGDW63KTSYRUNZ5XSSEGPAXDNC7APTVDDXZEA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.326794461 (13h58m5.485560195s) [noise=true , address=45.91.116.10:4083 , piece_id=BKKDIJSBDXPFIEBFAE5K3HMZYMUV57DZZZ2PPTKSDN5W26HRUG3Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.327600795 (13h58m5.486366529s) [noise=true , address=77.90.31.12:4590 , piece_id=TKUT2ZV7CIAF4WODX4BS3PVMUFPUB3S4Q5VWLWSOXMTQH3WSCEVA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.330252889 (13h58m5.489018633s) [noise=true , address=77.90.31.14:4663 , piece_id=KTCI2YDX527DYFGHLU3EN7X5CET52EPI3OPZMMM23GVUC6UEWPEA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.337759492 (13h58m5.496525226s) [noise=true , address=104.36.82.10:4077 , piece_id=SWDDXFHVEAASFT3QGRVXNJREDIIKXGJWKT2AMC5WBRV3QI356SGQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.341411059 (13h58m5.500176803s) [noise=true , address=45.91.116.4:4940 , piece_id=EOTFWQ7IA3ZGOKGV6UL76IW3KVBH7BSDUWNJJANSH3RIXV4P3XHQ, seg_pos={0 0}, upload=12238]: Done uploading piece. err: <nil> Aug 26 06:01:38.341436287 (13h58m5.500202021s) [seg_pos={0 0}, upload=12238]: Segment reached optimal threshold of 13 pieces. Aug 26 06:01:38.341547309 (13h58m5.500313043s) [noise=true , address=77.90.31.21:4878 , piece_id=HGMW355XDVQ7C5V3S4TJA4TIETBKSN7TPS4P4GUBQICLN4QAEWPA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341666147 (13h58m5.500431882s) [noise=true , address=77.90.31.16:4734 , piece_id=UJMKMSAHDH5X74RPMOKRR2SHTWZNMJPVBCOFV3T3OTCP2DOJR7JA, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341725080 (13h58m5.500490814s) [noise=true , address=77.90.31.18:4805 , piece_id=AETDASIPJ37ICCK4EKSLOVLS77S22JBI4GVSBASTZPPSSFZDXK4Q, seg_pos={0 0}, upload=12238]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Aug 26 06:01:38.341751140 (13h58m5.500516874s) [seg_pos={0 0}, upload=12238]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 06:01:38.341841753 (13h58m5.500607487s) [upload=12238]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 06:01:38.341846252 (13h58m5.500611986s) [upload=12238]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 06:01:43.222504557 (13h58m10.381270291s) [upload=12238]: Done uploading segments... Aug 26 06:01:43.222522181 (13h58m10.381287915s) [upload=12238]: Upload finished. err: <nil> Duration: 5.898748777s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............X.....X................X........................] duration: 6.665052285s FAIL (2025-08-26 06:14:28 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3B7C25E954D0, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 6.665071834s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.........XX..X...X.XX...........XXX.XX.X....................] duration: 5.817304862s FAIL (2025-08-26 06:14:23 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.817326493s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 7 out of 60 is failed (threshold=3) [.........X.XX.....X.X...............XX......................] duration: 5.981808355s FAIL (2025-08-26 06:14:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:57:53.229787528 (13h54m20.388553262s) [upload=12181]: Starting upload Aug 26 05:57:53.229866149 (13h54m20.388631883s) [upload=12181]: Done starting upload Aug 26 05:57:53.229949559 (13h54m20.388715293s) [upload=12181]: Uploading segments... Aug 26 05:57:53.230047747 (13h54m20.388813481s) [upload=12181]: Got next segment. Inline: false Aug 26 05:57:53.230078435 (13h54m20.388844169s) [upload=12181]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:57:53.230083365 (13h54m20.388849099s) [upload=12181]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:57:57.671117492 (13h54m24.829883226s) [seg_pos={0 0}, upload=12181]: Begin upload segment... Aug 26 05:57:57.671158381 (13h54m24.829924115s) [seg_pos={0 0}, upload=12181]: Done begin upload segment. Aug 26 05:57:57.671178558 (13h54m24.829944293s) [noise=true , address=104.36.82.15:4290 , piece_id=WN3XAYHTTP7MLRD4JBWZA46LCU7ZZOCJG33VXTM4MKVQAMDT4D3A, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671225048 (13h54m24.829990782s) [noise=true , address=79.127.201.215:4360 , piece_id=NPFLNT5ZXPXHL2G4SBO7G6PBBCED4DVTKUQ7H4AACEBIMHM2E4VQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671552484 (13h54m24.830318208s) [noise=true , address=45.91.116.4:4960 , piece_id=7X22MD7TCFLRW4G47Q4P3HRSF2QNQCGOYWJBUFTSM66OSFBRQDEA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671741506 (13h54m24.83050724s) [noise=true , address=104.36.82.23:4468 , piece_id=OD45WJDG5OKB3IC4BULXPYHD6V7QTJMLO64KFWPGA6ZR7PO5ZBOQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.671838101 (13h54m24.830603835s) [noise=true , address=77.90.31.10:4538 , piece_id=3AQWXQXBHCNYP2XQKCA4LPEDH3ZZ6WHVAYK3LTZS4WNP76DTWDEA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672083650 (13h54m24.830849384s) [noise=true , address=64.49.13.154:4934 , piece_id=T55ATJHP6AO2BIKFYO6WBOLERUI7FNFUCTSOQ4ASPD6FNDJKJWSA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672177120 (13h54m24.830942854s) [noise=true , address=77.90.31.14:4681 , piece_id=MPGCU5ZSZEL4VKCOYMS7ZX5A57BY46FLU4P3CQ4KITEWWOUDJ4LQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672491421 (13h54m24.831257155s) [noise=true , address=77.90.31.19:4862 , piece_id=FEQAYMXTAZTNP3PCTIFJMW7IOWAZ6NRBMLARTS3IUCR2CHKYMKLA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672508203 (13h54m24.831273937s) [noise=true , address=104.36.82.10:4088 , piece_id=CPDOJATUHTB5OFXSYTI2JFQ5ZSXSJCOV5B6DU3HILFJNIHGNYMRA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672788690 (13h54m24.831554414s) [noise=true , address=77.90.31.18:4823 , piece_id=SCDSAFCYWBDBAA7PMCW2OTLPMXX3ZTVQEAMGQDDKMZLVQ3JFELKA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.672887669 (13h54m24.831653403s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NKL4MGXJGQPYRSOHJII3ONXFXZLYON5SAH5KYIZKG7XM3RBGAQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673083794 (13h54m24.831849518s) [noise=true , address=156.146.43.225:4450 , piece_id=P3CORXRBNMVYZR3M2VJWPDE5LKL6BYAK2VOW6PW6FO7GZNXPHHHQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673200808 (13h54m24.831966542s) [noise=true , address=79.127.219.51:4199 , piece_id=HIRZ2XKQBZ64DP3C37LGLKOZOZKI4EF6MGQYMNIQGKPZSJCWXTYQ, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673305198 (13h54m24.832070922s) [noise=true , address=45.91.116.12:4236 , piece_id=VYYTQ2L4NJPJYBOCKOT7MW4Q2IPPQY3GUMUYV56NQPRBQRQEP3YA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673460926 (13h54m24.83222666s) [noise=true , address=104.36.82.5:4857 , piece_id=UYH3F2UZXZPJS33QLL2TFF3QMT3RSVGIBZDPHJMTGPH5VLAZ27OA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673715744 (13h54m24.832481468s) [noise=true , address=104.36.82.16:4315 , piece_id=E2KJWAQ5YZLL3ZEGBEV4U2TL5UVDGM5Y7AF2WTOYPNKI7I7WACVA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.673839791 (13h54m24.832605525s) [noise=true , address=104.36.82.44:4880 , piece_id=CCPOVQB7AUXKAXMVHLITUB6GVCFNKBCORWXOC7W5A54CDR2OFASA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:57.674066565 (13h54m24.832832299s) [noise=true , address=104.36.82.50:4028 , piece_id=ZF55MSIK6YVWAMZZVADOCOEMGWGV3KVF57DMBUIC5FW4G5H576ZA, seg_pos={0 0}, upload=12181]: Uploading piece... Aug 26 05:57:58.853667308 (13h54m26.012433042s) [upload=12181]: Next returned nil segment Aug 26 05:57:58.853685563 (13h54m26.012451287s) [upload=12181]: Waiting for error group managing segments... Aug 26 05:57:59.158597313 (13h54m26.317363047s) [noise=true , address=64.49.13.154:4934 , piece_id=T55ATJHP6AO2BIKFYO6WBOLERUI7FNFUCTSOQ4ASPD6FNDJKJWSA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.530803022 (13h54m26.689568757s) [noise=true , address=79.127.219.51:4199 , piece_id=HIRZ2XKQBZ64DP3C37LGLKOZOZKI4EF6MGQYMNIQGKPZSJCWXTYQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.590970267 (13h54m26.749735991s) [noise=true , address=45.91.116.4:4960 , piece_id=7X22MD7TCFLRW4G47Q4P3HRSF2QNQCGOYWJBUFTSM66OSFBRQDEA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.591150923 (13h54m26.749916657s) [noise=true , address=104.36.82.50:4028 , piece_id=ZF55MSIK6YVWAMZZVADOCOEMGWGV3KVF57DMBUIC5FW4G5H576ZA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.592999480 (13h54m26.751765214s) [noise=true , address=104.36.82.60:4363 , piece_id=J7NKL4MGXJGQPYRSOHJII3ONXFXZLYON5SAH5KYIZKG7XM3RBGAQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.609956145 (13h54m26.768721879s) [noise=true , address=156.146.43.225:4450 , piece_id=P3CORXRBNMVYZR3M2VJWPDE5LKL6BYAK2VOW6PW6FO7GZNXPHHHQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.615646122 (13h54m26.774411846s) [noise=true , address=104.36.82.10:4088 , piece_id=CPDOJATUHTB5OFXSYTI2JFQ5ZSXSJCOV5B6DU3HILFJNIHGNYMRA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.618123673 (13h54m26.776889427s) [noise=true , address=104.36.82.5:4857 , piece_id=UYH3F2UZXZPJS33QLL2TFF3QMT3RSVGIBZDPHJMTGPH5VLAZ27OA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.623700524 (13h54m26.782466258s) [noise=true , address=77.90.31.14:4681 , piece_id=MPGCU5ZSZEL4VKCOYMS7ZX5A57BY46FLU4P3CQ4KITEWWOUDJ4LQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.626669584 (13h54m26.785435318s) [noise=true , address=104.36.82.44:4880 , piece_id=CCPOVQB7AUXKAXMVHLITUB6GVCFNKBCORWXOC7W5A54CDR2OFASA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.646945800 (13h54m26.805711535s) [noise=true , address=104.36.82.23:4468 , piece_id=OD45WJDG5OKB3IC4BULXPYHD6V7QTJMLO64KFWPGA6ZR7PO5ZBOQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.651400024 (13h54m26.810165758s) [noise=true , address=104.36.82.16:4315 , piece_id=E2KJWAQ5YZLL3ZEGBEV4U2TL5UVDGM5Y7AF2WTOYPNKI7I7WACVA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.657389944 (13h54m26.816155678s) [noise=true , address=77.90.31.18:4823 , piece_id=SCDSAFCYWBDBAA7PMCW2OTLPMXX3ZTVQEAMGQDDKMZLVQ3JFELKA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660101904 (13h54m26.818867638s) [noise=true , address=45.91.116.12:4236 , piece_id=VYYTQ2L4NJPJYBOCKOT7MW4Q2IPPQY3GUMUYV56NQPRBQRQEP3YA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660121592 (13h54m26.818887326s) [seg_pos={0 0}, upload=12181]: Segment reached optimal threshold of 14 pieces. Aug 26 05:57:59.660309161 (13h54m26.819074895s) [noise=true , address=104.36.82.15:4290 , piece_id=WN3XAYHTTP7MLRD4JBWZA46LCU7ZZOCJG33VXTM4MKVQAMDT4D3A, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660359727 (13h54m26.819125462s) [noise=true , address=77.90.31.19:4862 , piece_id=FEQAYMXTAZTNP3PCTIFJMW7IOWAZ6NRBMLARTS3IUCR2CHKYMKLA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: <nil> Aug 26 05:57:59.660436014 (13h54m26.819201748s) [noise=true , address=79.127.201.215:4360 , piece_id=NPFLNT5ZXPXHL2G4SBO7G6PBBCED4DVTKUQ7H4AACEBIMHM2E4VQ, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660500126 (13h54m26.81926586s) [noise=true , address=77.90.31.10:4538 , piece_id=3AQWXQXBHCNYP2XQKCA4LPEDH3ZZ6WHVAYK3LTZS4WNP76DTWDEA, seg_pos={0 0}, upload=12181]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kRwLj3eRSu1a8oRSnUF5NuG6sJ9R9qMmFT89CHXMWB11WQD1N): protocol: expected piece hash; context canceled; EOF Aug 26 05:57:59.660521798 (13h54m26.819287532s) [seg_pos={0 0}, upload=12181]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 26 05:57:59.660580931 (13h54m26.819346665s) [upload=12181]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:57:59.660584878 (13h54m26.819350612s) [upload=12181]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:58:07.696182248 (13h54m34.854947982s) [upload=12181]: Done uploading segments... Aug 26 05:58:07.696231492 (13h54m34.854997226s) [upload=12181]: Upload finished. err: <nil> Duration: 5.981835568s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [........XX.X...................X............................] duration: 241.795602ms remote: "tcp:207.211.208.129:443" response headers: X-Xss-Protection=1; mode=block Accept-Ranges=bytes Date=Tue, 26 Aug 2025 05:56:05 GMT Content-Length=423 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=185F3B77B1A24724 X-Request-Id=jE3iVaxRVjP target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 06:14:22 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3B77B1A24724</RequestId><HostId></HostId></Error>" Duration: 241.820099ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [.X.........XX.XX.....XXXX............X.....XX...............] duration: 1.950353101s FAIL (2025-08-26 06:14:19 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 1.950382729s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 10 out of 60 is failed (threshold=3) [........XX.XX.....XXX.X...........XX........................] duration: 2.056370145s FAIL (2025-08-26 06:14:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:56:16.833543439 (13h52m43.992309173s) [upload=12161]: Starting upload Aug 26 05:56:16.833599205 (13h52m43.992364939s) [upload=12161]: Done starting upload Aug 26 05:56:16.833651586 (13h52m43.99241731s) [upload=12161]: Uploading segments... Aug 26 05:56:16.833712372 (13h52m43.992478106s) [upload=12161]: Got next segment. Inline: true Aug 26 05:56:16.833717171 (13h52m43.992482905s) [upload=12161]: Waiting for error group managing segments... Aug 26 05:56:16.833768870 (13h52m43.992534604s) [upload=12161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:56:16.833774881 (13h52m43.992540615s) [upload=12161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:56:16.833793016 (13h52m43.99255875s) [upload=12161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:56:17.243509800 (13h52m44.402275534s) [upload=12161]: Done uploading segments... Aug 26 05:56:17.243527964 (13h52m44.402293699s) [upload=12161]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 2.056396155s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 14 out of 60 is failed (threshold=3) [X..XX.....X.....X....XXXX..........X..XXX.X.................] duration: 1.746414295s FAIL (2025-08-26 06:14:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.746478149s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [..X.XX........XX.XX....X..XX.........XX.X.XXX...............] duration: 1.828153435s FAIL (2025-08-26 06:14:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 06:01:08.342560001 (13h57m35.501325736s) [upload=12234]: Starting upload Aug 26 06:01:08.342643181 (13h57m35.501408915s) [upload=12234]: Done starting upload Aug 26 06:01:08.342701543 (13h57m35.501467277s) [upload=12234]: Uploading segments... Aug 26 06:01:08.342775774 (13h57m35.501541509s) [upload=12234]: Got next segment. Inline: true Aug 26 06:01:08.342780554 (13h57m35.501546289s) [upload=12234]: Waiting for error group managing segments... Aug 26 06:01:08.342822424 (13h57m35.501588158s) [upload=12234]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 06:01:08.342827043 (13h57m35.501592777s) [upload=12234]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 06:01:08.342829718 (13h57m35.501595452s) [upload=12234]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 06:01:12.739727752 (13h57m39.898493507s) [upload=12234]: Done uploading segments... Aug 26 06:01:12.739748322 (13h57m39.898514056s) [upload=12234]: Upload finished. err: <nil> Duration:* 1.828170488s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............X.....X................X.......................] duration: 6.678893358s FAIL (2025-08-26 06:14:08 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3B7C25E954D0, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 6.678914297s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 11 out of 60 is failed (threshold=3) [X........XX.XX.....XXX.X...........XX.......................] duration: 1.843466024s FAIL (2025-08-26 06:14:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:56:16.833543439 (13h52m43.992309173s) [upload=12161]: Starting upload Aug 26 05:56:16.833599205 (13h52m43.992364939s) [upload=12161]: Done starting upload Aug 26 05:56:16.833651586 (13h52m43.99241731s) [upload=12161]: Uploading segments... Aug 26 05:56:16.833712372 (13h52m43.992478106s) [upload=12161]: Got next segment. Inline: true Aug 26 05:56:16.833717171 (13h52m43.992482905s) [upload=12161]: Waiting for error group managing segments... Aug 26 05:56:16.833768870 (13h52m43.992534604s) [upload=12161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:56:16.833774881 (13h52m43.992540615s) [upload=12161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:56:16.833793016 (13h52m43.99255875s) [upload=12161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:56:17.243509800 (13h52m44.402275534s) [upload=12161]: Done uploading segments... Aug 26 05:56:17.243527964 (13h52m44.402293699s) [upload=12161]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 1.843497575s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 9 out of 60 is failed (threshold=3) [.X..........X......XXX............XX..X..X..................] duration: 707.319727ms remote: "tcp:45.38.24.2:443" response headers: Content-Length=433 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 06:00:36 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=185F3BB6D312505B X-Request-Id=6Gw8NdfoL57 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 06:13:58 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3BB6D312505B</RequestId><HostId></HostId></Error>" Duration: 707.345718ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............X.....X................X......................] duration: 6.444149769s FAIL (2025-08-26 06:13:49 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3B7C25E954D0, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 6.444163335s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [..............X.......X..X..........X....X..................] duration: 281.452493ms remote: "tcp:185.244.226.2:443" response headers: Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Date=Tue, 26 Aug 2025 06:00:37 GMT Content-Type=text/html; charset=utf-8 Access-Control-Allow-Origin=* X-Request-Id=77T4Bv5mHju target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 06:13:44 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 281.478253ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 13 out of 60 is failed (threshold=3) [X.........XX..X...X.XX...........XXX.XX.X...................] duration: 5.821167031s FAIL (2025-08-26 06:13:38 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.821195035s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [X........XX.X...................X...........................] duration: 237.937079ms remote: "tcp:207.211.208.129:443" response headers: X-Xss-Protection=1; mode=block Accept-Ranges=bytes Date=Tue, 26 Aug 2025 05:56:05 GMT Content-Length=423 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=185F3B77B1A24724 X-Request-Id=jE3iVaxRVjP target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 06:13:38 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3B77B1A24724</RequestId><HostId></HostId></Error>" Duration: 237.979181ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.X...XXX.....XXX.XX.............X...X.X.XX..................] duration: 5.590316775s FAIL (2025-08-26 06:13:34 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.590337133s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [..X.........XX.XX.....XXXX............X.....XX..............] duration: 1.902625311s FAIL (2025-08-26 06:13:33 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 1.902654105s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............X.....X................X.....................] duration: 6.605274165s FAIL (2025-08-26 06:13:30 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3B7C25E954D0, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 6.605299754s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)