Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.871722443s FAIL (2025-08-09 04:00:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.871748985s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X...................X........................] duration: 2.342697381s FAIL (2025-08-09 04:00:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.342746305s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 778.95138ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:00:16 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 778.991156ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X......................X............X...............] duration: 6.056928425s FAIL (2025-08-09 04:00:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 6.056955378s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 741.00558ms FAIL (2025-08-09 04:00:04 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 741.080542ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X....X.........................X..] duration: 6.11995255s FAIL (2025-08-09 04:00:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.119971846s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 707.61815ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:59:30 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 707.642375ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X......................X............X..............] duration: 5.819677875s FAIL (2025-08-09 03:59:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.819702622s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.869713412s FAIL (2025-08-09 03:59:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.869748379s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X...................X.......................] duration: 5.369698167s FAIL (2025-08-09 03:59:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.369738594s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X....X.........................X.] duration: 6.10447801s FAIL (2025-08-09 03:59:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.104490243s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X......................X............X.............] duration: 5.915359024s FAIL (2025-08-09 03:59:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.915385204s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X....X.........................X] duration: 30.000539058s FAIL (2025-08-09 03:59:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000558034s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 763.73131ms FAIL (2025-08-09 03:58:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 763.756017ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X......................X............X............] duration: 5.681771627s FAIL (2025-08-09 03:58:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.681797676s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 736.131083ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:58:38 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 736.151983ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 777.363156ms FAIL (2025-08-09 03:58:24 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 777.389738ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.832795564s FAIL (2025-08-09 03:58:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.832826774s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 704.510192ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:58:14 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 704.537183ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X....X.........................] duration: 6.272057073s FAIL (2025-08-09 03:58:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.27208106s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X...................X......................] duration: 5.309946974s FAIL (2025-08-09 03:58:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.309970419s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X....X........................] duration: 6.031693564s FAIL (2025-08-09 03:57:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.03171821s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X......................X............X...........] duration: 5.601596245s FAIL (2025-08-09 03:57:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.601620142s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 730.724397ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:57:31 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 730.750718ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.86429692s FAIL (2025-08-09 03:57:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.864320885s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 724.755238ms FAIL (2025-08-09 03:57:22 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 724.785956ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X...................X.....................] duration: 2.346055536s FAIL (2025-08-09 03:57:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.346585892s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X....X.......................] duration: 6.138913558s FAIL (2025-08-09 03:56:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.138931812s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.189172653s FAIL (2025-08-09 03:56:47 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.189197141s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X......................X............X..........] duration: 5.618278545s FAIL (2025-08-09 03:56:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.61830663s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.835614739s FAIL (2025-08-09 03:56:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.835641802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 687.791024ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:56:29 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 687.815239ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X....X......................] duration: 6.180758419s FAIL (2025-08-09 03:56:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.180777957s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 767.101138ms FAIL (2025-08-09 03:56:14 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 767.120516ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X......................X............X.........] duration: 5.835103428s FAIL (2025-08-09 03:56:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.835129498s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.327816812s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:55:53 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 2.327837401s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X....X.....................] duration: 6.313795431s FAIL (2025-08-09 03:55:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.313816091s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X...................X....................] duration: 2.377602968s FAIL (2025-08-09 03:55:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.377645979s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 712.684682ms FAIL (2025-08-09 03:55:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 712.727654ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X...................X...................] duration: 3.973356502s FAIL (2025-08-09 03:55:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.973379335s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 691.803271ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:55:33 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 691.824793ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.833022531s FAIL (2025-08-09 03:55:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.833087215s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X......................X............X........] duration: 5.673946359s FAIL (2025-08-09 03:55:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.673977228s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X....X....................] duration: 6.251451202s FAIL (2025-08-09 03:55:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.251474197s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X......................X............X.......] duration: 5.538379514s FAIL (2025-08-09 03:55:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.538416886s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 783.542775ms FAIL (2025-08-09 03:55:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 783.572672ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 712.957233ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:54:52 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 712.983544ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X......................X............X......] duration: 5.785571659s FAIL (2025-08-09 03:54:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.785609782s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...................X..................] duration: 2.304139621s FAIL (2025-08-09 03:54:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.304169456s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.838423404s FAIL (2025-08-09 03:54:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.838449264s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)