Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X....X........................] duration: 6.031693564s FAIL (2025-08-09 03:57:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.03171821s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X......................X............X...........] duration: 5.601596245s FAIL (2025-08-09 03:57:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.601620142s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 730.724397ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:57:31 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 730.750718ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.86429692s FAIL (2025-08-09 03:57:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.864320885s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 724.755238ms FAIL (2025-08-09 03:57:22 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 724.785956ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X...................X.....................] duration: 2.346055536s FAIL (2025-08-09 03:57:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.346585892s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X....X.......................] duration: 6.138913558s FAIL (2025-08-09 03:56:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.138931812s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.189172653s FAIL (2025-08-09 03:56:47 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.189197141s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X......................X............X..........] duration: 5.618278545s FAIL (2025-08-09 03:56:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.61830663s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.835614739s FAIL (2025-08-09 03:56:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.835641802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 687.791024ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:56:29 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 687.815239ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X....X......................] duration: 6.180758419s FAIL (2025-08-09 03:56:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.180777957s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 767.101138ms FAIL (2025-08-09 03:56:14 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 767.120516ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X......................X............X.........] duration: 5.835103428s FAIL (2025-08-09 03:56:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.835129498s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.327816812s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:55:53 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 2.327837401s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X....X.....................] duration: 6.313795431s FAIL (2025-08-09 03:55:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.313816091s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X...................X....................] duration: 2.377602968s FAIL (2025-08-09 03:55:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.377645979s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 712.684682ms FAIL (2025-08-09 03:55:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 712.727654ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X...................X...................] duration: 3.973356502s FAIL (2025-08-09 03:55:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.973379335s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 691.803271ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:55:33 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 691.824793ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.833022531s FAIL (2025-08-09 03:55:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.833087215s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X......................X............X........] duration: 5.673946359s FAIL (2025-08-09 03:55:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.673977228s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X....X....................] duration: 6.251451202s FAIL (2025-08-09 03:55:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.251474197s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X......................X............X.......] duration: 5.538379514s FAIL (2025-08-09 03:55:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.538416886s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 783.542775ms FAIL (2025-08-09 03:55:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 783.572672ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 712.957233ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:54:52 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 712.983544ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X......................X............X......] duration: 5.785571659s FAIL (2025-08-09 03:54:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.785609782s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...................X..................] duration: 2.304139621s FAIL (2025-08-09 03:54:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.304169456s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.838423404s FAIL (2025-08-09 03:54:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.838449264s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X....X...................] duration: 6.238095932s FAIL (2025-08-09 03:54:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.238137172s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 743.285781ms FAIL (2025-08-09 03:54:19 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 743.325588ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 836.441416ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:54:16 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 836.465132ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.853245653s FAIL (2025-08-09 03:53:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.85327646s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 724.086899ms FAIL (2025-08-09 03:53:52 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 724.113149ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.................X......................X............X.....] duration: 5.785465536s FAIL (2025-08-09 03:53:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.785506565s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 744.641357ms FAIL (2025-08-09 03:53:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 744.670252ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.963359797s FAIL (2025-08-09 03:53:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.963386057s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 704.77985ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:53:35 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 704.799306ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X...................X.................] duration: 2.439702352s FAIL (2025-08-09 03:53:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.439732769s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X....X..................] duration: 6.11554056s FAIL (2025-08-09 03:53:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.115569185s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 749.72486ms FAIL (2025-08-09 03:53:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 749.753645ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...................X................] duration: 2.271979928s FAIL (2025-08-09 03:53:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.272002453s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 707.776753ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:52:38 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 707.805016ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.................X......................X............X....] duration: 5.608917524s FAIL (2025-08-09 03:52:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.608943825s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.82849592s FAIL (2025-08-09 03:52:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.828524473s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X....X.................] duration: 6.172527905s FAIL (2025-08-09 03:52:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.172550609s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 774.42422ms FAIL (2025-08-09 03:52:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 774.454177ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.................X......................X............X...] duration: 5.524192679s FAIL (2025-08-09 03:52:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.524219571s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X...................X...............] duration: 2.347057835s FAIL (2025-08-09 03:52:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.347079737s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 781.527089ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:51:55 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 781.555403ms edge gateway vhost us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)