Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.942688153s FAIL (2025-08-09 03:51:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.942713893s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...................X..............] duration: 2.281714004s FAIL (2025-08-09 03:51:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.281750543s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X....X................] duration: 5.909053637s FAIL (2025-08-09 03:51:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.90907577s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 741.080552ms FAIL (2025-08-09 03:51:11 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 741.103357ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.................X......................X............X..] duration: 5.566380217s FAIL (2025-08-09 03:51:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.566406448s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 738.428528ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:50:59 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 738.449598ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X...................X.............] duration: 2.39531237s FAIL (2025-08-09 03:50:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.395366264s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.051827659s FAIL (2025-08-09 03:50:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 2.051856966s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X....X...............] duration: 6.049816812s FAIL (2025-08-09 03:50:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.049846107s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 762.002294ms FAIL (2025-08-09 03:50:24 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 762.027712ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.874186808s FAIL (2025-08-09 03:49:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.874210864s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.................X......................X............X.] duration: 5.655530961s FAIL (2025-08-09 03:49:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.655554495s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 696.353526ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:49:44 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 696.377792ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X...................X............] duration: 2.513645219s FAIL (2025-08-09 03:49:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.513668282s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.................X......................X............X] duration: 5.950050173s FAIL (2025-08-09 03:49:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.950076653s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X....X..............] duration: 6.343282658s FAIL (2025-08-09 03:49:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.343302957s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 759.321161ms FAIL (2025-08-09 03:49:22 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 759.364614ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X...................X...........] duration: 6.229406769s FAIL (2025-08-09 03:49:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.229429813s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 707.351731ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:49:03 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 707.372821ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 747.739232ms FAIL (2025-08-09 03:49:03 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 747.769742ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X....X.............] duration: 6.13176962s FAIL (2025-08-09 03:49:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.131818405s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.083054437s FAIL (2025-08-09 03:48:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 2.083090005s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.................X......................X............] duration: 5.774143673s FAIL (2025-08-09 03:48:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.774170835s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 778.948865ms FAIL (2025-08-09 03:48:23 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 779.015524ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 896.084603ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:48:20 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 896.112626ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X...................X..........] duration: 2.372955305s FAIL (2025-08-09 03:48:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.372973691s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.................X......................X...........] duration: 5.666138266s FAIL (2025-08-09 03:48:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.666187992s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X....X............] duration: 5.9891879s FAIL (2025-08-09 03:48:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.989210854s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.844614157s FAIL (2025-08-09 03:47:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.844637282s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 797.881199ms FAIL (2025-08-09 03:47:47 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 797.924412ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X...................X.........] duration: 2.34573794s FAIL (2025-08-09 03:47:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.34575369s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X....X...........] duration: 6.000654517s FAIL (2025-08-09 03:47:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.000678652s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.049544531s FAIL (2025-08-09 03:47:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 2.049572174s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.................X......................X..........] duration: 5.561511914s FAIL (2025-08-09 03:47:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.561538074s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 737.939132ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:47:23 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 737.965674ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 755.659417ms FAIL (2025-08-09 03:47:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 755.728339ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.................X......................X.........] duration: 5.750866808s FAIL (2025-08-09 03:46:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.750887126s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.....................X.....................................] duration: 1.805726554s FAIL (2025-08-09 03:46:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.805756322s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X...................X........] duration: 2.395598055s FAIL (2025-08-09 03:46:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.395619095s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X.................X......................X........] duration: 5.792706602s FAIL (2025-08-09 03:46:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.792727422s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 973.41466ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:46:21 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 973.434547ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X....X..........] duration: 7.169562265s FAIL (2025-08-09 03:46:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.169586543s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 775.910673ms FAIL (2025-08-09 03:46:05 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 775.935409ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X.................X......................X.......] duration: 6.08212349s FAIL (2025-08-09 03:45:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 6.082149751s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X.....................X....................................] duration: 1.819867708s FAIL (2025-08-09 03:45:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.819900252s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 721.202791ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:45:34 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 721.226555ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X....X.........] duration: 6.770891084s FAIL (2025-08-09 03:45:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.770913257s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X...................X.......] duration: 8.818328384s FAIL (2025-08-09 03:45:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.818343715s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X.................X......................X......] duration: 6.262817684s FAIL (2025-08-09 03:45:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 6.262840609s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X.....................X...................................] duration: 1.90043961s FAIL (2025-08-09 03:45:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.900465479s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)